[Corpora-List] Call for Registration: Shared Task on Irony Detection in Italian Tweets (Evalita 2018)

A.T. Cignarella a.t.cignarella at gmail.com
Thu May 3 12:27:35 CEST 2018


[Apologies for cross-posting]

**********************************

Call for Participants

**********************************

Task: Irony Detection in Italian Tweets (ironITA) in the context of EVALITA 2018 <http://www.evalita.it/2018/> Info: http://di.unito.it/ironita18 Final Workshop: 12-13 December 2018, Turin, Italy (co-located with CLiC-it 2018 <http://clic2018.di.unito.it/en/home-2/>) Registration is required to obtain data and participate in the shared task. ** Register NOW! ** http://www.evalita.it/2018/registration

---------------------------

The ironITA Task

---------------------------

We propose two different subtasks for the automatic detection of irony on Twitter. Participants may choose to participate to both the tasks or only to one sub-task.

A) Irony detection

The first subtask is a two-class (or binary) classification task where the system has to predict whether a tweet is ironic or not.

Given a message, decide whether the message is ironic or not.

B) Different types of irony (with special focus on sarcasm identification)

The second subtask is a multi-class classification task where the system has to predict one out of three labels describing:

i) sarcasm;

ii) irony which cannot be categorized as sarcasm (i.e. other kinds of verbal irony or descriptions of situational irony which do not show the characteristics of sarcasm);

iii) non-irony.

Given a message, decide whether the message is sarcastic, ironic but not sarcastic or not ironic. Notice that in our interpretation sarcasm is a specific kind of irony.

Irony and sarcasm are present in many domains of great interest nowadays, such as hate speech and political stance. For this reason, we will include in our datasets tweets related to those domains. In particular, a portion of tweets will overlap with data from the EVALITA 2018 shared task devoted to Hate Speech Detection (HaSpeeDe).

Further details on the task, data, and evaluation are available at the task website:

http://di.unito.it/ironita18

----------------------

Important Dates

----------------------

-

*28th May 2018: Training set available.*

-

*3rd September 2018: Registration closes.*

-

17th September 2018: Test set available.

-

23rd September 2018: Systems results due to the organizers.

-

1st October 2018: Assessment returned to participants.

-

15th October 2018: Submission of the working notes due to the organizers.

-

25th October 2018: Reviews to participants.

-

5th November 2018: Camera-ready working notes due.

-

12th or 13th December 2018: Final workshop in Turin.

----------------

Organizers

----------------

Alessandra T. Cignarella, University of Torino, Italy (cigna at di.unito.it) [Primary Contact]

Simona Frenda, University of Torino, Italy (frenda at di.unito.it) [Primary Contact]

Cristina Bosco, University of Torino, Italy

Viviana Patti, University of Torino, Italy

Paolo Rosso, Universitat Politècnica de València, Spain

-----------

Contact

-----------

Join the google group: ironita-evalita2018 at googlegroups.com -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 42788 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20180503/a1f79998/attachment.txt>



More information about the Corpora mailing list