[Corpora-List] EVALITA 2016 - Call for Interest

Viviana Patti patti at di.unito.it
Mon Apr 4 08:57:49 CEST 2016

(Apologies for cross-posting)



Evaluation of NLP and Speech Tools for Italian


***EVALITA 2016 - Call for Interest***



Following the success of the previous editions, we are pleased to announce EVALITA 2016, the fifth evaluation campaign of Natural Language Processing and Speech tools for Italian.

The general objective of EVALITA (http://www.evalita.it) is to promote the development of language technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner. EVALITA is an initiative of the Italian Association for Computational Linguistics (AILC) and it is endorsed by the Italian Association for Artificial Intelligence (AI*IA) and the Italian Association for Speech Sciences (AISV).

In the context of EVALITA 2016 we are organising the following tasks:

- FactA - Event Factuality Annotation

- NEEL-IT - Named Entity rEcognition and Linking in Italian Tweets

- PoSTWITA - POS tagging for Italian Social Media Texts

- QA­-FAQ - Question Answering for Frequently Asked Questions

- SENTIPOLC - SENTIment POLarity Classification

In addition we launch a new challenge organised by IBM Italy:

- IBM Watson Services Challenge

As with other international evaluation campaigns, guidelines describing the different tasks will be distributed among the participants.

Participants to the tasks will also be provided with training data and will have the chance to test their systems according to the metrics and procedures to be used in the formal evaluation.

The results of the evaluation will be disseminated at the final workshop, which will be organised in Naples on 7 December 2016, immediately after the Third Italian Conference on Computational Linguistics (CLiC-it 2016).

We encourage participation from both academic institutions and industrial organisations. Please visit the EVALITA web site where information about all tasks is currently available, and indicate your intention to participate and the specific task(s) you are interested in. You can do so by filling out the form at the following link, which will be available until April 20th 2016:


Your expression of interest is not at all binding, but it’s very important to us to best organise this evaluation campaign. In any case, independently of your expression of interest now, you will be able to register for any of the tasks once the online registration opens.

IMPORTANT DATES: ----------------

- 20th April 2016: call for interest closes

- 15th May 2016: online registration opens

- 30th May 2016: development data available to participants

- 12th September 2016: test data available, registration closes

- 19th September 2016: system results due to organisers

- 26th September 2016: assessment returned to participants

- 31st October 2016: technical reports due to organisers

- 7th December 2016: final workshop

Scientific coordination: ------------------------

Pierpaolo Basile (Università degli Studi di Bari Aldo Moro) Franco Cutugno (Università degli Studi di Napoli Federico II) Malvina Nissim (Rijksuniversiteit Groningen) Viviana Patti (Università degli Studi di Torino) Rachele Sprugnoli (Fondazione Bruno Kessler and Università degli Studi di Trento)

Contact: --------


FOLLOW US! ----------

Twitter: @EVALITAcampaign Facebook: https://www.facebook.com/evalita2016/

More information about the Corpora mailing list