[Corpora-List] EVALITA 2009 Call for Interest

Manuela Speranza manspera at fbk.eu
Thu Nov 13 11:45:41 CET 2008

<apologies for cross-posting>



Evaluation of NLP Tools for Italian



EVALITA 2009 - Call for Interest October 2008

Following the success obtained by Evalita 2007 (http://evalita.fbk.eu/2007), we are pleased to announce Evalita 2009, the second evaluation campaign of Natural Language Processing tools for Italian. The general objective of Evalita is to promote the development of language technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner.

We invite participation, both from academic institutions and industrial organizations, on six tasks: - Part of Speech Tagging - Parsing - Lexical Substitution - Entity Recognition - Anaphora Resolution - Textual Entailment

As with other international evaluation campaigns, guidelines describing the different tasks will be distributed among the participants. Participants will also be provided with training data and will have the chance to test their systems with the evaluation metrics and procedures to be used in the formal evaluation. The results of the evaluation will be disseminated at the final workshop which will be organized in Reggio Emilia in conjunction with AI*IA 2009 (to be confirmed).

More detailed information is available on the Evalita website at http://evalita.fbk.eu. To indicate your intention to participate in one or more tasks at Evalita 2009, please go to the Call for Interest at the Evalita website and fill in the form.

Important dates (check for updates at http://evalita.fbk.eu) 1st January 2009: on-line registration opens 1st February 2009: development data available to participants 20th May 2009: test data available; registration closes 1st June 2009: system results due to organizers 15th June 2009: assessment returned to participants 6 th July 2009: technical reports due to organizers September 2009: final workshop, Reggio Emilia (to be confirmed)

Coordination: Bernardo Magnini (FBK-irst) and Amedeo Cappelli (ISTI-CNR and CELCT)

Task Organization: - PoS-Tagging: Giuseppe Attardi and Maria Simi (Uni. Pisa) - Parsing: Cristina Bosco, Alessandro Mazzei, Vincenzo Lombardo (Uni. Torino)

Felice dell'Orletta, Alessandro Lenci, Simonetta Montemagni (Uni. Pisa - ILC-CNR, Pisa) - Lexical Substitution: Antonio Toral (ILC-CNR, Pisa) - Entity Recognition: Luisa Bentivogli, Manuela Speranza (FBK-irst, Trento),

Valentina Bartalesi Lenzi, Rachele Sprugnoli (CELCT, Trento) - Anaphora Resolution: Massimo Poesio (Uni. Trento), Malvina Nissim, Fabio

Tamburini (Uni. Bologna) - Textual Entailment: Johan Bos (Uni. Roma "La Sapienza"), Marco Pennacchiotti

(Saarland University), Fabio Massimo Zanzotto (Uni. Roma "Tor Vergata")

Contact: Manuela Speranza, manspera at fbk.eu (FBK-irst, Trento)

More information about the Corpora mailing list