[Corpora-List] EVALITA 2009 Newsletter No. 1

Manuela Speranza manspera at fbk.eu
Fri Jun 12 12:08:58 CEST 2009


<apologies for cross-posting>

********************************************************************

EVALITA 2009

Evaluation of NLP and Speech Tools for Italian

http://evalita.fbk.eu

********************************************************************

EVALITA 2009 - Newsletter No. 1 June 12th, 2009

We would like to remind you that the registration to EVALITA 2009, the second evaluation campaign of Natural Language Processing and Speech tools for Italian, is open. In order to register for one or more EVALITA tasks, follow the link: http://evalita.itc.it/registration.html

The general objective of EVALITA is to promote the development of language technologies for the Italian language, providing a shared framework where different systems and approaches can be evaluated in a consistent manner. EVALITA is organised with the support of AI*IA (the Italian Association for Artificial Intelligence) and AISV (the Italian Association of Speech Science ).

The results of the evaluation will be disseminated at the final workshop, which will be organized in conjunction with AI*IA 2009 and will take place in Reggio Emilia on December 12th, 2009.

Tasks ----

Text tasks: - PoS-Tagging - Parsing - Lexical substitution - Entity Recognition - Textual Entailment

Speech tasks: - Connected Digits Recognition - Dialogue System Evaluation - Speaker Identity Verification

Training data ----------

Training data for all eight tasks are available. Please follow the link at "Data distribution" from the webpage of each task to get information as to how to obtain them. Test data will be available from September 10th.

Registrations ---------

We have received 39 registrations up to now, from 27 different organizations. Among these, 11 are not Italian and 5 are not academic.

Remind of deadlines --------------

10th September 2009: test data available, registration closes 20th September 2009: system results due to organizers 5th October 2009: assessment returned to participants 25th October 2009: technical reports due to organizers 12th December 2009: final workshop, Reggio Emilia

Organizers --------

Coordination: Bernardo Magnini (FBK-irst) and Amedeo Cappelli (ISTI-CNR and CELCT)

Text tasks: - PoS-Tagging: Giuseppe Attardi and Maria Simi (Uni. Pisa) - Parsing: Cristina Bosco, Alessandro Mazzei, Vincenzo Lombardo (Uni. Torino), Felice dell'Orletta, Alessandro Lenci (Uni. Pisa) and Simonetta Montemagni (ILC-CNR, Pisa) - Lexical Substitution: Antonio Toral (ILC-CNR, Pisa) - Entity Recognition: Manuela Speranza (FBK-irst, Trento), Valentina Bartalesi Lenzi and Rachele Sprugnoli (CELCT, Trento) - Textual Entailment: Johan Bos (Uni. Roma "La Sapienza"), Marco Pennacchiotti (Saarland University) and Fabio Massimo Zanzotto (Uni. Roma "Tor Vergata")

Speech tasks: Scientific coordination: Francesco Cutugno (Uni. Napoli "Federico II") and Mauro Falcone (Fondazione Ugo Bordoni, Roma) - Connected Digits Recognition: Gianpaolo Coro (ABLA, Milano), Roberto Gretter and Marco Matassoni (FBK-irst, Trento) - Spoken Dialogue Evaluation: Giuseppe Riccardi (Uni. Trento), Francesco Cutugno (Uni. Napoli "Federico II"), Roberto Pieraccini (Speechcycle, New York) and Morena Danieli (Loquendo, Torino) - Speaker Identity Verification: Guido Aversano (Parrot SA, Paris) and Luciano Romito (Uni. Calabria, Cosenza)

In order to register for one or more of the EVALITA 2009 tasks, please go to the registration page of the EVALITA 2009 website: http://evalita.fbk.eu/registration.html

For more detailed information please refer to the website at http://evalita.fbk.eu

Timeline

- 1st February 2009: on-line registration opens - 1st April 2009: development data available to participants - 10th September 2009: test data available, registration closes - 20th September 2009: system results due to organizers - 5th October 2009: assessment returned to participants - 25th October 2009: technical reports due to organizers - 12th December 2009: final workshop, Reggio Emilia

Contact: Manuela Speranza - manspera at fbk.eu



More information about the Corpora mailing list