International Workshop on Semantic Evaluations
an ACL-SIGLEX event
Call for Participation
The purpose of the SensEval/SemEval workshops (http://en.wikipedia.org/wiki/SemEval) is to evaluate semantic analysis systems. SemEval-2012 will be the next event in the series.
The first three workshops, SensEval-1 through SensEval-3, were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. In 2007 the workshop was renamed SemEval and the next two workshops SemEval-2007 and SemEval-2010 the nature of the tasks evolved to include semantic analysis tasks outside of word sense disambiguation.
We are now getting ready for SemEval-2012! SemEval-2012 will be associated with the new *SEM, First Joint Conference on Lexical and Computational Semantics, and co-located with NAACL, Montreal, Canada.
The list of tasks with complete descriptions and trial data is now available. Here is a short preview of the tasks that will be offered (for more details, please visit our webpage):
1. English Lexical Simplification 2. Measuring Degrees of Relational Similarity 3. Spatial Role Labeling 4. Evaluating Chinese Word Similarity 5. Chinese Semantic Dependency Parsing 6. Semantic Textual Similarity 7. COPA: Choice Of Plausible Alternatives An evaluation of common-sense causal reasoning 8. Cross-lingual Textual Entailment for Content Synchronization
As with previous evaluations, participants will be provided with specific training data, and will have the chance to test their systems on common data sets.
October 26, 2011 Call for participation December 10, 2012 Full Training Data + Test scripts available for participants [TBC] February 10, 2012 Test set ready February 15, 2012 onwards Start of evaluation period [Task Dependent] March 1, 2012 End of Evaluation Period March 10, 2012 Paper submission deadline March 25, 2012 Reviews due April 11, 2012 Camera Ready [TBC]
If you may be interested to participate in SemEval-2012, please let us know by sending the tasks you intend to participate (not binding) to semeval at cs.york.ac.uk and consider joining our discussion group at semeval3 at googlegroups.com.
The SemEval organizers: Suresh Manandhar Deniz Yuret