[Corpora-List] Call for Participation: Low Resource HLT Evaluation

Ji, Heng jih at rpi.edu
Sat May 7 16:18:26 CEST 2016

________________________________ From: tac-kbp-bounces at nist.gov [tac-kbp-bounces at nist.gov] on behalf of Shudong Huang [snh8 at nist.gov] Sent: Wednesday, May 04, 2016 3:44 PM To: tac-kbp at nist.gov Subject: [TAC-KBP] Call for Participation: Low Resource HLT Evaluation

NIST is pleased to announce a new evaluation series aimed to advance human language technologies that provide rapid and effective response to emerging incidents where the language resources are very limited. This evaluation series is called Low Resource HLT Evaluation (LoReHLT). LoReHLT16 plans to offer three evaluation tasks: machine translation (MT), named entity recognition (NER), and situation frames (SF).


- Three evaluation tasks: MT, NER, and SF - Two training conditions: constrained (required) and unconstrained - Surprise language evaluation - Three evaluation checkpoints to gauge performance based on training resources given

2016 Schedule:

Feb 19 - May 16: Registration period (deadline extended) Jun 2 - 8: Dry run period Jun 29: Encrypted evaluation data released Jul 6: Surprise language announced and evaluation begins Jul 13: Checkpoint 1 due Jul 20: Checkpoint 2 due Aug 3: Checkpoint 3 due Aug 28 – 29: Post evaluation workshop (Nashua, New Hampshire, US)

For more information about the LoReHLT16 evaluation, please see the evaluation plan at <redir.aspx?REF=Dq7YRrEtFP61HyAXGpquFz013HXqEIZBiCfaJQp_R91VuCxGgnbTCAFodHRwOi8vd3d3Lm5pc3QuZ292L2l0bC9pYWQvbWlnL2xvcmVobHQxNi5jZm0.> http://www.nist.gov/itl/iad/<redir.aspx?REF=ghgziaR7OJRdKyY5R7JI57y31KR8AZkGZqFt-AvNNUlVuCxGgnbTCAFodHRwOi8vd3d3Lm5pc3QuZ292L2l0bC9pYWQv>mig/lorehlt16.cfm. If you have any questions, contact us at <redir.aspx?REF=8UEI_jlS_AStYqEQxxtAmHnP6g4Yv1WUeNbvckSLOf9VuCxGgnbTCAFtYWlsdG86bG9yZWhsdF9wb2NAbmlzdC5nb3Y.> lorehlt_poc at nist.gov<redir.aspx?REF=8UEI_jlS_AStYqEQxxtAmHnP6g4Yv1WUeNbvckSLOf9VuCxGgnbTCAFtYWlsdG86bG9yZWhsdF9wb2NAbmlzdC5nb3Y.>.

Feel free to forward this message to your colleagues who may find the evaluation of interest.

Best Regards,

NIST LoReHLT team -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 29342 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20160507/435ce4d6/attachment.txt>

More information about the Corpora mailing list