for BioNLP-OST 2019
BioNLP Open Shared Tasks
We invite submission of task proposals for BioNLP Open Shared Tasks (BioNLP-OST) 2019, which is a continued effort of the BioNLP Shared Task (BioNLP-ST) series. BioNLP-ST, which was organized four times, in 2009, 2011, 2013, and 2016, was a series of evaluations that represent a community-wide trend towards fine-grained information extraction and knowledge acquisition for biomedical applications. This time, we organize it as an “open” framework of shared tasks. In the new framework, task registration will be open to any potential contributor. Please refer to the homepage (http://2019.bionlp-ost.org) for detail of the framework.
As the initial phase for realizing the plan, we invite submission of task proposals. If you have or plan to develop an annotated corpus to address a problem of biomedical NLP or text-mining, you may want to consider providing it as a shared task through BioNLP-OST Shared Tasks. The past BioNLP-ST editions has attracted dozens of participants in the long term and established a community of solution providers. By offering your task to the community, you might very well find solutions to your text-mining problem.
For task providers, the organizers will provide technical and methodological support with necessary tooling. All the submitted proposals will be reviewed by the Scientific Committee of BioNLP-OST, and review comments will be provided to the authors. We believe the expert review comments will be useful to implement the proposals into valuable shared tasks.
Proposals submitted before the 14th of December are eligible for special technical support by the BioNLP-OST organizing team during BLAH5 ( http://blah5.linkedannotation.org) in Japan, Feb. 12-15, 2019. One author for each selected proposal (up to 3 proposals) will be awarded travel support.
We welcome any NLP/text mining task with a potential application in the biomedical domain, which will include, but not limited to
We also welcome tasks in languages other than English. Submission Guidelines
A task proposal is expected to include the following:
Name of the task
A brief description of the goals of the task
Motivation and application domains
Description of the corpus: type of documents, existing and expected
number of annotated documents
Description of the annotation with:
an example of annotation in the actual format and visualization if
the annotation scheme (entity types, relation types, type
a link to the entire or a sample corpus with annotations (optional)
a link to the annotation guidelines (optional)
Description of the annotation process: e.g. number of annotators,
expertise of annotators, double annotation, inter-annotator agreement
Evaluation methodology of participant results, and criteria, and
optionally a link to the evaluation tools source code
Current state of, or plan for the corpus annotation and evaluation tools
License policy of the data and the tools. Note that BioNLP-OST advocates
open license policy.
A link to the homepage of the project (optional)
Author information: names, affiliations, contact information (email),
link to homepage if any.
Task proposals can be submitted in PDF (up to 2 pages plus one extra page for references).
Submission should be made via EasyChair at the following link:
Should you have questions, please feel free to contact to oc at bionlp-ost.org Preliminary schedule for BioNLP-OST
Shared task platform ready with early tasks Feb. 28th, 2019
Platform open for registration of tasks and solutions Mar. 4th, 2019
Workshop paper submission due Jul. 19th, 2019
BioNLP-OST workshop Nov. 3rd or 4th, 2019
Journal special issue submission due Mar. 28th, 2020 Important dates for BLAH5 support award
Task proposals due December 14th, 2018
Task review notification January 8th, 2019
BLAH5 workshop February 12th-15th, 2019 BioNLP-OST organizing committee
Jin-Dong Kim, DBCLS, Japan
Claire Nédellec, INRA, France
Robert Bossy, INRA, France
Louise Deléger, INRA, France -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 37607 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20181123/777db59e/attachment.txt>