[Corpora-List] Question Generation Shared Task Evaluation Campaign 2010

Brendan Wyse bjwyse at gmail.com
Sun Apr 4 12:07:08 CEST 2010


QUESTION GENERATION SHARED TASK EVALUATION CHALLENGE 2010 ========================================================

This is a final call for participants for the QG STEC 2010. Development data has already been released to interested participants. This month we will be releasing the test data for the challenge. Please read on to learn about our two tasks relating to Question Generation.

Task A: Open Question Generation from Paragraphs ======================================

Teams are given a paragraph of text from OpenLearn, Wikipedia or Yahoo Answers. QG Systems should produce six questions at various scope levels from this text.

Example:

Abraham Lincoln (February 12, 1809 – April 15, 1865), the 16th President of the United States, successfully led his country through its greatest internal crisis, the American Civil War, preserving the Union and ending slavery. As an outspoken opponent of the expansion of slavery in the United States, Lincoln won the Republican Party nomination in 1860 and was elected president later that year. His tenure in office was occupied primarily with the defeat of the secessionist Confederate States of America in the American Civil War. He introduced measures that resulted in the abolition of slavery, issuing his Emancipation Proclamation in 1863 and promoting the passage of the Thirteenth Amendment to the Constitution. As the civil war was drawing to a close, Lincoln became the first American president to be assassinated.

1) Who is Abraham Lincoln?

2) What major measures did President Lincoln introduce?

3) How did President Lincoln die?

4) When was Abraham Lincoln elected president?

5) When was President Lincoln assassinated?

6) What party did Abraham Lincoln belong to?

Task B: Question Generation from Sentences =================================

Teams are given a single sentence of text from OpenLearn, Wikipedia or Yahoo Answers. They are also given a target question type (WHO? WHEN? WHERE? etc.) QG Systems should produce a question of the target type and the question will typically be answered by the given sentence.

Example:

The Council of Europe was set up in 1949.

Target Question Type: WHEN?

1) When was the Council of Europe set up?

Teams interested in the tasks described below should make their interest known to Vasile Rus<vrus at memphis.edu> and Brendan Wyse<bjwyse at gmail.com>.

The QG STEC 2010 is part of Generation Challenges 2010 ( http://www.nltg.brighton.ac.uk/research/genchal10/index.html) and the results of the challenge will be presented at the 3rd Workshop on Question Generation (http://questiongeneration.org/QG2010).

We also have a further task whereby teams can submit interesting reports on Question Generation at the workshop.

Please see http://questiongeneration.org/QGSTEC2010 for more details.

Thank You.

QGSTEC2010 Organisers =================== Brendan Wyse (The Open University) Vasile Rus (The University of Memphis) Mihai Lintean (The University of Memphis) Art Graesser (The University of Memphis) Svetlana Stoyanchev (The Open University) Paul Piwek (The Open University) -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 3793 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20100404/403fb9dc/attachment.txt>



More information about the Corpora mailing list