[Corpora-List] FIRE 2020: Call for Track proposals (Deadline: 1st March)

Thomas Mandl mandl_lists at gmx.de
Sun Feb 16 13:18:20 CET 2020

* Apologies for multiple postings *

************************** 12th meeting of the Forum for Information Retrieval Evaluation (FIRE 2020) Website : fire.irsi.res.in **************************

We invite proposals for offering evaluation tracks at FIRE 2020.

FIRE 2020 is the 12th edition of the annual meeting of Forum for Information Retrieval Evaluation (fire.irsi.res.in). Since its inception in 2008, FIRE has had a strong focus on shared tasks, similar to those offered at Evaluation forums like TREC, CLEF and NTCIR. The shared tasks focus on solving specific problems in the area information access and more importantly help in generating evaluation datasets for the research community.

It is not required for the tasks to focus on a specific language, and they can broadly cover any problem in the fields related to IR, NLP and ML. However, the organizers especially encourage proposals for tracks related to South Asian, African and Middle Eastern languages. In the past FIRE has hosted tracks on Arabic, Persian, German and Russian besides several Indian languages. We aim to continue these efforts and include more language groups from these regions. For knowing more about tracks in past FIRE meetings, you can visit fire.irsi.res.in

Informal inquiries can also be sent to the track chairs.

Please include the following details in your proposal:

1. Track name 2. Track description 3. Broad categories of the track (eg: IR, NPL, ML, etc). More than one categories can be mentioned. 3. Use case/s 4. Target Audience and number of expected submissions 5. Data(*) (fair details) 6. Evaluation plan 7. Timeline: Please try to align with the FIRE conference dates as given below 8. Organizer/s Details:

*Tentative timeline*

- 1st March – track proposals due - 10th March – track acceptance notification due - 30th March - open track websites - 15th April – training data release - 15th June – test data release - 25th June – run submission deadline - 15th July – results declared - 31st August – Working notes and overview papers due - Tentatively in 1st or 2nd week of December - FIRE 2020

Please send this details in a pdf format toclia at isical.ac.in with a copy to parth.mehta126 at gmail.com andmandl at uni-hildesheim.de

(*) It is preferable that the data be made publicly available through Information Retrieval Society of India. In case of data that can not be distributed publicly (e.g. Twitter data) a unique identifier that can be used to recreate the original corpus can be provided (e.g. tweet ids in case of Twitter data). This disbursal will be governed by a copyright form, which the users have to sign before getting the data. A sample form is available at (http://fire.irsi.res.in/fire/static/data). In case it is not preferable/possible for the track organizers to share the data, please mention this in the proposal.

The aim of organizing these tracks at FIRE is to have debates and discussions on focused topics and give feedback to participants. As a result, at least one of the track organizers from each track is expected to attend FIRE and present the overview of track in person. In case of non-attendance of any of the organizers, the team will not be allowed to continue the track next year.

We will try to provide student volunteers for support in the proposed tracks. They will basically be undergraduate students interested in IR and related fields and can help with corpus creation, evaluation, correspondence with participants, etc. If you require any such support, kindly mention that in the track proposals along with the number of students required.

Hoping to have an enthusiastic response from your end.

Regards, Overall Track Coordinators, FIRE 2020 Parth Mehta (DA-IICT, Gandhinagar) Thomas Mandl (University of Hildesheim, Germany)

-------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 4540 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20200216/d0e63bd9/attachment.txt>

More information about the Corpora mailing list