We invite you to participate in the 2021 edition of CheckThat! @ CLEF. This year, we feature three tasks that form part of the full fact-checking pipeline in multiple languages:
T1. Check-worthiness estimation Given a piece of text (tweet or a sentence in a debate), detect whether it is worth fact-checking. (English, Spanish, Arabic, Bulgarian, and Turkish)
- Subtask 1A: Check-worthiness of tweets: Given a tweet, predict whether it is worth fact-checking.
- Subtask 1B: Check-Worthiness of Debates/Speeches: Given a political debate/speech, produce a ranked list of its sentences, ordered by their check-worthiness. This is a ranking task.
T2. Claim retrieval Given a check-worthy claim in the form of a tweet or a sentence in the context of a debate, and a set of previously fact-checked claims, determine whether the claim has been previously fact-checked. (English and Arabic)
- Subtask 2A: Detect Previously Fact-Checked Claims in Tweets: Given a tweet, detect whether the claim the tweet makes was previously fact-checked with respect to a collection of fact-checked claims.
- Subtask 2B: Detect Previously Fact-Checked Claims in Political Debates/Speeches: Given a claim in a political debate or a speech, detect whether the claim has been previously fact-checked with respect to a collection of previously fact-checked claims.
T3. Fake news detection Given the text of a news article, determine whether the claims made in the article are true, partially true, false or other (e.g., claims in dispute) and also detect the topical domain of the article. (English)
Subtask 3A: Multi-class fake news detection of news articles (English): This task is a four-class classification problem. Given the text of a news article, determine whether the claims made in the article are true, partially true, false, or other.
Subtask 3B: Given the text of a news article, determine the topical domain of the article (English).
Further information: https://sites.google.com/view/clef2021-checkthat/home
Data repository: https://gitlab.com/checkthat_lab/clef2021-checkthat-lab
Important Dates --------------------- 30 April 2021: Registration closes 7 May 2021: End of Evaluation Cycle 28 May 2021: Submission of Participant Papers [CEUR-WS] 11 June 2021: Notification of Acceptance Participant Papers [CEUR-WS] 2 July 2021: Camera Ready of Participant Papers [CEUR-WS] 21-24 September 2021: Conference (Bucharest, Romania) -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/html Size: 2869 bytes Desc: not available URL: <https://mailman.uib.no/public/corpora/attachments/20210425/28dea119/attachment.txt>