Please use this identifier to cite or link to this item: https://hdl.handle.net/20.500.11851/8298
Title: Overview of the Clef–2021 Checkthat! Lab on Detecting Check-Worthy Claims, Previously Fact-Checked Claims, and Fake News
Authors: Nakov, P.
Da San Martino, G.
Elsayed, T.
Barrón-Cedeño, A.
Míguez, R.
Shaar, S.
Alam, F.
Keywords: Check-worthiness estimation
COVID-19
Disinformation
Fact-checking
Fake news detection
Misinformation
Verified claim retrieval
Information retrieval
Check-worthiness estimation
Classification tasks
COVID-19
Disinformation
Fact-checking
Fake news detection
Misinformation
News articles
Turkishs
Verified claim retrieval
Laboratories
Publisher: Springer Science and Business Media Deutschland GmbH
Abstract: We describe the fourth edition of the CheckThat! Lab, part of the 2021 Conference and Labs of the Evaluation Forum (CLEF). The lab evaluates technology supporting tasks related to factuality, and covers Arabic, Bulgarian, English, Spanish, and Turkish. Task 1 asks to predict which posts in a Twitter stream are worth fact-checking, focusing on COVID-19 and politics (in all five languages). Task 2 asks to determine whether a claim in a tweet can be verified using a set of previously fact-checked claims (in Arabic and English). Task 3 asks to predict the veracity of a news article and its topical domain (in English). The evaluation is based on mean average precision or precision at rank k for the ranking tasks, and macro-F1 for the classification tasks. This was the most popular CLEF-2021 lab in terms of team registrations: 132 teams. Nearly one-third of them participated: 15, 5, and 25 teams submitted official runs for tasks 1, 2, and 3, respectively. © 2021, Springer Nature Switzerland AG.
Description: 12th International Conference of the Cross-Language Evaluation Forum for European Languages, CLEF 2021 -- 21 September 2021 through 24 September 2021 -- 265349
URI: https://doi.org/10.1007/978-3-030-85251-1_19
https://hdl.handle.net/20.500.11851/8298
ISBN: 9783030852504
ISSN: 0302-9743
Appears in Collections:Bilgisayar Mühendisliği Bölümü / Department of Computer Engineering
Scopus İndeksli Yayınlar Koleksiyonu / Scopus Indexed Publications Collection

Show full item record



CORE Recommender

SCOPUSTM   
Citations

14
checked on Dec 21, 2024

Page view(s)

52
checked on Dec 16, 2024

Google ScholarTM

Check




Altmetric


Items in GCRIS Repository are protected by copyright, with all rights reserved, unless otherwise indicated.