TY - JOUR
T1 - Overview of EmoThreat
T2 - 14th Forum for Information Retrieval Evaluation, FIRE 2022
AU - Butt, Sabur
AU - Amjad, Maaz
AU - Balouchzahi, Fazlourrahman
AU - Ashraf, Noman
AU - Sharma, Rajesh
AU - Sidorov, Grigori
AU - Gelbukh, Alexander
N1 - Publisher Copyright:
© 2022 Copyright for this paper by its authors.
PY - 2022
Y1 - 2022
N2 - Emotion and targeted abuse detection i.e threat, are problems that have been studied in many rich resource languages. However, when it comes to low-resource languages such as Urdu, we find a dearth of resources and methodologies. Our paper presents the findings of the shared task "EmoThreat: Emotions and Threat detection in Urdu", where we focused on presenting resources for multi-label emotion classification (Task A) and binary threat detection (Task B) in Urdu. Task B was further divided into group and individual threat detection, making it a multi-class problem. The paper presents a summary of the methodologies and findings of the ten different participating teams. Each team also presented a thorough error analysis for the best model. The best performing system in Task A achieved a macroF1 score of 0.687, whereas, Task B subtask 1 and subtask 2 achieved 0.716 and 0.539 macro-F1 scores respectively.
AB - Emotion and targeted abuse detection i.e threat, are problems that have been studied in many rich resource languages. However, when it comes to low-resource languages such as Urdu, we find a dearth of resources and methodologies. Our paper presents the findings of the shared task "EmoThreat: Emotions and Threat detection in Urdu", where we focused on presenting resources for multi-label emotion classification (Task A) and binary threat detection (Task B) in Urdu. Task B was further divided into group and individual threat detection, making it a multi-class problem. The paper presents a summary of the methodologies and findings of the ten different participating teams. Each team also presented a thorough error analysis for the best model. The best performing system in Task A achieved a macroF1 score of 0.687, whereas, Task B subtask 1 and subtask 2 achieved 0.716 and 0.539 macro-F1 scores respectively.
KW - Emotion Detection
KW - Group Threats
KW - Individual Threats
KW - Natural Language Processing
KW - Threatening language Detection
KW - Urdu language
UR - http://www.scopus.com/inward/record.url?scp=85151926191&partnerID=8YFLogxK
M3 - Artículo de la conferencia
AN - SCOPUS:85151926191
SN - 1613-0073
VL - 3395
SP - 220
EP - 230
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
Y2 - 9 December 2022 through 13 December 2022
ER -