Overview of EmoThreat: Emotions and Threat Detection in Urdu at FIRE 2022

Sabur Butt, Maaz Amjad, Fazlourrahman Balouchzahi, Noman Ashraf, Rajesh Sharma, Grigori Sidorov, Alexander Gelbukh

Producción científica: Contribución a una revistaArtículo de la conferenciarevisión exhaustiva

10 Citas (Scopus)

Resumen

Emotion and targeted abuse detection i.e threat, are problems that have been studied in many rich resource languages. However, when it comes to low-resource languages such as Urdu, we find a dearth of resources and methodologies. Our paper presents the findings of the shared task "EmoThreat: Emotions and Threat detection in Urdu", where we focused on presenting resources for multi-label emotion classification (Task A) and binary threat detection (Task B) in Urdu. Task B was further divided into group and individual threat detection, making it a multi-class problem. The paper presents a summary of the methodologies and findings of the ten different participating teams. Each team also presented a thorough error analysis for the best model. The best performing system in Task A achieved a macroF1 score of 0.687, whereas, Task B subtask 1 and subtask 2 achieved 0.716 and 0.539 macro-F1 scores respectively.

Idioma originalInglés
Páginas (desde-hasta)220-230
Número de páginas11
PublicaciónCEUR Workshop Proceedings
Volumen3395
EstadoPublicada - 2022
Evento14th Forum for Information Retrieval Evaluation, FIRE 2022 - Kolkata, India
Duración: 9 dic. 202213 dic. 2022

Huella

Profundice en los temas de investigación de 'Overview of EmoThreat: Emotions and Threat Detection in Urdu at FIRE 2022'. En conjunto forman una huella única.

Citar esto