TY - JOUR
T1 - The Combination of BERT and Data Oversampling for Answer Type Prediction
AU - Hoang, Thang Ta
AU - Ojo, Olumide Ebenezer
AU - Adebanji, Olaronke Oluwayemisi
AU - Calvo, Hiram
AU - Gelbukh, Alexander
N1 - Publisher Copyright:
© 2022 CEUR-WS. All rights reserved.
PY - 2022
Y1 - 2022
N2 - In this paper, we address the Task 1 (of the SMART Task 2021) of predicting the answer categories and types based on target ontologies, which could be useful in knowledge-based Question Answering (QA) systems. We introduced our method by combining the power of BERT architectures with data oversampling via replacements of linked terms to Wikidata and dependent noun phrases to attain the state-of-the-art performance. The accuracy on the DBpedia dataset is 98.5%, whereas NDCG@5 and NDCG@10 are 72.7% and 66.4% respectively. Our model has the best performance compared to other teams, with the accuracy score of 98% and Mean Reciprocal Rank (MRR) of 70% on the Wikidata dataset.
AB - In this paper, we address the Task 1 (of the SMART Task 2021) of predicting the answer categories and types based on target ontologies, which could be useful in knowledge-based Question Answering (QA) systems. We introduced our method by combining the power of BERT architectures with data oversampling via replacements of linked terms to Wikidata and dependent noun phrases to attain the state-of-the-art performance. The accuracy on the DBpedia dataset is 98.5%, whereas NDCG@5 and NDCG@10 are 72.7% and 66.4% respectively. Our model has the best performance compared to other teams, with the accuracy score of 98% and Mean Reciprocal Rank (MRR) of 70% on the Wikidata dataset.
KW - Answer Type Prediction
KW - ISWC
KW - Question Answering
KW - Semantic Web Challenge
UR - http://www.scopus.com/inward/record.url?scp=85129142915&partnerID=8YFLogxK
M3 - Artículo de la conferencia
AN - SCOPUS:85129142915
SN - 1613-0073
VL - 3119
JO - CEUR Workshop Proceedings
JF - CEUR Workshop Proceedings
T2 - 2nd SeMantic Answer Type and Relation Prediction Task at ISWC Semantic Web Challenge, SMART 2021
Y2 - 26 October 2021
ER -