Fake news spreaders profiling using N-grams of various types and SHAP-based feature selection

Fazlourrahman Balouchzahi, Grigori Sidorov, Hosahalli Lakshmaiah Shashirekha

Research output: Contribution to journalArticlepeer-review

Abstract

Complex learning approaches along with complicated and expensive features are not always the best or the only solution for Natural Language Processing (NLP) tasks. Despite huge progress and advancements in learning approaches such as Deep Learning (DL) and Transfer Learning (TL), there are many NLP tasks such as Text Classification (TC), for which basic Machine Learning (ML) classifiers perform superior to DL or TL approaches. Added to this, an efficient feature engineering step can significantly improve the performance of ML based systems. To check the efficacy of ML based systems and feature engineering on TC, this paper explores char, character sequences, syllables, word n-grams as well as syntactic n-grams as features and SHapley Additive exPlanations (SHAP) values to select the important features from the collection of extracted features. Voting Classifiers (VC) with soft and hard voting of four ML classifiers, namely: Support Vector Machine (SVM) with Linear and Radial Basis Function (RBF) kernel, Logistic Regression (LR), and Random Forest (RF) was trained and evaluated on Fake News Spreaders Profiling (FNSP) shared task dataset in PAN 2020. This shared task consists of profiling fake news spreaders in English and Spanish languages. The proposed models exhibited an average accuracy of 0.785 for both languages in this shared task and outperformed the best models submitted to this task.

Original languageEnglish
Pages (from-to)4437-4448
Number of pages12
JournalJournal of Intelligent and Fuzzy Systems
Volume42
Issue number5
DOIs
StatePublished - 2022

Keywords

  • Fake news
  • Feature engineering
  • Learning approaches
  • N-grams
  • SHAP values

Fingerprint

Dive into the research topics of 'Fake news spreaders profiling using N-grams of various types and SHAP-based feature selection'. Together they form a unique fingerprint.

Cite this