A Two-Parameter Fractional Tsallis Decision Tree

Jazmín S. De la Cruz-García, Juan Bory-Reyes, Aldo Ramirez-Arellano

Research output: Contribution to journalArticlepeer-review

Abstract

Decision trees are decision support data mining tools that create, as the name suggests, a tree-like model. The classical C4.5 decision tree, based on the Shannon entropy, is a simple algorithm to calculate the gain ratio and then split the attributes based on this entropy measure. Tsallis and Renyi entropies (instead of Shannon) can be employed to generate a decision tree with better results. In practice, the entropic index parameter of these entropies is tuned to outperform the classical decision trees. However, this process is carried out by testing a range of values for a given database, which is time-consuming and unfeasible for massive data. This paper introduces a decision tree based on a two-parameter fractional Tsallis entropy. We propose a constructionist approach to the representation of databases as complex networks that enable us an efficient computation of the parameters of this entropy using the box-covering algorithm and renormalization of the complex network. The experimental results support the conclusion that the two-parameter fractional Tsallis entropy is a more sensitive measure than parametric Renyi, Tsallis, and Gini index precedents for a decision tree classifier.

Original languageEnglish
Article number572
JournalEntropy
Volume24
Issue number5
DOIs
StatePublished - May 2022

Keywords

  • complex networks
  • decision trees
  • Gini index
  • two-parameter Tsallis entropy

Fingerprint

Dive into the research topics of 'A Two-Parameter Fractional Tsallis Decision Tree'. Together they form a unique fingerprint.

Cite this