Proposal for a unified methodology for evaluating supervised and non-supervised classification algorithms

Salvador Godoy-Calderón, J. Fco Martínez-Trinidad, Manuel Lazo Cortés

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

There is presently no unified methodology that allows the evaluation of supervised and non-supervised classification algorithms. Supervised problems are evaluated through Quality Functions that require a previously known solution for the problem, while non-supervised problems are evaluated through several Structural Indexes that do not evaluate the classification algorithm by using the same pattern similarity criteria embedded in the classification algorithm. In both cases, a lot of useful information remains hidden or is not considered by the evaluation method, such as the quality of the supervision sample or the structural change generated by the classification algorithm on the sample. This paper proposes a unified methodology to evaluate classification problems of both kinds, that offers the possibility of making comparative evaluations and yields a larger amount of information to the evaluator about the quality of the initial sample, when it exists, and regarding the change produced by the classification algorithm.

Original languageEnglish
Title of host publicationProgress in Pattern Recognition, Image Analysis and Applications - 11th Iberoamerican Congress in Pattern Recognition, CIARP 2006, Proceedings
PublisherSpringer Verlag
Pages674-685
Number of pages12
ISBN (Print)3540465561, 9783540465560
DOIs
StatePublished - 2006
Event11th Iberoamerican Congress in Pattern Recognition, CIARP 2006 - Cancun, Mexico
Duration: 14 Nov 200617 Nov 2006

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4225 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference11th Iberoamerican Congress in Pattern Recognition, CIARP 2006
Country/TerritoryMexico
CityCancun
Period14/11/0617/11/06

Fingerprint

Dive into the research topics of 'Proposal for a unified methodology for evaluating supervised and non-supervised classification algorithms'. Together they form a unique fingerprint.

Cite this