Title
Evaluation Of Classification Algorithms Using Mcdm And Rank Correlation
Abstract
Classification algorithm selection is an important issue in many disciplines. Since it normally involves more than one criterion, the task of algorithm selection can be modeled as multiple criteria decision making (MCDM) problems. Different MCDM methods evaluate classifiers from different aspects and thus they may produce divergent rankings of classifiers. The goal of this paper is to propose an approach to resolve disagreements among MCDM methods based on Spearman's rank correlation coefficient. Five MCDM methods are examined using 17 classification algorithms and 10 performance criteria over 11 public-domain binary classification datasets in the experimental study. The rankings of classifiers are quite different at first. After applying the proposed approach, the differences among MCDM rankings are largely reduced. The experimental results prove that the proposed approach can resolve conflicting MCDM rankings and reach an agreement among different MCDM methods.
Year
DOI
Venue
2012
10.1142/S0219622012500095
INTERNATIONAL JOURNAL OF INFORMATION TECHNOLOGY & DECISION MAKING
Keywords
Field
DocType
Multi-criteria decision making (MCDM), classification, Spearman's rank correlation coefficient, TOPSIS, ELECTRE, grey relational analysis, VIKOR, PROMETHEE
Rank correlation,Data mining,Multiple-criteria decision analysis,Binary classification,Grey relational analysis,ELECTRE,Artificial intelligence,TOPSIS,Statistical classification,Spearman's rank correlation coefficient,Machine learning,Mathematics
Journal
Volume
Issue
ISSN
11
1
0219-6220
Citations 
PageRank 
References 
195
4.82
25
Authors
4
Search Limit
100195
Name
Order
Citations
PageRank
Gang Kou12527191.95
Yanqun Lu21954.82
Yi Peng3130378.20
Yu Shi43208264.97