Title
User preferences based software defect detection algorithms selection using MCDM
Abstract
A variety of classification algorithms for software defect detection have been developed over the years. How to select an appropriate classifier for a given task is an important issue in Data mining and knowledge discovery (DMKD). Many studies have compared different types of classification algorithms and the performances of these algorithms may vary using different performance measures and under different circumstances. Since the algorithm selection task needs to examine several criteria, such as accuracy, computational time, and misclassification rate, it can be modeled as a multiple criteria decision making (MCDM) problem. The goal of this paper is to use a set of MCDM methods to rank classification algorithms, with empirical results based on the software defect detection datasets. Since the preferences of the decision maker (DM) play an important role in algorithm evaluation and selection, this paper involved the DM during the ranking procedure by assigning user weights to the performance measures. Four MCDM methods are examined using 38 classification algorithms and 13 evaluation criteria over 10 public-domain software defect datasets. The results indicate that the boosting of CART and the boosting of C4.5 decision tree are ranked as the most appropriate algorithms for software defect datasets. Though the MCDM methods provide some conflicting results for the selected software defect datasets, they agree on most top-ranked classification algorithms.
Year
DOI
Venue
2012
10.1016/j.ins.2010.04.019
Information Sciences: an International Journal
Keywords
Field
DocType
user preference,selected software defect datasets,public-domain software defect datasets,classification algorithm,decision tree,mcdm method,software defect detection datasets,software defect detection,top-ranked classification algorithm,software defect detection algorithm,decision maker,software defect datasets,knowledge discovery,data mining,public domain
Decision tree,Data mining,Multiple-criteria decision analysis,Computer science,Software bug,Artificial intelligence,Classifier (linguistics),Ranking,Algorithm,Knowledge extraction,Boosting (machine learning),Statistical classification,Machine learning
Journal
Volume
ISSN
Citations 
191,
0020-0255
30
PageRank 
References 
Authors
1.15
39
3
Name
Order
Citations
PageRank
Yi Peng1130378.20
Guoxun Wang236311.99
Honggang Wang31365124.06