Title
Accuracy-diversity based pruning of classifier ensembles.
Abstract
Classification ensemble methods have recently drawn serious attention due to their ability to appreciably pull up prediction performance. Since smaller ensembles are preferred because of storage and efficiency reasons, ensemble pruning is an important step for construction of classifier ensembles. In this paper, we propose a heuristic method to obtain an optimal ensemble from a given pool of classifiers. The proposed accuracy–diversity based pruning algorithm takes into account the accuracy of individual classifiers as well as the pairwise diversity amongst these classifiers. The algorithm performs a systematic bottom-up search and conditionally grows sub-ensembles by adding diverse pairs of classifiers to the candidates with relatively higher accuracies. The ultimate aim is to deliver the smallest ensemble with highest achievable accuracy in the pool. The performance study on UCI datasets demonstrates that the proposed algorithm rarely misses the optimal ensemble, thus establishing confidence in the quality of heuristics employed by the algorithm.
Year
DOI
Venue
2014
10.1007/s13748-014-0042-9
Progress in AI
Keywords
Field
DocType
Classifier ensemble, Ensemble pruning, Diversity, Accuracy, Heuristic, Brute force search, Optimal ensemble
Data mining,Random subspace method,Computer science,Heuristics,Artificial intelligence,Classifier (linguistics),Ensemble learning,Pairwise comparison,Heuristic,Brute-force search,Pattern recognition,Cascading classifiers,Machine learning
Journal
Volume
Issue
ISSN
2
2-3
2192-6360
Citations 
PageRank 
References 
9
0.52
35
Authors
4
Name
Order
Citations
PageRank
Vasudha Bhatnagar118117.69
Manju Bhardwaj2192.33
Shivam Sharma390.52
Sufyan Haroon490.52