Title
Statistical instance-based pruning in ensembles of independent classifiers.
Abstract
The global prediction of a homogeneous ensemble of classifiers generated in independent applications of a randomized learning algorithm on a fixed training set is analyzed within a Bayesian framework. Assuming that majority voting is used, it is possible to estimate with a given confidence level the prediction of the complete ensemble by querying only a subset of classifiers. For a particular instance that needs to be classified, the polling of ensemble classifiers can be halted when the probability that the predicted class will not change when taking into account the remaining votes is above the specified confidence level. Experiments on a collection of benchmark classification problems using representative parallel ensembles, such as bagging and random forests, confirm the validity of the analysis and demonstrate the effectiveness of the instance-based ensemble pruning method proposed.
Year
DOI
Venue
2009
10.1109/TPAMI.2008.204
IEEE Trans. Pattern Anal. Mach. Intell.
Keywords
Field
DocType
complete ensemble,global prediction,bayesian framework,representative parallel ensemble,homogeneous ensemble,ensemble classifier,specified confidence level,benchmark classification problem,independent classifiers,confidence level,instance-based ensemble pruning method,probability distribution,training data,bagging,learning artificial intelligence,bayesian methods,random forests,ensemble learning,radio frequency,probability,voting,majority voting,algorithm design and analysis,random forest
Data mining,Computer science,Random subspace method,Probability distribution,Artificial intelligence,Random forest,Majority rule,Ensemble learning,Algorithm design,Pattern recognition,Cascading classifiers,Machine learning,Bayesian probability
Journal
Volume
Issue
ISSN
31
2
0162-8828
Citations 
PageRank 
References 
24
0.94
12
Authors
3
Name
Order
Citations
PageRank
Daniel Hernández-Lobato144026.10
Gonzalo Martínez-Muñoz252423.76
Alberto Suárez348722.33