Name
Abstract | ||
|---|---|---|
Ensemble learning consists of generating a collection of classifiers whose predictions are then combined to yield a single unified decision. Ensembles of complementary classifiers provide accurate and robust predictions, which are often better than the predictions of the individual classifiers in the ensemble. Nevertheless, ensembles also have some drawbacks: typically, all classifiers are queried to compute the final ensemble prediction. Therefore, all the classifiers need to be accessible to address potential queries. This entails larger storage requirements and slower predictions than a single classifier. Ensemble pruning techniques are useful to alleviate these drawbacks. Static pruning techniques reduce the ensemble size by selecting a sub-ensemble of classifiers from the original ensemble. In dynamic pruning, the querying process is halted when the partial ensemble prediction is sufficient to reach a stable final decision with a reasonable amount of confidence. In this paper, we present the results of a comprehensive analysis of static and dynamic pruning techniques applied to Adaboost ensembles. These ensemble pruning techniques are evaluated on a wide range of classification problems. From this analysis, one concludes that the combination of static and dynamic pruning techniques provides a notable reduction in the memory requirements and an improvement in the classification time without a significant loss of prediction accuracy. |
Year | DOI | Venue |
|---|---|---|
2014 | 10.1109/TCYB.2014.2313638 | IEEE T. Cybernetics |
Keywords | DocType | Volume |
learning (artificial intelligence),pattern classification,query processing,storage management,Adaboost ensembles,boosting ensembles,classification problems,classification time,complementary classifiers,double pruning scheme,dynamic pruning techniques,ensemble learning,ensemble prediction,ensemble pruning techniques,ensemble size,memory requirements,querying process,static pruning techniques,storage requirements,Adaboost,double pruning,ensemble pruning,instance-based pruning,semi-definite programming | Journal | 44 |
Issue | ISSN | Citations |
12 | 2168-2267 | 11 |
PageRank | References | Authors |
0.43 | 26 | 5 |
Name | Order | Citations | PageRank |
|---|---|---|---|
| Víctor Soto | 1 | 33 | 2.60 |
| Sergio García-Moratilla | 2 | 11 | 0.77 |
| Gonzalo Martínez-Muñoz | 3 | 524 | 23.76 |
| Daniel Hernández-Lobato | 4 | 440 | 26.10 |
| Alberto Suárez | 5 | 487 | 22.33 |