Name
Abstract | ||
|---|---|---|
Self-poised ensemble learning is based on the idea of introducing an artificial innovation to the map to be predicted by each machine in the ensemble such that it compensates the error incurred by the previous one. We will show that this approach is equivalent to regularize the loss function used to train each machine with a penalty term which measures decorrelation with previous machines. Although the algorithm is competitive in practice, it is also observed that the innovations tend to generate an increasedly bad behavior of individual learners in time, damaging the ensemble performance. To avoid this, we propose to incorporate smoothing parameters which control the introduced level of innovation and can be characterized to avoid an explosive behavior of the algorithm. Our experimental results report the behavior of neural networks ensembles trained with the proposed algorithm in two real and well-known data sets. |
Year | DOI | Venue |
|---|---|---|
2005 | 10.1007/11596448_7 | CIS (1) |
Keywords | Field | DocType |
previous machine,individual learner,ensemble performance,self-poised ensemble learning,increasedly bad behavior,neural networks ensemble,proposed algorithm,moderated innovation,artificial innovation,explosive behavior,ensemble learning,loss function | Data set,Decorrelation,Computer science,Explosive material,Smoothing,Artificial intelligence,Artificial neural network,Ensemble learning,Machine learning | Conference |
Volume | ISSN | ISBN |
3801 | 0302-9743 | 3-540-30818-0 |
Citations | PageRank | References |
0 | 0.34 | 9 |
Authors | ||
4 | ||
Name | Order | Citations | PageRank |
|---|---|---|---|
| Ricardo Ñanculef | 1 | 53 | 10.64 |
| Carlos Valle | 2 | 21 | 8.20 |
| Héctor Allende | 3 | 148 | 31.69 |
| Claudio Moraga | 4 | 612 | 100.27 |