Title
Error awareness by lower and upper bounds in ensemble learning
Abstract
Ensemble learning system could lower down risk of overfitting that often appears in supervised learning for a single learning model. However, overfitting had still been observed in negative correlation learning that trains a set of neural networks simultaneously with correlation-based penalties. In negative correlation learning, each subsystem could see all training data, and focus on those data that has not been learned well by the other subsystems in the ensemble. One cost of learning all data points is that the learned decision boundary could get too closer to some data points. Such decision boundary might not give the better generalization even if it could provide the higher accuracy on the training data. Two constraints are introduced into negative correlation learning for preventing overfitting. One is the lower bound of error rate (LBER). The other is the upper bound of error output (UBEO). These two error bounds would decide whether to learn a certain data point. Experimental results would explore how LBER and UBEO would lead negative correlation learning towards a better decision boundary.
Year
DOI
Venue
2015
10.1109/ICNC.2015.7377958
2015 11th International Conference on Natural Computation (ICNC)
Keywords
Field
DocType
Decision boundary,ensemble learning,error bounds
Semi-supervised learning,Instance-based learning,Stability (learning theory),Active learning (machine learning),Computer science,Supervised learning,Unsupervised learning,Artificial intelligence,Overfitting,Ensemble learning,Machine learning
Conference
Volume
Issue
ISSN
30
9
0218-0014
Citations 
PageRank 
References 
2
0.46
5
Authors
3
Name
Order
Citations
PageRank
Yong Liu12526265.08
Qiangfu Zhao221462.36
Yan Pei312522.89