Title
RMSE-ELM: Recursive Model based Selective Ensemble of Extreme Learning Machines for Robustness Improvement.
Abstract
For blended data, the robustness of extreme learning machine (ELM) is so weak because the coefficients (weights and biases) of hidden nodes are set randomly and the noisy data exert a negative effect. To solve this problem, a new framework called "RMSE-ELM" is proposed in this paper. It is a two-layer recursive model. In the first layer, the framework trains lots of ELMs in different ensemble groups concurrently and then employs selective ensemble approach to pick out an optimal set of ELMs in each group, which can be merged into a large group of ELMs called candidate pool. In the second layer, selective ensemble approach is recursively used on candidate pool to acquire the final ensemble. In the experiments, we apply UCI blended datasets to confirm the robustness of our new approach in two key aspects (mean square error and standard deviation). The space complexity of our method is increased to some degree, but the result has shown that RMSE-ELM significantly improves robustness with a rapid learning speed compared to representative methods (ELM, OP-ELM, GASEN-ELM, GASEN-BP, and E-GASEN). It becomes a potential framework to solve robustness issue of ELM for high-dimensional blended data in the future.
Year
DOI
Venue
2014
10.1155/2014/395686
MATHEMATICAL PROBLEMS IN ENGINEERING
Field
DocType
Volume
Mathematical optimization,Noisy data,Extreme learning machine,Computer science,Mean squared error,Robustness (computer science),Standard deviation,Ensemble learning,Recursion
Journal
2014
ISSN
Citations 
PageRank 
1024-123X
0
0.34
References 
Authors
25
6
Name
Order
Citations
PageRank
Bo Han16123.20
Bo He27713.20
Mengmeng Ma300.34
Tingting Sun410.72
Tianhong Yan5242.86
Amaury Lendasse600.34