Title
An Enhanced Hierarchical Extreme Learning Machine With Random Sparse Matrix Based Autoencoder
Abstract
Recently, by employing the stacked extreme learning machine (ELM) based autoencoders (ELM-AE) and sparse AEs (SAE), multilayer ELM (ML-ELM) and hierarchical ELM (H-ELM) has been developed. Compared to the conventional stacked AEs, the ML-ELM and H-ELM usually achieve better generalization performance with a significantly reduced training time. However, the l(1)-norm based SAE may suffer the overfitting problem and it is unable to provide analytical solution leading to long training time for big data. To alleviate these deficiencies, we propose an enhanced H-ELM (EH-ELM) with a novel random sparse matrix based AE (S-MA) in this paper. The contributions are in two aspects, 1) utilizing the random sparse matrix, the sparse features can be obtained; 2) the proposed SMA can provide an analytical solution so that the high computational complexity issue in SAE can be addressed. Experimental results on benchmark datasets show that the proposed EH-ELM achieves a higher recognition rate and a faster training speed than H-ELM and ML-ELM.
Year
DOI
Venue
2019
10.1109/icassp.2019.8682337
2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)
Keywords
Field
DocType
Extreme learning machine, Autoencoder, Multilayer perceptron, Random sparse matrix
SMA*,Autoencoder,Pattern recognition,Computer science,Extreme learning machine,Feature extraction,Artificial intelligence,Overfitting,Sparse matrix,Benchmark (computing),Computational complexity theory
Conference
ISSN
Citations 
PageRank 
1520-6149
0
0.34
References 
Authors
0
5
Name
Order
Citations
PageRank
Tianlei Wang1349.77
Xiaoping Lai292.92
Jiuwen Cao317818.99
Chi-Man Vong455741.41
Badong Chen591965.71