Paper Info
Title
A fast learning method for feedforward neural networks.
Abstract
In order to circumvent the weakness of very slow convergence of most traditional learning algorithms for single layer feedforward neural networks, the extreme learning machines (ELM) has been recently developed to achieve extremely fast learning with good performance by training only for the output weights. However, it cannot be applied to multiple-hidden layer feedforward neural networks (MLFN), which is a challenging bottleneck of ELM. In this work, the novel fast learning method (FLM) for feedforward neural networks is proposed. Firstly, based on the existing ridge regression theories, the hidden-feature-space ridge regression (HFSR) and centered ridge regression Centered-ELM are presented. Their connection with ELM is also theoretically revealed. As special kernel methods, they can inherently be used to propagate the prominent advantages of ELM into MLFN. Then, a novel fast learning method FLM for feedforward neural networks is proposed as a unified framework for HFSR and Centered-ELM. FLM can be applied for both SLFN and MLFN with a single or multiple outputs. In FLM, only the parameters in the last hidden layer require being adjusted while all the parameters in other hidden layers can be randomly assigned. The proposed FLM was tested against state of the art methods on real-world datasets and it provides better and more reliable results.
Year
DOI
Venue
2015
10.1016/j.neucom.2014.01.065
Neurocomputing
Keywords
Field
DocType
Fast learning method,Feedforward neural network,Extreme learning machine,Hidden-feature-space ridge regression
Convergence (routing),Bottleneck,Feedforward neural network,Pattern recognition,Regression,Extreme learning machine,Computer science,Artificial intelligence,Kernel method,Machine learning
Journal
Volume
ISSN
Citations 
149
0925-2312
6
PageRank 
References 
Authors
0.44
26
4
Name
Order
Citations
PageRank
Shitong Wang11485109.13
Fu Lai Chung2153486.72
Jun Wang3181.70
Jun Wu4441.81