Title
An adaptive growing and pruning algorithm for designing recurrent neural network.
Abstract
The training of recurrent neural networks (RNNs) concerns the selection of their structures and the connection weights. To efficiently enhance generalization capabilities of RNNs, a recurrent self-organizing neural networks (RSONN), using an adaptive growing and pruning algorithm (AGPA), is proposed for improving their performance in this paper. This AGPA can self-organize the structures of RNNs based on the information processing ability and competitiveness of hidden neurons in the learning process. Then, the hidden neurons of RSONN can be added or pruned to improve the generalization performance. Furthermore, an adaptive second-order algorithm with adaptive learning rate is employed to adjust the parameters of RSONN. And the convergence of RSONN is given to show the computational efficiency. To demonstrate the merits of RSONN for data modeling, several benchmark datasets and a real world application associated with nonlinear systems modeling problems are examined with comparisons against other existing methods. Experimental results show that the proposed RSONN effectively simplifies the network structure and performs better than some exiting methods.
Year
DOI
Venue
2017
10.1016/j.neucom.2017.02.038
Neurocomputing
Keywords
Field
DocType
Recurrent self-organizing neural network,Adaptive growing and pruning algorithm,Information processing ability,Competitiveness,Convergence
Convergence (routing),Pruning algorithm,Data modeling,Nonlinear system,Information processing,Computer science,Recurrent neural network,Artificial intelligence,Artificial neural network,Machine learning,Network structure
Journal
Volume
Issue
ISSN
242
C
0925-2312
Citations 
PageRank 
References 
6
0.50
38
Authors
3
Name
Order
Citations
PageRank
Hong-Gui Han147639.06
shuo zhang22916.71
Jun-Fei Qiao379874.56