Title
Reducing the complexity of an adaptive radial basis function network with a histogram algorithm.
Abstract
In this paper, a constructive training technique known as the dynamic decay adjustment (DDA) algorithm is combined with an information density estimation method to develop a new variant of the radial basis function (RBF) network. The RBF network trained with the DDA algorithm (i.e. RBFNDDA) is able to learn information incrementally by creating new hidden units whenever it is necessary. However, RBFNDDA exhibits a greedy insertion behaviour that absorbs both useful and non-useful information during its learning process, therefore increasing its network complexity unnecessarily. As such, we propose to integrate RBFNDDA with a histogram (HIST) algorithm to reduce the network complexity. The HIST algorithm is used to compute distribution of information in the trained RBFNDDA network. Then, hidden nodes with non-useful information are identified and pruned. The effectiveness of the proposed model, namely RBFNDDA-HIST, is evaluated using a number of benchmark data sets. A performance comparison study between RBFNDDA-HIST and other classification methods is conducted. The proposed RBFNDDA-HIST model is also applied to a real-world condition monitoring problem in a power generation plant. The results are analysed and discussed. The outcome indicates that RBFNDDA-HIST not only can reduce the number of hidden nodes significantly without requiring a long training time but also can produce promising accuracy rates.
Year
DOI
Venue
2017
10.1007/s00521-016-2350-4
Neural Computing and Applications
Keywords
Field
DocType
Radial basis function network, Dynamic decay adjustment, Pruning, Histogram, Nodes reduction
Histogram,Digital differential analyzer (graphics algorithm),Data set,Radial basis function network,Network complexity,Radial basis function,Constructive,Computer science,Algorithm,Artificial intelligence,Condition monitoring,Machine learning
Journal
Volume
Issue
ISSN
28
S-1
1433-3058
Citations 
PageRank 
References 
0
0.34
29
Authors
4
Name
Order
Citations
PageRank
Pey Yun Goh111.36
Shing Chiang Tan212218.99
Wooi Ping Cheah3368.03
Chee Peng Lim41459122.04