Title
Kernel CMAC with improved capability.
Abstract
The cerebellar model articulation controller (CMAC) has some attractive features, namely fast learning capability and the possibility of efficient digital hardware implementation. Although CMAC was proposed many years ago, several open questions have been left even for today. The most important ones are about its modeling and generalization capabilities. The limits of its modeling capability were addressed in the literature, and recently, certain questions of its generalization property were also investigated. This paper deals with both the modeling and the generalization properties of CMAC. First, a new interpolation model is introduced. Then, a detailed analysis of the generalization error is given, and an analytical expression of this error for some special cases is presented. It is shown that this generalization error can be rather significant, and a simple regularized training algorithm to reduce this error is proposed. The results related to the modeling capability show that there are differences between the one-dimensional (1-D) and the multidimensional versions of CMAC. This paper discusses the reasons of this difference and suggests a new kernel-based interpretation of CMAC. The kernel interpretation gives a unified framework. Applying this approach, both the 1-D and the multidimensional CMACs can be constructed with similar modeling capability. Finally, this paper shows that the regularized training algorithm can be applied for the kernel interpretations too, which results in a network with significantly improved approximation capabilities.
Year
DOI
Venue
2007
10.1109/TSMCB.2006.881295
IEEE Transactions on Systems, Man, and Cybernetics, Part B
Keywords
Field
DocType
improved capability,kernel interpretation,modeling capability,approximation capability,modeling capability show,generalization property,similar modeling capability,generalization capability,cerebellar model articulation controller,kernel cmac,generalization error,paper deal,neural networks,kernel,training data,neural network,spline,additives,information systems
Kernel (linear algebra),Spline (mathematics),Pattern recognition,Computer science,Rather poor,Kernel representation,Cerebellar model articulation controller,Regularization (mathematics),Generalization error,Artificial intelligence,Artificial neural network,Machine learning
Journal
Volume
Issue
ISSN
37
1
1083-4419
Citations 
PageRank 
References 
12
0.71
18
Authors
2
Name
Order
Citations
PageRank
Gábor Horváth1322.75
Tamás Szabó27712.48