Title
Comparison of convergence and stability properties for the state and output solutions of neural networks
Abstract
A typical neuron cell is characterized by the state variable and the neuron output, which is obtained by passing the state through a nonlinear active device implementing the neuron activation. The paper introduces a wide class of neural networks for which the state solutions and the output solutions enjoy the same convergence and stability properties. The class, which includes as a special case the standard cellular neural networks, is characterized by piecewise-linear Lipschitz continuous neuron activations, Lipschitz continuous (possibly) high-order interconnections between neurons and asymptotically stable isolated neuron cells. The paper also shows that if we relax any of the assumptions on the smoothness of the neuron activations or interconnecting structure, or on the stability of the isolated neuron cells, then the equivalence between the convergence properties of the state solutions and the output solutions is in general no longer guaranteed. To this end, three relevant classes of neural networks in the literature are considered, where each class violates one of the assumptions made in the paper, and it is shown that the state solutions of the networks enjoy stronger convergence properties with respect to the output solutions or viceversa. Copyright © 2010 John Wiley & Sons, Ltd.
Year
DOI
Venue
2011
10.1002/cta.657
I. J. Circuit Theory and Applications
Keywords
Field
DocType
typical neuron cell,output solution,neuron output,neural network,state variable,isolated neuron cell,stability property,neuron activation,state solution,piecewise-linear lipschitz continuous neuron,asymptotically stable isolated neuron,neural networks,stability,convergence
Convergence (routing),Nonlinear system,Control theory,Equivalence (measure theory),State variable,Lipschitz continuity,Artificial neural network,Cellular neural network,Mathematics,Stability theory
Journal
Volume
Issue
ISSN
39
7
0098-9886
Citations 
PageRank 
References 
0
0.34
19
Authors
5
Name
Order
Citations
PageRank
Mauro Di Marco120518.38
Mauro Forti239836.80
Massimo Grazzini313111.01
Luca Pancioni420717.58
Amedeo Premoli5318.39