Title
Shaping attraction basins in neural networks
Abstract
An interesting duality between two formally related schemes for neural associative memory is exploited to shape the attraction basins of stored memories. Considered are a family of spectral algorithms—based on specifying the spectrum of the matrix of weights as a function of the memories to be stored—and a class of dual spectral algorithms—based on manipulations of the orthogonal subspace of the memories, which are expanded here. These algorithms are shown to attain near maximal memory storage capacity of the order of n, and are shown to typically require the order of n3 elementary operations for their implementation. Signal-to-noise ratio arguments are presented showing a duality in the error-correction behaviour of the two schemes: the spectral algorithm demonstrates memory-specific attraction around the memories, while the dual spectral algorithm demonstrates direction-specific attraction. Composite algorithms capable of joint memory-specific and direction-specific attraction are presented as a means of variably shaping attraction basins around desired memories. Computer simulations are included in support of the analysis.
Year
DOI
Venue
1990
10.1016/0893-6080(90)90052-M
Neural Networks
Keywords
DocType
Volume
Associative memory,Network dynamics
Journal
3
Issue
ISSN
Citations 
6
0893-6080
1
PageRank 
References 
Authors
0.37
0
4
Name
Order
Citations
PageRank
Santosh S. Venkatesh138171.80
Girish Pancha210.71
Demetri Psaltis3431209.24
Gabriel Sirat410.37