Title
Linear and logarithmic capacities in associative neural networks
Abstract
A model of associate memory incorporating global linearity and pointwise nonlinearities in a state space of n-dimensional binary vectors is considered. Attention is focused on the ability to store a prescribed set of state vectors as attractors within the model. Within the framework of such associative nets, a specific strategy for information storage that utilizes the spectrum of a linear operator is considered in some detail. Comparisons are made between this spectral strategy and a prior scheme that utilizes the sum of Kronecker outer products of the prescribed set of state vectors, which are to function nominally as memories. The storage capacity of the spectral strategy is linear in n (the dimension of the state space under consideration), whereas an asymptotic result of n/4 log n holds for the storage capacity of the outer product scheme. Computer-simulated results show that the spectral strategy stores information more efficiently. The preprocessing costs incurred in the two algorithms are estimated, and recursive strategies are developed for their computation
Year
DOI
Venue
1989
10.1109/18.30977
Information Theory, IEEE Transactions  
Keywords
Field
DocType
content-addressable storage,neural nets,Kronecker outer products,associate memory,associative neural networks,attractors,global linearity,information storage,linear capacity,logarithmic capacity,n-dimensional binary vectors,pointwise nonlinearities,preprocessing costs,recursive strategies,spectral strategy,state space,state vectors,storage capacity
Outer product,Kronecker delta,Binary logarithm,Content-addressable memory,Computer science,Algorithm,Content-addressable storage,Linear map,State space,Pointwise
Journal
Volume
Issue
ISSN
35
3
0018-9448
Citations 
PageRank 
References 
38
18.40
2
Authors
2
Name
Order
Citations
PageRank
Santosh S. Venkatesh138171.80
Demetri Psaltis2431209.24