Unfully interconnected neural networks as associative memory

Unfully interconnected neural networks (UINNs) are proposed as associative memory. The basic idea is to form compact internal representations of patterns in order to increase the storage efficiency of the interconnections. Several effective methods for designing UINNs as associative memory, including monolayered and multilayered neural networks, are presented. A maximum-interconnection-preserving method which forms a rectangular grid structure of local interconnections is proposed. Dynamical modeling almost doubles the average storage per interconnection weight of the neural network compared with the Hopfield model. Multilayered neural networks are of relatively high storage capacity.<<ETX>>

[1]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[3]  Lin-Bao Yang,et al.  Cellular neural networks: theory , 1988 .

[4]  D L Alkon,et al.  Memory storage and neural systems. , 1989, Scientific American.