Overlapping decompositions in the design of associative memories

This paper is concerned with the design of neural networks to be used as associative memories. The idea of overlapping decompositions, which is extensively used in the solution of large-scale problems as a method of reducing the computational work, is applied to discrete-time neural networks with binary neurons. It is shown that if the desired memory matrix accepts a suitable overlapping decomposition, then the problem can be solved by synthesizing a number of smaller networks independently. The concept is illustrated with two examples.

[1]  A. Michel,et al.  Analysis and synthesis of a class of neural networks: linear systems operating on a closed hypercube , 1989 .

[2]  Wolfgang Porod,et al.  Analysis and synthesis of a class of neural networks: variable structure systems with infinite grain , 1989 .

[3]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Stefen Hui,et al.  Synthesis of Brain-State-in-a-Box (BSB) based associative memories , 1994, IEEE Trans. Neural Networks.

[5]  David Mautner Himmelblau,et al.  Decomposition of large-scale problems , 1973 .

[6]  A.N. Michel,et al.  Analysis and synthesis of a class of discrete-time neural networks described on hypercubes , 1991, IEEE Trans. Neural Networks.

[7]  Ikeda,et al.  Overlapping decompositions, expansions, and contractions of dynamic systems , 1979 .

[8]  I. Guyon,et al.  Information storage and retrieval in spin-glass like neural networks , 1985 .

[9]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[10]  L. Personnaz,et al.  Collective computational properties of neural networks: New learning mechanisms. , 1986, Physical review. A, General physics.

[11]  Renzo Perfetti,et al.  A synthesis procedure for brain-state-in-a-box neural networks , 1995, IEEE Trans. Neural Networks.