Searching Real-Valued Synaptic Weights of Hopfield's Associative Memory Using Evolutionary Programming

We apply evolutionary computations to Hopfield model of associative memory. Although there have been a lot of researches which apply evolutionary techniques to layered neural networks, their applications to Hopfield neural networks remain few so far. Previously we reported that a genetic algorithm using discrete encoding chromosomes evolves the Hebb-rule associative memory to enhance its storage capacity. We also reported that the genetic algorithm evolves a network with random synaptic weights eventually to store some number of patterns as fixed points. In this paper we present an evolution of the Hopfield model of associative memory using evolutionary programming as a real-valued parameter optimization.

[1]  J. A. Hertz,et al.  Irreversible spin glasses and neural networks , 1987 .

[2]  Jean-Didier Legat,et al.  Analog implementation of an associative memory: learning algorithm and VLSI constraints , 1993 .

[3]  Akira Imada,et al.  Mutually Connected Neural Network Can Learn Some Patterns by Means of GA , 1995 .

[4]  Akira Imada,et al.  Genetic Algorithm Enlarges the Capacity of Associative Memory , 1995, ICGA.

[5]  I. Morgenstern,et al.  Heidelberg Colloquium on Glassy Dynamics , 1987 .

[6]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[7]  János Komlós,et al.  Convergence results in an associative memory model , 1988, Neural Networks.

[8]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[9]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[10]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[11]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Santosh S. Venkatesh,et al.  Feature and memory-selective error correction in neural associative memory , 1993 .

[13]  E. Gardner,et al.  An Exactly Solvable Asymmetric Neural Network Model , 1987 .

[14]  Marc Mézard,et al.  The roles of stability and symmetry in the dynamics of neural networks , 1988 .

[15]  Teuvo Kohonen,et al.  Representation of Associated Data by Matrix Operators , 1973, IEEE Transactions on Computers.

[16]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.