Lamarckian evolution of associative memory

There has been a lot of research which applies evolutionary techniques to layered neural networks. However, their application to Hopfield neural networks remain few so far. We apply genetic algorithms to a fully connected Hopfield associative memory model. In an earlier paper, we reported that random weight matrices were evolved to store a number of patterns only by means of a simple genetic algorithm (A. Imada and K. Araki, 1995). We propose that the storage capacity can be enlarged by incorporating Lamarckian inheritance to the genetic algorithm.

[1]  Akira Imada,et al.  Genetic Algorithm Enlarges the Capacity of Associative Memory , 1995, ICGA.

[2]  H. C. LONGUET-HIGGINS,et al.  Non-Holographic Associative Memory , 1969, Nature.

[3]  Tariq Samad,et al.  Towards the Genetic Synthesisof Neural Networks , 1989, ICGA.

[4]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[5]  L. Darrell Whitley,et al.  Optimizing Neural Networks Using FasterMore Accurate Genetic Search , 1989, ICGA.

[6]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[7]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[8]  Peter M. Todd,et al.  Designing Neural Networks using Genetic Algorithms , 1989, ICGA.

[9]  Lawrence Davis,et al.  Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[10]  S. Yoshizawa,et al.  Dynamics of an auto-associative neural network model with arbitrary connectivity and noise in the threshold , 1991 .

[11]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[12]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[13]  Mohamad H. Hassoun,et al.  Associative neural memories , 1993 .

[14]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[15]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[16]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[17]  L. Darrell Whitley,et al.  Adding Learning to the Cellular Development of Neural Networks: Evolution and the Baldwin Effect , 1993, Evolutionary Computation.

[18]  Stefano Nolfi,et al.  Evolving Artificial Neural Networks that Develop in Time , 1995, ECAL.

[19]  S. Amari,et al.  Sparsely coded associative memories: capacity and dynamical properties , 1991 .

[20]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[21]  Akira Imada,et al.  Mutually Connected Neural Network Can Learn Some Patterns by Means of GA , 1995 .

[22]  Hiroaki Kitano,et al.  Designing Neural Networks Using Genetic Algorithms with Graph Generation System , 1990, Complex Syst..