Random Perturbations to Hebbian Synapses of Associative Memory Using a Genetic Algorithm

We apply evolutionary algorithms to Hopfield model of associative memory. Previously we reported that a genetic algorithm using ternary chromosomes evolves the Hebb-rule associative memory to enhance its storage capacity by pruning some connections. This paper describes a genetic algorithm using real-encoded chromosomes which successfully evolves over-loaded Hebbian synaptic weights to function as an associative memory. The goal of this study is to shed new light on the analysis of the Hopfield model, which also enables us to use the model as more challenging test suite for evolutionary computations.

[1]  Teuvo Kohonen,et al.  Representation of Associated Data by Matrix Operators , 1973, IEEE Transactions on Computers.

[2]  D. Amit,et al.  Statistical mechanics of neural networks near saturation , 1987 .

[3]  Samir W. Mahfoud.  A Comparison of Parallel and Sequential Niching Methods , 1995, ICGA.

[4]  A. Imada.  Evolved Asymmetry and Dilution of Random Synaptic Weights in Hop eld Network Turn a Spin-glass Phase into Associative Memory , 1997 .

[5]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[6]  L. Darrell Whitley,et al.  Building Better Test Functions , 1995, ICGA.

[7]  Akira Imada,et al.  Genetic Algorithm Enlarges the Capacity of Associative Memory , 1995, ICGA.

[8]  Heinz Mühlenbein,et al.  The parallel genetic algorithm as function optimizer , 1991, Parallel Comput..

[9]  Sompolinsky,et al.  Neural networks with nonlinear synapses and a static noise. , 1986, Physical review. A, General physics.

[10]  E. Gardner.  The space of interactions in neural network models , 1988 .

[11]  János Komlós,et al.  Convergence results in an associative memory model , 1988, Neural Networks.

[12]  D. Ackley.  A connectionist machine for genetic hillclimbing , 1987 .

[13]  Marc Mézard,et al.  The roles of stability and symmetry in the dynamics of neural networks , 1988 .

[14]  Heinz Mühlenbein,et al.  Adaptation of population sizes by competing subpopulations , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[15]  Santosh S. Venkatesh,et al.  Feature and memory-selective error correction in neural associative memory , 1993 .

[16]  Heinz Mühlenbein,et al.  Predictive Models for the Breeder Genetic Algorithm I. Continuous Parameter Optimization , 1993, Evolutionary Computation.

[17]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[18]  Xin Yao,et al.  A review of evolutionary artificial neural networks , 1993, Int. J. Intell. Syst..

[19]  J. D. Schaffer,et al.  Combinations of genetic algorithms and neural networks: a survey of the state of the art , 1992, [Proceedings] COGANN-92: International Workshop on Combinations of Genetic Algorithms and Neural Networks.

[20]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[21]  Rajarshi Das,et al.  A Study of Control Parameters Affecting Online Performance of Genetic Algorithms for Function Optimization , 1989, ICGA.

[22]  J. A. Hertz,et al.  Irreversible spin glasses and neural networks , 1987 .

[23]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[25]  Gilbert Syswerda,et al.  Uniform Crossover in Genetic Algorithms , 1989, ICGA.