论文信息 - Learning algorithms with optimal stability in neural networks

Learning algorithms with optimal stability in neural networks

To ensure large basins of attraction in spin-glass-like neural networks of two-state elements xi imu =+or-1. The authors propose to study learning rules with optimal stability Delta , where delta is the largest number satisfying Delta <or=( Sigma j Jij xi jmu ) xi imu ; mu =1. . . . .p: i=1. . . . .N (where N is the number of neurons and p is the number of patterns). They motivate this proposal and provide optimal stability learning rules for two different choices of normalisation for the synaptic matrix (Jij). In addition, numerical work is presented which gives the value of the optimal stability for random uncorrelated patterns.

W. Krauth | M. Mézard

[1] J J Hopfield,et al. Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[2] C. D. Gelatt,et al. Optimization by Simulated Annealing , 1983, Science.

[3] Gérard Weisbuch,et al. Scaling laws for the attractors of Hopfield networks , 1985 .

[4] I. Guyon,et al. Information storage and retrieval in spin-glass like neural networks , 1985 .

[5] Sompolinsky,et al. Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[6] Opper,et al. Learning of correlated patterns in spin-glass networks by local learning rules. , 1987, Physical review letters.

[7] Kanter,et al. Associative recall of memory without errors. , 1987, Physical review. A, General physics.