Designing Bidirectional Associative Memories with Optimal Stability

In this paper, a learning algorithm for bidirectional associative memories (BAM's) with optimal stability is presented. According to an objective function that measures the stability and attraction of the BAM, the authors cast the learning procedure into a global minimization problem, solved by a gradient descent technique. This learning rule guarantees the storage of training patterns with basins of attraction as large as possible. The authors also investigate the storage capacity of the BAR/L, the convergence of the learning method, the asymptotic stability of each training pattern and its basin of attraction. To evaluate the performance of the authors' learning strategy, a large number of simulations have been carried out. >

[1]  Patrick K. Simpson,et al.  Artificial Neural Systems: Foundations, Paradigms, Applications, and Implementations , 1990 .

[2]  Thomas B. Kepler,et al.  Optimal learning in neural network memories , 1989 .

[3]  Edgar Sanchez-Sinencio,et al.  Nonlinear switched capacitor 'neural' networks for optimization problems , 1990 .

[4]  Jehoshua Bruck,et al.  On the number of spurious memories in the Hopfield model , 1990, IEEE Trans. Inf. Theory.

[5]  H. Gutfreund,et al.  Learning and retrieval in attractor neural networks above saturation , 1991 .

[6]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[7]  P.K. Simpson,et al.  Higher-ordered and intraconnected bidirectional associative memories , 1990, IEEE Trans. Syst. Man Cybern..

[8]  Y. Owechko,et al.  Optical Holographic Associative Memory Using A Phase Conjugate Resonator , 1986, Photonics West - Lasers and Applications in Science and Engineering.

[9]  Opper,et al.  Learning of correlated patterns in spin-glass networks by local learning rules. , 1987, Physical review letters.

[10]  Jose B. Cruz,et al.  Guaranteed recall of all training pairs for bidirectional associative memory , 1991, IEEE Trans. Neural Networks.

[11]  L. Personnaz,et al.  Collective computational properties of neural networks: New learning mechanisms. , 1986, Physical review. A, General physics.

[12]  Jose B. Cruz,et al.  Two coding strategies for bidirectional associative memory , 1990, IEEE Trans. Neural Networks.

[13]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[14]  A.N. Michel,et al.  Associative memories via artificial neural networks , 1990, IEEE Control Systems Magazine.

[15]  W. Krauth,et al.  Learning algorithms with optimal stability in neural networks , 1987 .

[16]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[17]  B. Bavarian,et al.  Introduction to neural networks for intelligent control , 1988, IEEE Control Systems Magazine.