The dynamic threshold of semi-orthogonal associative memory model

Discusses the fundamental properties of state evolution in the recalling processes of the semi-orthogonal associative memory (SAM) model and derives the optimum dynamic threshold of a SAM. In a probabilistic sense, there is a convergence criterion Q/sub /spl nu// in the SAM such that, for arbitrary initial input, the recalling outputs converge to the desired pattern on this input when the effective Hamming distance between the desired pattern and the initial input is no larger than (1-Q/sub /spl nu//)N, but the attracting basins of stable states in this model are strange. It is proved that the strange attracting basins can be improved by introducing a dynamic threshold into this model. Making use of the statistical neurodynamics, the optimum dynamic threshold is given and its efficiency is investigated.

[1]  Yasumitsu Miyazaki,et al.  Connected Associative Memory Neural Network with Dynamical Threshold Function , 1992 .

[2]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[3]  N. Farhat.  Optoelectronic neural networks and learning machines , 1989, IEEE Circuits and Devices Magazine.

[4]  A.N. Michel,et al.  Analysis and synthesis of a class of discrete-time neural networks described on hypercubes , 1991, IEEE Trans. Neural Networks.

[5]  X. Huang,et al.  The capacity of the semi-orthogonally associative memories model , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[6]  Mahesan Niranjan,et al.  A theoretical investigation into the performance of the Hopfield model , 1990, IEEE Trans. Neural Networks.

[7]  S. Amari,et al.  Characteristics of Random Nets of Analog Neuron-Like Elements , 1972, IEEE Trans. Syst. Man Cybern..

[8]  Shun-ichi Amari,et al.  Statistical neurodynamics of associative memory , 1988, Neural Networks.

[9]  Xinhua Zhuang,et al.  Better learning for bidirectional associative memory , 1993, Neural Networks.

[10]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[11]  Eric Goles Ch.,et al.  Decreasing energy functions as a tool for studying threshold networks , 1985, Discret. Appl. Math..

[12]  Shun-ichi Amari,et al.  Mathematical foundations of neurocomputing , 1990, Proc. IEEE.

[13]  Robert Hecht-Nielsen,et al.  A BAM with increased information storage capacity , 1988, IEEE 1988 International Conference on Neural Networks.

[14]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[15]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[16]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.