The Behavior of Forgetting Learning in Bidirectional Associative Memory

Forgetting learning is an incremental learning rule in associative memories. With it, the recent learning items can be encoded, and the old learning items will be forgotten. In this article, we analyze the storage behavior of bidirectional associative memory (BAM) under the forgetting learning. That is, Can the most recent k learning item be stored as a fixed point? Also, we discuss how to choose the forgetting constant in the forgetting learning such that the BAM can correctly store as many as possible of the most recent learning items. Simulation is provided to verify the theoretical analysis.

[1]  Andrew Chi-Sing Leung,et al.  Stability, capacity, and statistical dynamics of second-order bidirectional associative memory , 1995, IEEE Trans. Syst. Man Cybern..

[2]  Jose B. Cruz,et al.  Two coding strategies for bidirectional associative memory , 1990, IEEE Trans. Neural Networks.

[3]  J. Austin Associative memory , 1987 .

[4]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[5]  D. J. Wallace,et al.  Storage capacity and learning in Ising-Spin neural networks , 1991 .

[6]  Robert Hecht-Nielsen,et al.  A BAM with increased information storage capacity , 1988, IEEE 1988 International Conference on Neural Networks.

[7]  C. S. Leung Encoding method for bidirectional associative memory using projection on convex sets , 1993, IEEE Trans. Neural Networks.

[8]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[9]  G. Parisi A memory which forgets , 1986 .

[10]  J. Leo van Hemmen,et al.  Collective phenomena in neural networks , 1991 .

[11]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[12]  Andrew Chi-Sing Leung,et al.  Stability and statistical properties of second-order bidirectional associative memory , 1997, IEEE Trans. Neural Networks.

[13]  Bart Kosko,et al.  Neural networks and fuzzy systems , 1998 .

[14]  Stanislas Dehaene,et al.  Networks of Formal Neurons and Memory Palimpsests , 1986 .