Neural associative memory for intelligent information processing

In this paper, first we derive a novel relaxation method for the system of linear inequalities and apply it to the learning for associative memories. Since the proposed intersection learning can guarantee the recall of all training data, it can greatly enlarge the storage capacity of associative memories. In addition, it requires much less weights renewal times than the conventional methods. We also propose a multimodule associative memory which can be learned by the intersection learning algorithm. The proposed associative memory can deal with many-to-many associations and it is applied to a knowledge processing task. Computer simulation results show the effectiveness of the proposed learning algorithm and associative memory.

[1]  Yuichiro Anzai,et al.  Multimodule Neural Network for Associative Memory , 1992 .

[2]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[3]  Masafumi Hagiwara Multidirectional associative memory , 1990 .

[4]  Jose B. Cruz,et al.  Guaranteed recall of all training pairs for bidirectional associative memory , 1991, IEEE Trans. Neural Networks.

[5]  Masao Nakagawa,et al.  Episodic associative memory , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[6]  Xinhua Zhuang,et al.  Better learning for bidirectional associative memory , 1993, Neural Networks.

[7]  Masafumi Hagiwara,et al.  Knowledge processing system using multidirectional associative memory , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  Masafumi Hagiwara,et al.  Episodic Associative Memories , 1996, Neurocomputing.

[9]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[10]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[11]  Masafumi Hagiwara,et al.  Multimodule associative memory for many-to-many associations , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[12]  Yuzo Hirai,et al.  Mutually linked HASPs: A solution for constraint-satisfaction problems by associative processing , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[13]  Masao Nakagawa,et al.  Improved multidirectional associative memories for training sets including common terms , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[14]  Marvin K. Simon,et al.  Spread spectrum communications. Volume 1, 2 & 3 , 1985 .

[15]  Heekuck Oh,et al.  Adaptation of the relaxation method for learning in bidirectional associative memory , 1994, IEEE Trans. Neural Networks.

[16]  Peter M. Todd,et al.  Learning and connectionist representations , 1993 .

[17]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[18]  Masao Nakagawa,et al.  Quick learning for bidirectional associative memory , 1994 .