Successive learning in hetero-associative memories using chaotic neural networks

In this paper, the authors propose a successive learning method in hetero-associative memories such as bidirectional associative memories and multidirectional associative memories using chaotic neural networks. It can distinguish unknown data from the stored known data and can learn the unknown data successively. The proposed model makes use of the difference in the response to the input data in order to distinguish unknown data from the stored known data. When input data is regarded as unknown data, the data is memorized. Furthermore, the proposed model can estimate and learn correct data from noisy unknown data or incomplete unknown data by considering the temporal summation of the continuous data input. In addition, similarity to the physiological facts in the olfactory bulb of a rabbit, as found by Freeman (1991), is observed in the behavior of the proposed model. A series of computer simulations shows the effectiveness of the proposed model.

[1]  W. Freeman.  The physiology of perception. , 1991, Scientific American.

[2]  Chang-song Zhou,et al.  Chaotic neural networks and chaotic annealing , 2000, Neurocomputing.

[3]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[4]  E. Caianiello.  Outline of a theory of thought-processes and thinking machines. , 1961, Journal of theoretical biology.

[5]  Masafumi Hagiwara,et al.  Chaotic multidirectional associative memory , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[6]  Masafumi Hagiwara,et al.  Chaotic bidirectional associative memory , 1996, Proceedings of International Conference on Neural Networks (ICNN'96).

[7]  Masafumi Hagiwara,et al.  Successive learning in chaotic neural network , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[8]  Yong Yao,et al.  Model of biological pattern recognition with spatially chaotic dynamics , 1990, Neural Networks.

[9]  Kazuyuki Aihara,et al.  An analysis of associative dynamics in a chaotic neural network with external stimulation , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[10]  Masafumi Hagiwara.  Multidirectional associative memory , 1990 .

[11]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[12]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[13]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[14]  Kazuyuki Aihara,et al.  Automatic learning in chaotic neural networks , 1996 .

[15]  K. Aihara,et al.  Chaotic neural networks , 1990 .