Chaotic complex‐valued bipartite auto‐associative memory with a periodic activation function

A Hopfield associative memory (HAM) can store binary data. A HAM has been extended to a complex‐valued HAM (CHAM) which can store multi‐level data. A CHAM has often been applied to the storage of grayscale images. A CHAM has a problem of rotational invariance, which makes many psuedomemories and reduces the noise tolerance. A chaotic CHAM can explore the stored patterns, though it recalls many pseudomemories. A complex‐valued bipartite auto‐associative memory (CBAAM) was proposed to improve the noise tolerance by solving rotational invariance. Since a CBAAM stores the reversed patterns, a chaotic CBAAM (CCBAAM) recalls both the training and reversed patterns. In order to solve this problem, a periodic activation function is introduced. A periodic activation function identifies the training and reversed patterns, so that a CCBAAM does not recall the reversed patterns. We evaluate our proposed CCBAAM by computer simulations. © 2017 Institute of Electrical Engineers of Japan. Published by John Wiley & Sons, Inc.

[1]  Masaki Kobayashi,et al.  Symmetric Complex-Valued Hopfield Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Masaki Kobayashi,et al.  Pseudomemories of two‐dimensional multistate hopfield neural networks , 2017 .

[3]  Masaki Kobayashi,et al.  Rotational invariance of quaternionic hopfield neural networks , 2016 .

[4]  Masaki Kobayashi.  Gradient descent learning rule for complex‐valued associative memories with large constant terms , 2016 .

[5]  Jonas Schreiber.  Complex Valued Neural Networks Utilizing High Dimensional Parameters , 2016 .

[6]  Masaki Kobayashi,et al.  Hybrid Quaternionic Hopfield Neural Network , 2015, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[7]  Masaki Kobayashi,et al.  Attractors accompanied with a training pattern of multivalued hopfield neural networks , 2015 .

[8]  Masaki Kobayashi,et al.  Complex-Valued Bipartite Auto-Associative Memory , 2014, IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences.

[9]  Masaki Kobayashi,et al.  Projection Rule for Rotor Hopfield Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Masaki Kobayashi,et al.  Multidirectional associative memory with two hidden layers , 2013 .

[11]  廣瀬 明,et al.  Complex-valued neural networks : advances and applications , 2013 .

[12]  Masaki Kobayashi,et al.  Rotor Associative Memory with a Periodic Activation Function , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[13]  Igor N. Aizenberg.  Periodic Activation Function and a Modified Learning Algorithm for the Multivalued Neuron , 2010, IEEE Transactions on Neural Networks.

[14]  Gouhei Tanaka,et al.  Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction , 2009, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[15]  Yuko Osana,et al.  Chaotic Complex-Valued Associative Memory , 2007 .

[16]  Akira Hirose,et al.  Complex-Valued Neural Networks , 2006, Studies in Computational Intelligence.

[17]  Masaki Kobayashi,et al.  Complex-valued Multidirectional Associative Memory , 2005 .

[18]  Kazuyuki Aihara,et al.  Coherent Response in a Chaotic Neural Network , 2000, Neural Processing Letters.

[19]  Nobuyuki Matsui,et al.  A Neural Chaos Model of Multistable Perception , 2000, Neural Processing Letters.

[20]  Akira Hirose,et al.  Complex-Valued Neural Networks: Theories and Applications , 2003 .

[21]  Masaki Kobayashi,et al.  Automatic sleep stage scoring based on waveform recognition method and decision-tree learning , 2002, Systems and Computers in Japan.

[22]  Masaki Kobayashi,et al.  Multidirectional associative memory with a hidden layer , 2002, Systems and Computers in Japan.

[23]  H. Aoki.  Image Association Using a Complex-Valued Associative Memory Model , 2000 .

[24]  Yukio Kosugi,et al.  An image storage system using complex-valued associative memories , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[25]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[26]  Masafumi Hagiwara.  Multidirectional associative memory , 1990 .

[27]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[28]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.