An introduction to complex-valued recurrent correlation neural networks

In this paper, we generalize the bipolar recurrent correlation neural networks (RCNNs) of Chiueh and Goodman for complex-valued vectors. A complex-valued RCNN (CV-RCNN) is characterized by a possible non-linear function which is applied on the real part of the scalar product of the current state and the fundamental vectors. Computational experiments reveal that some CV-RCNNs can implement associative memories with high-storage capacity. Furthermore, these CV-RCNNs exhibit an excellent noise tolerance.

[1]  Mohamad H. Hassoun,et al.  Associative neural memories : theory and implementation , 1993 .

[2]  Marimuthu Palaniswami,et al.  Neural techniques for combinatorial optimization with applications , 1998, IEEE Trans. Neural Networks.

[3]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Mei Ping Teo.  Recurrent correlation associative memories , 2014 .

[5]  Claudio Moraga,et al.  A Feedforward Neural Network based on Multi-Valued Neurons , 2004, Fuzzy Days.

[6]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[7]  Edwin R. Hancock,et al.  Storage Capacity of the Exponential Correlation Associative Memory , 1999, Neural Process. Lett..

[8]  Jacek M. Zurada,et al.  Generalized Hopfield networks for associative memories with multi-valued stable states , 1996, Neurocomputing.

[9]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[10]  Tzi-Dar Chiueh,et al.  Recurrent correlation associative memories and their VLSI implementation , 1993 .

[11]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[12]  Jacek M. Zurada,et al.  A new design method for the complex-valued multistate Hopfield associative memory , 2003, IEEE Trans. Neural Networks.

[13]  D.-L. Lee,et al.  Improvements of Complex-Valued Hopfield Associative Memory by Using Generalized Projection Rules , 2006, IEEE Transactions on Neural Networks.

[14]  Santosh S. Venkatesh,et al.  The capacity of the Hopfield associative memory , 1987, IEEE Trans. Inf. Theory.

[15]  Gouhei Tanaka,et al.  Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction , 2009, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[16]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[17]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[18]  TANISŁAW,et al.  IMAGE RECALL USING A LARGE SCALE GENERALIZED BRAIN-STATE-IN-A-BOX NEURAL NETWORK , 2005 .

[19]  Edwin R. Hancock,et al.  A study of pattern recovery in recurrent correlation associative memories , 2003, IEEE Trans. Neural Networks.

[20]  Demetri Psaltis,et al.  Nonlinear discriminant functions and associative memories , 1987 .

[21]  Edwin R. Hancock,et al.  A Bayesian interpretation for the exponential correlation associative memory , 1998, Pattern Recognit. Lett..

[22]  Kanter,et al.  Associative recall of memory without errors. , 1987, Physical review. A, General physics.

[23]  Jun Wang,et al.  A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[24]  Karl Steinbuch,et al.  Die Lernmatrix , 2004, Kybernetik.

[25]  José Alí Moreno,et al.  The Hopfield Associative Memory Network: Improving Performance with the Kernel "Trick" , 2004, IBERAMIA.

[26]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[27]  Elisa Ricci,et al.  Recurrent Correlation Associative Memories: A Feature Space Perspective , 2008, IEEE Transactions on Neural Networks.

[28]  Dembo,et al.  General potential surfaces and neural networks. , 1988, Physical review. A, General physics.