Stability of Rotor Hopfield Neural Networks With Synchronous Mode

A complex-valued Hopfield neural network (CHNN) is a model of a Hopfield neural network using multistate neurons. The stability conditions of CHNNs have been widely studied. A CHNN with a synchronous mode will converge to a fixed point or a cycle of length 2. A rotor Hopfield neural network (RHNN) is also a model of a multistate Hopfield neural network. RHNNs have much higher storage capacity and noise tolerance than CHNNs. We extend the theories regarding the stability of CHNNs to RHNNs. In addition, we investigate the stability of RHNNs with the projection rule. Although a CHNN with projection rule can be trapped at a cycle, an RHNN with projection rule converges to a fixed point. This is one of the great advantages of RHNNs.

[1]  Masaki Kobayashi,et al.  Rotational invariance of quaternionic hopfield neural networks , 2016 .

[2]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[3]  Masaki Kobayashi.  Information geometry of rotor Boltzmann machines , 2016 .

[4]  Masaki Kobayashi,et al.  Complex-Valued Bipartite Auto-Associative Memory , 2014, IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences.

[5]  Masaki Kobayashi,et al.  Projection rule for complex-valued associative memory with large constant terms , 2012 .

[6]  Yukio Kosugi,et al.  An image storage system using complex-valued associative memories , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[7]  Masaki Kobayashi,et al.  Rotor Associative Memory with a Periodic Activation Function , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[8]  Pengsheng Zheng.  Threshold Complex-Valued Neural Associative Memory , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[9]  廣瀬 明,et al.  Complex-valued neural networks : advances and applications , 2013 .

[10]  Masaki Kobayashi,et al.  Pseudo-Relaxation Learning Algorithm for Complex-Valued Associative Memory , 2008, Int. J. Neural Syst..

[11]  Jacek M. Zurada,et al.  Complex-valued multistate neural associative memory , 1996, IEEE Trans. Neural Networks.

[12]  Masaki Kobayashi.  Gradient descent learning rule for complex‐valued associative memories with large constant terms , 2016 .

[13]  Masaki Kobayashi,et al.  Hyperbolic Hopfield Neural Networks , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Masaki Kobayashi,et al.  Attractors accompanied with a training pattern of multivalued hopfield neural networks , 2015 .

[15]  Donq-Liang Lee.  Improving the capacity of complex-valued neural networks with a modified gradient descent learning rule , 2001, IEEE Trans. Neural Networks.

[16]  Masaki Kobayashi,et al.  Fundamental Abilities of Rotor Associative Memory , 2010, 2010 IEEE/ACIS 9th International Conference on Computer and Information Science.

[17]  Masaki Kobayashi,et al.  Projection Rule for Rotor Hopfield Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Richard S. Zemel,et al.  Lending direction to neural networks , 1995, Neural Networks.

[19]  Nobuyuki Matsui,et al.  Commutative quaternion and multistate Hopfield neural networks , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[20]  Akira Hirose,et al.  Complex-Valued Neural Networks: Theories and Applications , 2003 .

[21]  Jonas Schreiber.  Complex Valued Neural Networks Utilizing High Dimensional Parameters , 2016 .

[22]  P. Arena,et al.  Neural Networks in Multidimensional Domains: Fundamentals and New Trends in Modelling and Control , 1998 .

[23]  H. Aoki.  A complex-valued neuron to transform gray level images to phase information , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[24]  Donq-Liang Lee.  Complex-Valued Neural Associative Memories: Network Stability and Learning Algorithm , 2003 .

[25]  Jacek M. Zurada,et al.  A new design method for the complex-valued multistate Hopfield associative memory , 2003, IEEE Trans. Neural Networks.

[26]  D.-L. Lee,et al.  Improvements of Complex-Valued Hopfield Associative Memory by Using Generalized Projection Rules , 2006, IEEE Transactions on Neural Networks.

[27]  Donq-Liang Lee,et al.  Relaxation of the stability condition of the complex-valued neural networks , 2001, IEEE Trans. Neural Networks.

[28]  Masaki Kobayashi,et al.  Noise Robust Gradient Descent Learning for Complex-Valued Associative Memory , 2011, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[29]  Masaki Kobayashi,et al.  Symmetric Complex-Valued Hopfield Neural Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Nobuyuki Matsui,et al.  Quaternionic multistate Hopfield neural network with extended projection rule , 2016, Artificial Life and Robotics.

[31]  Gouhei Tanaka,et al.  Complex-valued multistate associative memory with nonlinear multilevel functions for gray-level image reconstruction , 2009, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[32]  Masaki Kobayashi,et al.  Chaotic Rotor Associative Memory , 2009 .

[33]  Wen-June Wang,et al.  A multivalued bidirectional associative memory operating on a complex domain , 1998, Neural Networks.

[34]  Jacek M. Zurada,et al.  Stability condition for discrete time multi-valued recurrent neural networks in asynchronous update mode , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[35]  Masaki Kobayashi,et al.  Hybrid Quaternionic Hopfield Neural Network , 2015, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..