Hopf Bifurcation in a Chaotic Associative Memory

This paper has two basic objectives: the first is to investigate Hopf Bifurcation in the internal state of a Chaotic Associative Memory (CAM). For a small network with three neurons, resulting in a six-dimensional Equation of State, the existence and stability of Hopf Bifurcation were verified analytically. The second objective is to study how the Hopf Bifurcation changed the external state (output) of CAM, since this network was trained to associate a dataset of input-output patterns. There were three main differences between this study and others: the bifurcation parameter was not a time delay, but a physical parameter of a CAM; the weights of interconnections between chaotic neurons were neither free parameters nor chosen arbitrarily, but determined in the training process of classical AM; the Hopf Bifurcation occurred in the internal state of CAM, and not in the external state (input-output network signal). We present three examples of Hopf Bifurcation: one neuron with supercritical bifurcation while the other two neurons do not bifurcate; two neurons bifurcating into a subcritical bifurcation and one neuron does not bifurcate; and the same example as before, but with a supercritical bifurcation. We show that the presence of a limit cycle in the internal state of CAM prevents output signals from the network converging towards a desired equilibrium state (desired memory), although the CAM is able to access this memory.

[1]  Yang Hui.  Stability and Bifurcation Analysis on a Discrete-time Neural Network , 2010 .

[2]  Bhaskar D. Kulkarni,et al.  Normal form analysis of a nonisothermal reaction in a CSTR , 1994 .

[3]  Aluizio F. R. Araújo,et al.  Dynamic behaviors in chaotic bidirectional associative memory , 2007, J. Intell. Fuzzy Syst..

[4]  Jinde Cao,et al.  Stability and Hopf Bifurcation in a Simplified BAM Neural Network With Two Time Delays , 2007, IEEE Transactions on Neural Networks.

[5]  K. Aihara,et al.  Bifurcations in a coupled system of chaotic neurons generating oscillatory responses , 2008, 2008 15th International Conference on Systems, Signals and Image Processing.

[6]  Xiaofeng Liao,et al.  Bautin bifurcation in a class of two-neuron networks with resonant bilinear terms , 2008 .

[7]  Pei Yu,et al.  Hopf-zero bifurcation in a generalized Gopalsamy neural network model , 2012 .

[8]  Kazuyuki Aihara,et al.  A MOSFET-based model of a class 2 nerve membrane , 2005, IEEE Transactions on Neural Networks.

[9]  Jinde Cao,et al.  Stability and Hopf bifurcation analysis on a four-neuron BAM neural network with time delays , 2006 .

[10]  Stefan Balint,et al.  Bifurcation analysis for a discrete-time Hopfield neural network of two neurons with two delays , 2009, ESANN.

[11]  Chuandong Li,et al.  Codimension two bifurcation in a delayed neural network with unidirectional coupling , 2013 .

[12]  Luciana P. P. Bueno,et al.  Ability to skip steps emerging from chaotic dynamics , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[13]  Edward Ott,et al.  Chaos in Dynamical Systems - 2nd Edition , 2002 .

[14]  Kazuyuki Aihara,et al.  Associative Dynamics in a Chaotic Neural Network , 1997, Neural Networks.

[15]  Jin Ye,et al.  Stability and bifurcation in a simplified five-neuron BAM neural network with delays , 2009 .

[16]  Hiroshi Kawakami,et al.  Bifurcations in modified BVP neurons connected by inhibitory and electrical coupling , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[17]  Rui Xu,et al.  Bifurcation analysis for a tri-neuron discrete-time BAM neural network with delays , 2009 .

[18]  Christian O'Reilly,et al.  On Some Necessary and Sufficient Conditions for a Recurrent Neural Network Model With Time Delays to Generate Oscillations , 2010, IEEE Transactions on Neural Networks.

[19]  Chuandong Li,et al.  Bogdanov–Takens Singularity in Tri-Neuron Network With Time Delay , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[20]  M. Lakshmanan,et al.  Bifurcation analysis of the travelling waveform of FitzHugh-Nagumo nerve conduction model equation. , 1997, Chaos.

[21]  J. Crawford.  Introduction to bifurcation theory , 1991 .

[22]  Gholam Reza Rokni Lamooki,et al.  The Bogdanov-Takens bifurcation analysis on a three dimensional recurrent neural network , 2010, Neurocomputing.

[23]  Tetsuya Yoshinaga,et al.  Reduced model of discrete-time dynamic image segmentation system and its bifurcation analysis , 2009 .

[24]  BART KOSKO,et al.  Bidirectional associative memories , 1988, IEEE Trans. Syst. Man Cybern..

[25]  FARIDON AMDJADI,et al.  The Calculation of the Hopf/Hopf Mode Interaction Point in Problems with Z2-Symmetry , 2002, Int. J. Bifurc. Chaos.

[26]  Arindam Basu,et al.  Dynamics and Bifurcations in a Silicon Neuron , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[27]  Xianhua Tang,et al.  Stability and bifurcation analysis of a six-neuron BAM neural network model with discrete delays , 2011, Neurocomputing.

[28]  Junjie Wei,et al.  Stability and Hopf bifurcation analysis on a simplified BAM neural network with delays , 2005 .

[29]  Qiankun Song,et al.  Stability and Hopf bifurcation analysis of a tri-neuron BAM neural network with distributed delay , 2012, Neurocomputing.

[30]  P. J. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[31]  José D. Piñeiro,et al.  Stability of Quasi-Periodic Orbits in Recurrent Neural Networks , 2010, Neural Processing Letters.

[32]  Yi Zhao,et al.  Characterization of Static bifurcations for Maps in the Frequency Domain , 2007, Int. J. Bifurc. Chaos.

[33]  E. Ott.  Chaos in Dynamical Systems: Contents , 1993 .

[34]  Kazuyuki Aihara,et al.  An Associative Network with Chaotic Neurons and Dynamic Synapses , 2007, Int. J. Bifurc. Chaos.

[35]  J. Hale,et al.  Dynamics and Bifurcations , 1991 .

[36]  Liancheng Wang,et al.  Multiple Hopf bifurcations of symmetric BAM neural network model with delay , 2009, Appl. Math. Lett..

[37]  Aluizio F. R. Araújo,et al.  Controlling Chaos in Chaotic Bidirectional Associative Memories , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[38]  Chunrui Zhang,et al.  Stability and bifurcation of a discrete BAM neural network model with delays , 2008 .

[39]  P. Olver.  Nonlinear Systems , 2013 .

[40]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[41]  Xianhua Tang,et al.  Frequency domain analysis for bifurcation in a simplified tri-neuron BAM network model with two delays , 2010, Neural Networks.

[42]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.