The Bogdanov-Takens bifurcation analysis on a three dimensional recurrent neural network

A class of recurrent neural networks is investigated in the vicinity of the Bogdanov-Takens bifurcation point in the parameter space when the slope of the transfer function of the neurons at the origin is not equal to one. It will be shown that two different bifurcation diagrams can be constructed. In each bifurcation diagram, there are critical values for the parameters of the network for which curves of pitchfork and Hopf bifurcation intersect each other at a point where the linear part of the system that describes the network, has a pair of simple zero eigenvalues. As curves of homoclinic and heteroclinic bifurcation emanate from the Bogdanov-Takens point, a complicated behavior is observed by the variation of weights in the recurrent neural network.

[1]  Y. Kuznetsov.  Elements of Applied Bifurcation Theory , 2023, Applied Mathematical Sciences.

[2]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[3]  Jinde Cao,et al.  Global robust stability of delayed recurrent neural networks , 2004 .

[5]  Jinde Cao,et al.  Periodic solutions and its exponential stability of reaction–diffusion recurrent neural networks with continuously distributed delays , 2006 .

[6]  Zidong Wang,et al.  Neural networks with discrete and distributed time-varying delays: A general stability analysis , 2008 .

[7]  Y. Kuznetsov.  Elements of applied bifurcation theory (2nd ed.) , 1998 .

[8]  Yurong Liu,et al.  Stochastic stability of uncertain Hopfield neural networks with discrete and distributed delays , 2006 .

[9]  John J. Tyson,et al.  Existence of periodic solutions for negative feedback cellular control systems , 1977 .

[10]  Guanrong Chen,et al.  Hopf Bifurcation Analysis: A Frequency Domain Approach , 1996 .

[11]  David H. Owens,et al.  Existence, learning, and replication of periodic motions in recurrent neural networks , 1998, IEEE Trans. Neural Networks.

[12]  Zidong Wang,et al.  On global asymptotic stability of neural networks with discrete and distributed delays , 2005 .

[13]  Gholam Reza Rokni Lamooki,et al.  The Hopf bifurcation analysis on a time-delayed recurrent neural network in the frequency domain , 2010, Neurocomputing.

[14]  Bo Gao,et al.  Equilibria and Their Bifurcations in a Recurrent Neural Network Involving Iterates of a Transcendental Function , 2008, IEEE Transactions on Neural Networks.

[15]  S. Wiggins.  Introduction to Applied Nonlinear Dynamical Systems and Chaos , 1989 .

[16]  Amir F. Atiya,et al.  Oscillations and Synchronizations in Neural Networks: an Exploration of the Labeling Hypothesis , 1991, Int. J. Neural Syst..

[17]  Tharam S. Dillon,et al.  Exponential stability and oscillation of Hopfield graded response neural network , 1994, IEEE Trans. Neural Networks.

[18]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Jinde Cao,et al.  Stability and Hopf Bifurcation of a General Delayed Recurrent Neural Network , 2008, IEEE Transactions on Neural Networks.

[20]  Qiankun Song,et al.  Exponential stability of recurrent neural networks with both time-varying delays and general activation functions via LMI approach , 2008, Neurocomputing.

[21]  Daoyi Xu,et al.  Global attraction and stability for Cohen-Grossberg neural networks with delays , 2006, Neural Networks.

[22]  Long-Yeu Chung,et al.  Global asymptotic stability for cellular neural networks with discrete and distributed time-varying delays , 2007 .

[23]  Kenji Doya,et al.  Adaptive neural oscillator using continuous-time back-propagation learning , 1989, Neural Networks.

[24]  Jun Wang,et al.  Global exponential periodicity and global exponential stability of a class of recurrent neural networks with various activation functions and time-varying delays , 2007, Neural Networks.

[25]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[26]  Zidong Wang,et al.  Global exponential stability of generalized recurrent neural networks with discrete and distributed delays , 2006, Neural Networks.

[27]  Barak A. Pearlmutter.  Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[28]  Jochen J. Steil,et al.  Input space bifurcation manifolds of recurrent neural networks , 2005, Neurocomputing.

[29]  David H. Owens,et al.  Existence and learning of oscillations in recurrent neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[30]  Jinde Cao,et al.  Absolute exponential stability of recurrent neural networks with Lipschitz-continuous activation functions and time delays , 2004, Neural Networks.

[31]  Zidong Wang,et al.  Discrete-time recurrent neural networks with time-varying delays: Exponential stability analysis , 2007 .

[32]  Zidong Wang,et al.  Robust stability for stochastic Hopfield neural networks with time delays , 2006 .