Period-doublings to chaos in a simple neural network

The author considers a discrete-time neural network which consists of only two neurons with the sigmoidal nonlinear function as the neuron activation function and has no external inputs and no time delay. He treats the simple network as a one-parameter family of two-dimensional maps with the neuron gain as the parameter, and mathematically proves the existence of period-doublings to chaos in the network with an excitatory neuron and an inhibitory neuron. Specifically, it is proved that, for a certain class of singular connection weight matrices, the simple neural network is dynamically equivalent to a one-parameter full family of (one-dimensional) S-unimodal maps on the interval which is well-known to become chaotic through the period-doubling route as the parameter varies.<<ETX>>

[1]  S. N. Rasband,et al.  Chaotic Dynamics of Nonlinear Systems , 1990 .

[2]  Morris W. Hirsch,et al.  Convergent activation dynamics in continuous time networks , 1989, Neural Networks.

[3]  M. Feigenbaum.  Universal behavior in nonlinear systems , 1983 .

[4]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[5]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[6]  Paul F. M. J. Verschure,et al.  A note on chaotic behavior in simple neural networks , 1990, Neural Networks.

[7]  P. Hagedorn.  Non-Linear Oscillations , 1982 .

[8]  Erich Harth,et al.  Order and chaos in neural systems: An approach to the dynamics of higher brain functions , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[9]  Xin Wang,et al.  Stability of fixed points and periodic orbits and bifurcations in analog neural networks , 1992, Neural Networks.

[10]  L. Goddard.  Non-Linear Oscillations , 1963, Nature.

[11]  J. Barhen,et al.  'Chaotic relaxation' in concurrently asynchronous neurodynamics , 1989, International 1989 Joint Conference on Neural Networks.

[12]  Tomasz Nowicki.  On some dynamical properties of S-unimodal maps on an interval , 1985 .

[13]  John F. Kolen,et al.  Backpropagation is Sensitive to Initial Conditions , 1990, Complex Syst..

[14]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[15]  John W. Clark,et al.  Order and Chaos in Neural Systems , 1987 .

[16]  Ashok K. Agrawala,et al.  Study of Network Dynamics , 1993, Comput. Networks ISDN Syst..

[17]  Alvin Shrier,et al.  Chaos in neurobiology , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[18]  Pavol Brunovsky.  New directions in dynamical systems , 1990 .

[19]  Steve Renals,et al.  Chaos in Neural Networks , 1990, EURASIP Workshop.

[20]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[21]  James P. Crutchfield,et al.  Phenomenology of Spatio-Temporal Chaos , 1987 .

[22]  R. Westervelt,et al.  Dynamics of iterated-map neural networks. , 1989, Physical review. A, General physics.

[23]  John W. Clark,et al.  Chaos in neural systems , 1986 .

[24]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[25]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[26]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[27]  R. Devaney.  An Introduction to Chaotic Dynamical Systems , 1990 .

[28]  R. M. Westervelt,et al.  Complex dynamics in simple neural circuits , 1987 .

[29]  J. Eckmann,et al.  Iterated maps on the interval as dynamical systems , 1980 .

[30]  Riedel,et al.  Temporal sequences and chaos in neural nets. , 1988, Physical review. A, General physics.

[31]  Fernando J. Pineda,et al.  Dynamics and architecture for neural computation , 1988, J. Complex..

[32]  David Whitley,et al.  Discrete Dynamical Systems in Dimensions One and Two , 1983 .

[33]  B. Huberman,et al.  Dynamic behavior of nonlinear networks , 1983 .

[34]  Philip Holmes,et al.  Bifurcations of one- and two-dimensional maps , 1984, Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences.

[35]  G. Basti,et al.  On the cognitive function of deterministic chaos in neural networks , 1989, International 1989 Joint Conference on Neural Networks.

[36]  Charles M. Marcus,et al.  Dynamics of Analog Neural Networks with Time Delay , 1988, NIPS.

[37]  S. Renals,et al.  A study of network dynamics , 1990 .