Complex dynamics and the structure of small neural networks

The discrete-time dynamics of small neural networks is studied empirically, with emphasis laid on non-trivial bifurcation scenarios. For particular two- and three-neuron networks interesting dynamical properties like periodic, quasi-periodic and chaotic attractors are observed, many of them co-existing for one and the same set of parameters. An appropriate equivalence class of networks is defined, describing them as parametrized dynamical systems with identical dynamical capacities. Combined symmetries in phase space and parameter space are shown to generate different representatives of such a class. Moreover, conditions on the connectivity structure are suggested, which guarantee the existence of complex dynamics for a considered equivalence class of network configurations.

[1]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[2]  René Thom,et al.  Structural stability and morphogenesis , 1977, Pattern Recognit..

[3]  J. Szentágothai.  The modular architectonic principle of neural centers. , 1983, Reviews of physiology, biochemistry and pharmacology.

[4]  U. an der Heiden,et al.  The dynamics of recurrent inhibition , 1984, Journal of mathematical biology.

[5]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[6]  Kevan A. C. Martin,et al.  A Canonical Microcircuit for Neocortex , 1989, Neural Computation.

[7]  R. Westervelt,et al.  Dynamics of iterated-map neural networks. , 1989, Physical review. A, General physics.

[8]  S. Renals,et al.  A study of network dynamics , 1990 .

[9]  Xin Wang,et al.  Period-doublings to chaos in a simple neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[10]  R. Traub,et al.  Neuronal Networks of the Hippocampus , 1991 .

[11]  Xin Wang,et al.  Stability of fixed points and periodic orbits and bifurcations in analog neural networks , 1992, Neural Networks.

[12]  François Chapeau-Blondeau,et al.  Stable, oscillatory, and chaotic regimes in the dynamics of small neural networks with delay , 1992, Neural Networks.

[13]  F. Pasemann.  DYNAMICS OF A SINGLE MODEL NEURON , 1993 .

[14]  J. E. Skinner,et al.  Chaos and physiology: deterministic chaos in excitable cell assemblies. , 1994, Physiological reviews.

[15]  W. Singer,et al.  Temporal Coding in the Brain , 1994, Research and Perspectives in Neurosciences.

[16]  Frank Pasemann,et al.  Characterization of periodic attractors in neural ring networks , 1995, Neural Networks.

[17]  T. Gelder,et al.  Mind as Motion: Explorations in the Dynamics of Cognition , 1995 .

[18]  A. Opstal.  Dynamic Patterns: The Self-Organization of Brain and Behavior , 1995 .

[19]  Randall D. Beer,et al.  On the Dynamics of Small Continuous-Time Recurrent Neural Networks , 1995, Adapt. Behav..

[20]  J. Milton,et al.  NOISE, MULTISTABILITY, AND DELAYED RECURRENT LOOPS , 1996 .

[21]  Andreas V. M. Herz,et al.  Global Analysis of Recurrent Neural Networks , 1996 .

[22]  Christian Mira,et al.  Chaos In Discrete Dynamical Systems , 1997 .

[23]  Frank Pasemann.  Structure and dynamics of recurrent neuromodules , 1997 .

[24]  M. Arbib,et al.  Neural Organization: Structure, Function, and Dynamics , 1997 .

[25]  Khashayar Pakdaman,et al.  Effect of delay on the boundary of the basin of attraction in a system of two neurons , 1998, Neural Networks.

[26]  Arndt Klotz,et al.  A small-size neural network for computing with strange attractors , 1999, Neural Networks.

[27]  E. Kaszkurewicz,et al.  Matrix diagonal stability in systems and computation , 1999 .

[28]  Sylvain Meignen,et al.  Synchronization and desynchronization of neural oscillators , 1999, Neural Networks.

[29]  Mario Martelli,et al.  Introduction to Discrete Dynamical Systems and Chaos: Martelli/Introduction , 1999 .

[30]  Fernanda Botelho,et al.  Dynamical features simulated by recurrent neural networks , 1999, Neural Networks.

[31]  Mario Martelli,et al.  Introduction to discrete dynamical systems and chaos , 1999 .

[32]  F Pasemann,et al.  F Ur Mathematik in Den Naturwissenschaften Leipzig Generalized and Partial Synchronization of Coupled Neural Networks Generalized and Partial Synchronization of Coupled Neural Networks , 2022 .

[33]  Master-slave synchronization in chaotic discrete-time oscillators. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[34]  Peter Tiño,et al.  Attractive Periodic Sets in Discrete-Time Recurrent Networks (with Emphasis on Fixed-Point Stability and Bifurcations in Two-Neuron Networks) , 2001, Neural Computation.

[35]  Bruno Lara,et al.  Robot control and the evolution of modular neurodynamics , 2001 .

[36]  Lorenzo Moreno Ruiz,et al.  Study of Chaos in a Simple Discrete Recurrence Neural Network , 2001, IWANN.

[37]  J. Thompson,et al.  Nonlinear Dynamics and Chaos , 2002 .

[38]  Roman Borisyuk,et al.  Bifurcation analysis of a neural network model , 1992, Biological Cybernetics.

[39]  J. Kelso,et al.  Action-Perception as a Pattern Formation Process , 2018, Attention and Performance XIII.