Transition from regular to complex behaviour in a discrete deterministic asymmetric neural network model

The authors study the long-time behaviour of the transient before the collapse on the periodic attractors of a discrete deterministic asymmetric neural network model. The system has a finite number of possible states so it is not possible to use the term chaos in the usual sense of sensitive dependence on the initial condition. Nevertheless, on varying the asymmetry parameter, k, one observes a transition from ordered motion (i.e. short transients and short periods on the attractors) to 'complex' temporal behaviour. This transition takes place for the same value kc at which one has a change in behaviour for the mean transient length from a power law in the size of the system (N) to an exponential law in N. The 'complex' behaviour during the transient shows strong analogies with chaotic behaviour: decay of temporal correlations, positive Shannon entropy, nonconstant Renyi entropies of different orders. Moreover the transition is very similar to the intermittent transition in chaotic systems: a scaling law for the Shannon entropy and strong fluctuations of the 'effective Shannon entropy' along the transient, for k>kc.

[1]  Aleksandr Yakovlevich Khinchin,et al.  Mathematical foundations of information theory , 1959 .

[2]  Misha Tsodyks,et al.  Chaos in Highly Diluted Neural Networks , 1991 .

[3]  H. Gutfreund,et al.  The nature of attractors in an asymmetric spin glass with deterministic dynamics , 1988 .

[4]  G. Paladin,et al.  Intermittency as multifractality in history space , 1986 .

[5]  Falcioni,et al.  Ergodic properties of high-dimensional symplectic maps. , 1991, Physical review. A, Atomic, molecular, and optical physics.

[6]  S. Kauffman.  Metabolic stability and epigenesis in randomly constructed genetic nets. , 1969, Journal of theoretical biology.

[7]  Eckmann,et al.  Fluctuations of dynamical scaling indices in nonlinear systems. , 1986, Physical review. A, General physics.

[8]  Wolfgang Kinzel,et al.  Freezing transition in asymmetric random neural networks with deterministic dynamics , 1989 .

[9]  Alfréd Rényi,et al.  Probability Theory , 1970 .

[10]  G. Benettin,et al.  Lyapunov Characteristic Exponents for smooth dynamical systems and for hamiltonian systems; A method for computing all of them. Part 2: Numerical application , 1980 .

[11]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Ising spins and Glauber dynamics. , 1988, Physical review. A, General physics.

[12]  Michael Schreckenberg,et al.  Glauber dynamics of the asymmetric SK-model , 1989 .

[13]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[14]  B. Derrida,et al.  Phase Transitions in Two-Dimensional Kauffman Cellular Automata , 1986 .

[15]  K Nutzel,et al.  The length of attractors in asymmetric random neural networks with deterministic dynamics , 1991 .

[16]  Crutchfield,et al.  Are attractors relevant to turbulence? , 1988, Physical review letters.

[17]  Sompolinsky,et al.  Dynamics of spin systems with randomly asymmetric bonds: Langevin dynamics and a spherical model. , 1987, Physical review. A, General physics.

[18]  Y. Pomeau,et al.  Intermittent transition to turbulence in dissipative dynamical systems , 1980 .

[19]  G. Benettin,et al.  Lyapunov Characteristic Exponents for smooth dynamical systems and for hamiltonian systems; a method for computing all of them. Part 1: Theory , 1980 .

[20]  P. Grassberger.  Toward a quantitative theory of self-generated complexity , 1986 .

[21]  A. Vulpiani,et al.  Anomalous scaling laws in multifractal objects , 1987 .

[22]  S. Ruffo,et al.  Qualitative changes in Hamiltonian dynamics , 1985 .