Associative Dynamics in a Chaotic Neural Network

An associative network is constructed with chaotic neuron models interconnected through a conventional auto-associative matrix of synaptic weights. The associative dynamics of the network is analysed with spatio-temporal output patterns, quasi-energy function, distances between internal state vectors and orbital instability. The network shows a periodic response after a nonperiodic transient phase when the external stimulations are spatially constant. The retrieval characteristics and the duration in the transient phase are dependent on the initial conditions. The results imply that the transient dynamics can be interpreted as a memory searching process. The network also shows periodic responses with short and very long periods when external stimulations are not spatially constant, but corresponding to a stored pattern and an unstored pattern, respectively. The responses to the external stimulations can be utilized for a pattern recognition with nonliner dynamics. Copyright 1996 Elsevier Science Ltd.

[1]  Tomoki Fukai,et al.  Chaotic image retrieval in Markovian asymmetric neural networks with sign-constrained synaptic couplings , 1990 .

[2]  J. Yorke,et al.  Strange attractors that are not chaotic , 1984 .

[3]  H. Wigström,et al.  A neuron model with learning capability and its relation to mechanisms of association , 1973, Kybernetik.

[4]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[5]  K. Aihara,et al.  Forced Oscillations and Routes to Chaos in the Hodgkin-Huxley Axons and Squid Giant Axons , 1987 .

[6]  E. Caianiello.  Outline of a theory of thought-processes and thinking machines. , 1961, Journal of theoretical biology.

[7]  I. Shimada,et al.  A Numerical Approach to Ergodic Problem of Dissipative Dynamical Systems , 1979 .

[8]  H. B. Wilson,et al.  Chaotic stochasticity: a ubiquitous source of unpredictability in epidemics , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[9]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[10]  K. Kaneko.  Clustering, coding, switching, hierarchical ordering, and control in a network of chaotic elements , 1990 .

[11]  P. Bak,et al.  Self-organized criticality. , 1988, Physical review. A, General physics.

[12]  K. Aihara,et al.  Chaotic neural networks , 1990 .

[13]  Ichiro Tsuda,et al.  Dynamic link of memory--Chaotic memory map in nonequilibrium neural networks , 1992, Neural Networks.

[14]  Bruce J West,et al.  Patterns, Information and Chaos in Neuronal Systems , 1993 .

[15]  Christopher G. Langton,et al.  Computation at the edge of chaos: Phase transitions and emergent computation , 1990 .

[16]  Kaoru Nakano,et al.  Associatron-A Model of Associative Memory , 1972, IEEE Trans. Syst. Man Cybern..

[17]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[18]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[19]  L. Olsen,et al.  Chaos in biological systems. , 1985 .

[20]  P. Davis,et al.  Chaotic wandering and search in a cycle-memory neural network , 1992 .

[21]  Yong Yao,et al.  Model of biological pattern recognition with spatially chaotic dynamics , 1990, Neural Networks.

[22]  K. Aihara,et al.  12. Chaotic oscillations and bifurcations in squid giant axons , 1986 .

[23]  R. Quiroga,et al.  Chaos in Brain Function , 1990 .

[24]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[25]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[26]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[27]  Kazuyuki Aihara,et al.  An analysis of associative dynamics in a chaotic neural network with external stimulation , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[28]  K. Ikeda,et al.  Maxwell-Bloch Turbulence , 1989 .

[29]  Shun-ichi Amari,et al.  Characteristics of sparsely encoded associative memory , 1989, Neural Networks.

[30]  Moore,et al.  Unpredictability and undecidability in dynamical systems. , 1990, Physical review letters.

[31]  Tomasz Kapitaniak,et al.  On strange nonchaotic attractors and their dimensions , 1991 .

[32]  Tomasz Kapitaniak,et al.  Existence and characterization of strange nonchaotic attractors in nonlinear systems , 1991 .

[33]  Walter J. Freeman,et al.  TUTORIAL ON NEUROBIOLOGY: FROM SINGLE NEURONS TO BRAIN CHAOS , 1992 .

[34]  I. Tsuda.  Chaotic itinerancy as a dynamical basis of hermeneutics in brain and mind , 1991 .