A transient-chaotic autoassociative network (TCAN) based on Lee oscillators

In the past few decades, neural networks have been extensively adopted in various applications ranging from simple synaptic memory coding to sophisticated pattern recognition problems such as scene analysis. Moreover, current studies on neuroscience and physiology have reported that in a typical scene segmentation problem our major senses of perception (e.g., vision, olfaction, etc.) are highly involved in temporal (or what we call "transient") nonlinear neural dynamics and oscillations. This paper is an extension of the author's previous work on the dynamic neural model (EGDLM) of memory processing and on composite neural oscillators for scene segmentation. Moreover, it is inspired by the work of Aihara et al. and Wang on chaotic neural oscillators in pattern association. In this paper, the author proposes a new transient chaotic neural oscillator, namely the "Lee oscillator," to provide temporal neural coding and an information processing scheme. To illustrate its capability for memory association, a chaotic autoassociative network, namely the Transient-Chaotic Auto-associative Network (TCAN) was constructed based on the Lee oscillator. Different from classical autoassociators such as the celebrated Hopfield network, which provides a "time-independent" pattern association, the TCAN provides a remarkable progressive memory association scheme [what we call "progressive memory recalling" (PMR)] during the transient chaotic memory association. This is exactly consistent with the latest research in psychiatry and perception psychology on dynamic memory recalling schemes.

[1]  R. Sternberg,et al.  The Psychology of Intelligence , 2002 .

[2]  Jaeseung Jeong,et al.  Quantification of emotion by nonlinear analysis of the chaotic dynamics of electroencephalograms during perception of 1/f music , 1998, Biological Cybernetics.

[3]  Wei Ren,et al.  Determining the degree of chaos from analysis of ISI time series in the nervous system: a comparison between correlation dimension and nonlinear forecasting methods , 1998, Biological Cybernetics.

[4]  Yong Yao,et al.  Model of biological pattern recognition with spatially chaotic dynamics , 1990, Neural Networks.

[5]  Clemens Wagner,et al.  Construction of an associative memory using unstable periodic orbits of a chaotic attractor. , 2002, Journal of theoretical biology.

[6]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[7]  Ling Guan,et al.  A combined evolution method for associative memory networks , 1998, Neural Networks.

[8]  Ramón Huerta,et al.  Topology selection by chaotic neurons of a pyloric central pattern generator , 2001, Biological Cybernetics.

[9]  J. Piaget.  The Psychology Of Intelligence , 1951 .

[10]  Ali A. Minai,et al.  Stimulus-induced bifurcations in discrete-time neural oscillators , 1998, Biological Cybernetics.

[11]  DeLiang Wang,et al.  Image Segmentation Based on Oscillatory Correlation , 1997, Neural Computation.

[12]  Shinji Doi,et al.  Hopf bifurcations in multiple-parameter space of the Hodgkin-Huxley equations II. Singularity theoretic approach and highly degenerate bifurcations , 2000, Biological Cybernetics.

[13]  Kim T. Blackwell,et al.  Biological plausibility of synaptic associative memory models , 1994, Neural Networks.

[14]  K. Aihara,et al.  12. Chaotic oscillations and bifurcations in squid giant axons , 1986 .

[15]  Masahiko Morita,et al.  Associative memory with nonmonotone dynamics , 1993, Neural Networks.

[16]  DeLiang Wang,et al.  Locally excitatory globally inhibitory oscillator networks , 1995, IEEE Transactions on Neural Networks.

[17]  Jochen Triesch,et al.  Robotic Gesture Recognition , 1997, Gesture Workshop.

[18]  Alan V. Oppenheim,et al.  Synchronization of Lorenz-based chaotic circuits with applications to communications , 1993 .

[19]  Sandro Ridella,et al.  Using chaos to generate keys for associative noise-like coding memories , 1993, Neural Networks.

[20]  Cheng-Yuan Liou,et al.  Error tolerant associative memory , 1999, Biological Cybernetics.

[21]  Jochen Triesch,et al.  A System for Person-Independent Hand Posture Recognition against Complex Backgrounds , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[23]  Xin Wang,et al.  Discrete-time neural networks as dynamical systems , 1994 .

[24]  Xin Wang,et al.  Period-doublings to chaos in a simple neural network , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[25]  Norbert Krüger,et al.  Face recognition by elastic bunch graph matching , 1997, Proceedings of International Conference on Image Processing.

[26]  C. Malsburg.  Nervous Structures with Dynamical Links , 1985 .

[27]  Osamu Hoshino,et al.  Roles of dynamic linkage of stable attractors across cortical networks in recalling long-term memory , 2003, Biological Cybernetics.

[28]  Raymond S. T. Lee,et al.  Invariant object recognition based on elastic graph matching : theory and applications , 2003 .

[29]  J. Michael Herrmann,et al.  Effects of short-time plasticity on the associative memory , 2002, Neurocomputing.

[30]  Allen I. Selverston,et al.  Modeling observed chaotic oscillations in bursting neurons: the role of calcium dynamics and IP3 , 2000, Biological Cybernetics.

[31]  Walter J. Freeman,et al.  TUTORIAL ON NEUROBIOLOGY: FROM SINGLE NEURONS TO BRAIN CHAOS , 1992 .

[32]  James Nga-Kwok Liu,et al.  Tropical cyclone identification and tracking system using integrated neural oscillatory elastic graph matching and hybrid RBF network track mining techniques , 2000, IEEE Trans. Neural Networks Learn. Syst..

[33]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[34]  Kazuyuki Aihara,et al.  Chaotic simulated annealing by a neural network model with transient chaos , 1995, Neural Networks.

[35]  Walter J. Freeman,et al.  A proposed name for aperiodic brain activity: stochastic chaos , 2000, Neural Networks.

[36]  Shinji Doi,et al.  Hopf bifurcations in multiple-parameter space of the Hodgkin-Huxley equations I. Global organization of bistable periodic solutions , 2000, Biological Cybernetics.

[37]  Yuming Chen,et al.  Global stability of neural networks with distributed delays , 2002, Neural Networks.

[38]  Theodore W. Berger,et al.  A biologically based model of functional properties of the hippocampus , 1994, Neural Networks.

[39]  Ichiro Tsuda,et al.  Dynamic link of memory--Chaotic memory map in nonequilibrium neural networks , 1992, Neural Networks.

[40]  Jeanyung Chey,et al.  Spatial working memory span, delayed response and executive function in schizophrenia , 2002, Psychiatry Research.

[41]  Shin Ishii,et al.  A network of chaotic elements for information processing , 1996, Neural Networks.

[42]  Chein-I Chang,et al.  Classification of clustered microcalcifications using a Shape Cognitron neural network , 2003, Neural Networks.

[43]  DeLiang Wang,et al.  Synchronization and desynchronization in a network of locally coupled Wilson-Cowan oscillators , 1996, IEEE Trans. Neural Networks.

[44]  Jochen Triesch,et al.  Robust classification of hand postures against complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[45]  Raymond S. T. Lee.  Elastic Face Recognizer: Invariant Face Recognition Based on Elastic Graph Matching Model , 2002, Int. J. Pattern Recognit. Artif. Intell..

[46]  Chang-song Zhou,et al.  Chaotic neural networks and chaotic annealing , 2000, Neurocomputing.

[47]  W. Freeman.  How Brains Make Up Their Minds , 1999 .

[48]  Joydeep Ghosh,et al.  A complex-valued associative memory for storing patterns as oscillatory states , 1996, Biological Cybernetics.

[49]  Hiroshi Shimizu,et al.  Pattern recognition with figure-ground separation by generation of coherent oscillations , 1994, Neural Networks.

[50]  Teuvo Kohonen,et al.  Correlation Matrix Memories , 1972, IEEE Transactions on Computers.

[51]  K. Aihara,et al.  Forced Oscillations and Routes to Chaos in the Hodgkin-Huxley Axons and Squid Giant Axons , 1987 .

[52]  Pablo Varona,et al.  Dynamics of two electrically coupled chaotic neurons: Experimental observations and model analysis , 2001, Biological Cybernetics.

[53]  L. Kocarev,et al.  Chaos and cryptography: block encryption ciphers based on chaotic maps , 2001 .

[54]  Steve Renals,et al.  Chaos in Neural Networks , 1990, EURASIP Workshop.

[55]  Raymond S. T. Lee.  iJADE surveillant--an intelligent multi-resolution composite neuro-oscillatory agent-based surveillance system , 2003, Pattern Recognit..

[56]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory, Third Edition , 1989, Springer Series in Information Sciences.

[57]  DeLiang Wang,et al.  A dynamically coupled neural oscillator network for image segmentation , 2002, Neural Networks.

[58]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[59]  K. Aihara,et al.  Chaos and asymptotical stability in discrete-time neural networks , 1997, chao-dyn/9701020.

[60]  G. Ermentrout.  Principles of brain functioning: A synergetic approach to brain activity, behavior, and cognition , 1997 .

[61]  K. Aihara,et al.  Neural networks and chaos , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[62]  James A. Anderson,et al.  A simple neural network generating an interactive memory , 1972 .

[63]  Masahiko Morita,et al.  Capacity of associative memory using a nonmonotonic neuron model , 1993, Neural Networks.

[64]  James Nga-Kwok Liu,et al.  Scene analysis using an integrated composite neural oscillatory elastic graph matching model , 2002, Pattern Recognit..

[65]  Joachim M. Buhmann,et al.  Sensory segmentation with coupled neural oscillators , 1992, Biological Cybernetics.

[66]  Henry Markram,et al.  Synapses as dynamic memory buffers , 2002, Neural Networks.

[67]  W. Freeman.  Simulation of chaotic EEG patterns with a dynamic model of the olfactory system , 1987, Biological Cybernetics.

[68]  Jörgen M. Karlholm.  Associative memories with short-range, higher order couplings , 1993, Neural Networks.

[69]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[70]  W. Freeman,et al.  Spatio-temporal correlations in human gamma band electrocorticograms. , 1996, Electroencephalography and clinical neurophysiology.

[71]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[72]  Kazuyuki Aihara,et al.  Associative Dynamics in a Chaotic Neural Network , 1997, Neural Networks.

[73]  W. Freeman.  Nonlinear dynamics of paleocortex manifested in the olfactory EEG , 1979, Biological Cybernetics.