How to prevent spurious data in a chaotic brain

Seminal observations performed by Skarda and Freeman (1987) on the olfactory bulb of rabbits during cognitive tasks have suggested to locate the basal state of behavior in the network's spatio-temporal dynamics. Following these neurophysiological observations, the authors have investigated in previous papers the possibility to store external stimuli in spatio-temporal dynamical attractors of recurrent neural networks. To this aim, an efficient learning algorithm, based on a time asymmetric Hebbian mechanism, has been proposed. The underlying idea is to obtain - as much as possible - a natural i.e. unconstrained mapping between the external stimuli and the spontaneous internal dynamics of the network. The dynamical regime called "frustrated chaos" by the authors appears to play a substantial role in the establishment of this mapping. In this paper, adopting a symbolic coding of the output, new investigations are performed on the presence and the importance of spurious data. It is shown how the presence of chaos contributes to stop their proliferation.

[1]  Ichiro Tsuda,et al.  Towards an interpretation of dynamic neural activity in terms of chaotic dynamical systems , 2000 .

[2]  Y. Pomeau,et al.  Intermittent transition to turbulence in dissipative dynamical systems , 1980 .

[3]  Bruno Cessac,et al.  Self-organization and dynamics reduction in recurrent networks: stimulus presentation and learning , 1998, Neural Networks.

[4]  F. Varela,et al.  Perception's shadow: long-distance synchronization of human brain activity , 1999, Nature.

[5]  P. Érdi,et al.  The brain as a hermeneutic device. , 1996, Bio Systems.

[6]  D. J. Wallace,et al.  Models of Neural NetWorks , 1995 .

[7]  I. Tsuda,et al.  Chaotic dynamics of information processing: the "magic number seven plus-minus two" revisited. , 1985, Bulletin of mathematical biology.

[8]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[9]  W. Freeman.  Simulation of chaotic EEG patterns with a dynamic model of the olfactory system , 1987, Biological Cybernetics.

[10]  G. Bi,et al.  Distributed synaptic modification in neural networks induced by patterned stimulation , 1999, Nature.

[11]  A Babloyantz,et al.  Computation with chaos: a paradigm for cortical activity. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Eytan Domany,et al.  Models of Neural Networks I , 1991 .

[13]  Hugues Bersini,et al.  How chaos in small hopfield networks makes sense of the world , 2003 .

[14]  Hugues Bersini,et al.  Phase synchronization and chaotic dynamics in Hebbian learned artificial recurrent neural networks , 2005 .

[15]  Kunihiko Kaneko,et al.  ISSUE : Chaotic Itinerancy Chaotic itinerancy , 2003 .

[16]  C. Molter,et al.  Introduction of a Hebbian unsupervised learning algorithm to boost the encoding capacity of Hopfield networks , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[17]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[18]  O. Rössler.  The Chaotic Hierarchy , 1983 .

[19]  D. Ruelle,et al.  Ergodic theory of chaos and strange attractors , 1985 .

[20]  A. Wolf,et al.  Determining Lyapunov exponents from a time series , 1985 .

[21]  Ichiro Tsuda,et al.  Chaotic dynamics of information processing: The “magic number seven plus-minus two” revisited , 1985 .

[22]  Marina Basu.  The Embodied Mind: Cognitive Science and Human Experience , 2004 .

[23]  Hugues Bersini,et al.  Learning Cycles brings Chaos in Continuous Hopfield Networks , 2005 .

[24]  Hugues Bersini,et al.  An interpretative recurrent neural network to improve pattern storing capabilities: dynamical considerations , 2006 .

[25]  S. Grossberg.  Neural Networks and Natural Intelligence , 1988 .

[26]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[27]  R. Sternberg,et al.  The Psychology of Intelligence , 2002 .

[28]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[29]  I. Tsuda.  Toward an interpretation of dynamic neural activity in terms of chaotic dynamical systems. , 2001, The Behavioral and brain sciences.

[30]  Hugues Bersini.  The frustrated and compositional nature of chaos in small Hopfield networks , 1998, Neural Networks.