Stable Neural Attractors Formation: Learning Rules and Network Dynamics

Different models of attractor networks have been proposed to form cell assemblies. Among them, networks with a fixed synaptic matrix can be distinguished from those including learning dynamics, since the latter adapt the attractor landscape of the lateral connections according to the statistics of the presented stimuli, yielding a more complex behavior. We propose a new learning rule that builds internal representations of input timuli as attractors of neurons in a recurrent network. The dynamics of activation and synaptic adaptation are analyzed in experiments where representations for different input patterns are formed, focusing on the properties of the model as a memory system. The experimental results are exposed along with a survey of different Hebbian rules proposed in the literature for attractors formation. These rules are compared with the help of a new tool, the learning map, where LTP and LTD, as well as homo- and heterosynaptic competition, can be graphically interpreted.

[1]  L N Cooper,et al.  Solutions of the BCM learning rule in a network of lateral interacting nonlinear neurons. , 1999, Network.

[2]  N. RafaelLorenteDe,et al.  ANALYSIS OF THE ACTIVITY OF THE CHAINS OF INTERNUNCIAL NEURONS , 1938 .

[3]  Nicolas Brunel,et al.  Learning internal representations in an attractor neural network with analogue neurons , 1995 .

[4]  서효정,et al.  Cell-assembly의 생리학적 증거 , 2002 .

[5]  Nicolas Brunel,et al.  Dynamics of an attractor neural network converting temporal into spatial correlations Network: Compu , 1994 .

[6]  R. Lorente ANALYSIS OF THE ACTIVITY OF THE CHAINS -OF INTERNUNCIAL NEURONS , 2004 .

[7]  N Brunel,et al.  Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network. , 1998, Network.

[8]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[9]  Daniel J. Amit,et al.  Conversion of Temporal Correlations Between Stimuli to Spatial Correlations Between Attractors , 1999, Neural Computation.

[10]  Leslie G. Ungerleider,et al.  Transient and sustained activity in a distributed neural system for human working memory , 1997, Nature.

[11]  W. Abraham,et al.  Reduction of the threshold for long‐term potentiation by prior theta‐frequency synaptic activity , 1995, Hippocampus.

[12]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[13]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[14]  P M MILNER,et al.  The cell assembly: Mark II. , 1957, Psychological review.

[15]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[16]  Prof. Dr. Valentino Braitenberg,et al.  Anatomy of the Cortex , 1991, Studies of Brain Function.

[17]  E. Bienenstock A model of neocortex , 1995 .

[18]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[19]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[20]  D. Amaral,et al.  The three-dimensional organization of the hippocampal formation: A review of anatomical data , 1989, Neuroscience.

[21]  E. Rolls Functions of neuronal networks in the hippocampus and neocortex in memory , 1989 .

[22]  Nathan Intrator,et al.  Solutions of the BCM learning rule in a network of lateral interacting nonlinear neurons , 1999 .

[23]  Walter J. Freeman,et al.  The Hebbian paradigm reintegrated: Local reverberations as internal representations , 1995, Behavioral and Brain Sciences.

[24]  John H. Holland,et al.  Tests on a cell assembly theory of the action of the brain, using a large digital computer , 1956, IRE Trans. Inf. Theory.

[25]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[26]  R. Atkinson,et al.  The control of short-term memory. , 1971, Scientific American.

[27]  Matthew L. Shapiro,et al.  Simulating Hebb cell assemblies: the necessity for partitioned dendritic trees and a post-not-pre LTD rule , 1993 .