Learning in realistic networks of spiking neurons and spike‐driven plastic synapses

We have used simulations to study the learning dynamics of an autonomous, biologically realistic recurrent network of spiking neurons connected via plastic synapses, subjected to a stream of stimulus–delay trials, in which one of a set of stimuli is presented followed by a delay. Long‐term plasticity, produced by the neural activity experienced during training, structures the network and endows it with active (working) memory, i.e. enhanced, selective delay activity for every stimulus in the training set. Short‐term plasticity produces transient synaptic depression. Each stimulus used in training excites a selective subset of neurons in the network, and stimuli can share neurons (overlapping stimuli). Long‐term plasticity dynamics are driven by presynaptic spikes and coincident postsynaptic depolarization; stability is ensured by a refresh mechanism. In the absence of stimulation, the acquired synaptic structure persists for a very long time. The dependence of long‐term plasticity dynamics on the characteristics of the stimulus response (average emission rates, time course and synchronization), and on the single‐cell emission statistics (coefficient of variation) is studied. The study clarifies the specific roles of short‐term synaptic depression, NMDA receptors, stimulus representation overlaps, selective stimulation of inhibition, and spike asynchrony during stimulation. Patterns of network spiking activity before, during and after training reproduce most of the in vivo physiological observations in the literature.

[1]  N Brunel,et al.  Slow stochastic Hebbian learning of classes of stimuli in a recurrent neural network. , 1998, Network.

[2]  D. Amit,et al.  Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network , 2003, The European journal of neuroscience.

[3]  Y. Miyashita.  Neuronal correlate of visual associative long-term memory in the primate temporal cortex , 1988, Nature.

[4]  Nicolas Brunel,et al.  Dynamics and plasticity of stimulus-selective persistent activity in cortical network models. , 2003, Cerebral cortex.

[5]  Robert M. Kozelka,et al.  Introductory Probability and Statistical Applications. , 1966 .

[6]  Misha Tsodyks,et al.  Computation by Ensemble Synchronization in Recurrent Networks with Synaptic Depression , 2002, Journal of Computational Neuroscience.

[7]  Davide Badoni,et al.  Spike-Driven Synaptic Plasticity: Theory, Simulation, VLSI Implementation , 2000, Neural Computation.

[8]  E. Miller,et al.  Effects of Visual Experience on the Representation of Objects in the Prefrontal Cortex , 2000, Neuron.

[9]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[10]  O. Andreassen,et al.  Mice Deficient in Cellular Glutathione Peroxidase Show Increased Vulnerability to Malonate, 3-Nitropropionic Acid, and 1-Methyl-4-Phenyl-1,2,5,6-Tetrahydropyridine , 2000, The Journal of Neuroscience.

[11]  Daniel J. Amit,et al.  Spike-Driven Synaptic Dynamics Generating Working Memory States , 2003, Neural Computation.

[12]  Paolo Del Giudice,et al.  Long and short-term synaptic plasticity and the formation of working memory: A case study , 2001, Neurocomputing.

[13]  Daniel J. Amit,et al.  Mean Field and Capacity in Realistic Networks of Spiking Neurons Storing Sparsely Coded Random Memories , 2004, Neural Computation.

[14]  D. Amit,et al.  Learning attractors in an asynchronous, stochastic electronic neural network. , 1998, Network.

[15]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[16]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[17]  Henry Markram,et al.  Neural Networks with Dynamic Synapses , 1998, Neural Computation.

[18]  Paolo Del Giudice,et al.  Efficient Event-Driven Simulation of Large Networks of Spiking Neurons and Dynamical Synapses , 2000, Neural Computation.

[19]  D J Amit,et al.  Multiple-object working memory--a model for behavioral performance. , 2003, Cerebral cortex.

[20]  Paul L. Meyer,et al.  Introductory Probability and Statistical Applications , 1970 .

[21]  R. Desimone,et al.  Responses of Macaque Perirhinal Neurons during and after Visual Stimulus Association Learning , 1999, The Journal of Neuroscience.

[22]  Nicolas Brunel,et al.  Dynamics of an attractor neural network converting temporal into spatial correlations Network: Compu , 1994 .

[23]  H. Tamura,et al.  Visual response properties of cells in the ventral and dorsal parts of the macaque inferotemporal cortex. , 2001, Cerebral cortex.

[24]  Nicolas Brunel,et al.  Dynamics of a recurrent network of spiking neurons before and following learning , 1997 .

[25]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[26]  Ichiro Fujita,et al.  Presumed inhibitory neurons in the macaque inferior temporal cortex: visual response properties and functional interactions with adjacent neurons. , 2004, Journal of neurophysiology.

[27]  Daniel J. Amit,et al.  Simulation in neurobiology: theory or experiment? , 1998, Trends in Neurosciences.

[28]  H. Markram,et al.  t Synchrony Generation in Recurrent Networks with Frequency-Dependent Synapses , 2000, The Journal of Neuroscience.

[29]  Abbreviations , 1971 .

[30]  Y. Miyashita,et al.  Neuronal correlate of pictorial short-term memory in the primate temporal cortexYasushi Miyashita , 1988, Nature.

[31]  Y. Miyashita,et al.  Activity of primate inferotemporal neurons related to a sought target in pair-association task. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[32]  N Brunel,et al.  Correlations of cortical Hebbian reverberations: theory versus experiment , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  Daniel J. Amit,et al.  Paradigmatic Working Memory (Attractor) Cell in IT Cortex , 1997, Neural Computation.

[34]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[35]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[36]  K. Nakamura,et al.  Mnemonic firing of neurons in the monkey temporal pole during a visual recognition memory task. , 1995, Journal of neurophysiology.

[37]  Vittorio Dante,et al.  Learning attractors in an asynchronous, stochastic electronic neural network , 1998 .

[38]  L. Squire,et al.  Neuronal representations of stimulus associations develop in the temporal lobe during learning , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[39]  K. H. Britten,et al.  Neuronal plasticity that underlies improvement in perceptual performance. , 1994, Science.

[40]  Yasushi Miyashita,et al.  Forward Processing of Long-Term Associative Memory in Monkey Inferotemporal Cortex , 2003, The Journal of Neuroscience.

[41]  W. Senn,et al.  Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. , 2003, Journal of neurophysiology.

[42]  Christian Hölscher,et al.  Perirhinal cortex neuronal activity related to long‐term familiarity memory in the macaque , 2003, The European journal of neuroscience.

[43]  Maurizio Mattia,et al.  Collective Behavior of Networks with Linear (VLSI) Integrate-and-Fire Neurons , 1999, Neural Computation.

[44]  P. Dayan.  Fast oscillations in cortical circuits , 2000 .

[45]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.