Spike-Timing-Dependent Plasticity: The Relationship to Rate-Based Learning for Models with Weight Dynamics Determined by a Stable Fixed Point

Experimental evidence indicates that synaptic modification depends on the timing relationship between the presynaptic inputs and the output spikes that they generate. In this letter, results are presented for models of spike-timing-dependent plasticity (STDP) whose weight dynamics is determined by a stable fixed point. Four classes of STDP are identified on the basis of the time extent of their input-output interactions. The effect on the potentiation of synapses with different rates of input is investigated to elucidate the relationship of STDP with classical studies of long-term potentiation and depression and rate-based Hebbian learning. The selective potentiation of higher-rate synaptic inputs is found only for models where the time extent of the input-output interactions is input restricted (i.e., restricted to time domains delimited by adjacent synaptic inputs) and that have a time-asymmetric learning window with a longer time constant for depression than for potentiation. The analysis provides an account of learning dynamics determined by an input-selective stable fixed point. The effect of suppressive interspike interactions on STDP is also analyzed and shown to modify the synaptic dynamics.

[1]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[2]  H C Tuckwell,et al.  Synaptic transmission in a model for stochastic neural activity. , 1979, Journal of theoretical biology.

[3]  C. Zorumski,et al.  Properties of vertebrate glutamate receptors: Calcium mobilization and desensitization , 1992, Progress in Neurobiology.

[4]  Y. Dan,et al.  Spike-timing-dependent synaptic modification induced by natural spike trains , 2002, Nature.

[5]  J Rinzel,et al.  Influence of temporal correlation of synaptic input on the rate and variability of firing in neurons. , 2000, Biophysical journal.

[6]  R. Nicoll,et al.  Activity differentially regulates the surface expression of synaptic AMPA and NMDA glutamate receptors. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Patrick D. Roberts,et al.  Computational Consequences of Temporally Asymmetric Learning Rules: II. Sensory Image Cancellation , 2000, Journal of Computational Neuroscience.

[8]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[9]  Daniel J. Amit,et al.  Spike-Driven Synaptic Dynamics Generating Working Memory States , 2003, Neural Computation.

[10]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[11]  L. Abbott,et al.  A Quantitative Description of Short-Term Plasticity at Excitatory Synapses in Layer 2/3 of Rat Primary Visual Cortex , 1997, The Journal of Neuroscience.

[12]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[13]  K. Miller,et al.  Synaptic Economics: Competition and Cooperation in Synaptic Plasticity , 1996, Neuron.

[14]  K. I. Blum,et al.  Functional significance of long-term potentiation for sequence learning and prediction. , 1996, Cerebral cortex.

[15]  Daniel J. Amit,et al.  Quantitative Study of Attractor Neural Network Retrieving at Low Spike Rates: I , 1991 .

[16]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[17]  C. Holmgren,et al.  Coincident Spiking Activity Induces Long-Term Changes in Inhibition of Neocortical Pyramidal Cells , 2001, The Journal of Neuroscience.

[18]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.

[19]  Patrick D. Roberts,et al.  Spike timing dependent synaptic plasticity in biological systems , 2002, Biological Cybernetics.

[20]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[21]  David B. Grayden,et al.  Study of neuronal gain in a conductance-based leaky integrate-and-fire neuron model with balanced excitatory and inhibitory synaptic input , 2003, Biological Cybernetics.

[22]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  Kenneth D. Miller,et al.  The Role of Constraints in Hebbian Learning , 1994, Neural Computation.

[24]  Wulfram Gerstner,et al.  Coding properties of spiking neurons: reverse and cross-correlations , 2001, Neural Networks.

[25]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[26]  Anthony N. Burkitt,et al.  How synapses in the auditory system wax and wane: theoretical perspectives , 2003, Biological Cybernetics.

[27]  Stefano Fusi Spike-driven Synaptic Plasticity for Learning Correlated Patterns of Mean Firing Rates , 2003, Reviews in the neurosciences.

[28]  A. Siegert On the First Passage Time Probability Problem , 1951 .

[29]  Tomoki Fukai,et al.  A Stochastic Method to Predict the Consequence of Arbitrary Forms of Spike-Timing-Dependent Plasticity , 2003, Neural Computation.

[30]  Stan C. A. M. Gielen,et al.  Correlation Between Uncoupled Conductance-Based Integrate-and-Fire Neurons Due to Common and Synchronous Presynaptic Firing , 2001, Neural Computation.

[31]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[32]  J. Hammersley,et al.  Diffusion Processes and Related Topics in Biology , 1977 .

[33]  Wulfram Gerstner,et al.  What Matters in Neuronal Locking? , 1996, Neural Computation.

[34]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[35]  T. Sejnowski Statistical constraints on synaptic plasticity. , 1977, Journal of theoretical biology.

[36]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[37]  Daniel D. Lee,et al.  Equilibrium properties of temporally asymmetric Hebbian plasticity. , 2000, Physical review letters.

[38]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[39]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[40]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[41]  R. Huganir,et al.  Activity-Dependent Modulation of Synaptic AMPA Receptor Accumulation , 1998, Neuron.

[42]  Henry Markram,et al.  An Algorithm for Modifying Neurotransmitter Release Probability Based on Pre- and Postsynaptic Spike Timing , 2001, Neural Computation.

[43]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[44]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[45]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[46]  T. Lømo,et al.  Potentiation of monosynaptic EPSPs in the perforant path-dentate granule cell synapse , 2004, Experimental Brain Research.

[47]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[48]  T. Sejnowski,et al.  The Book of Hebb , 1999, Neuron.

[49]  S. Nelson,et al.  BDNF Has Opposite Effects on the Quantal Amplitude of Pyramidal Neuron and Interneuron Excitatory Synapses , 1998, Neuron.

[50]  Wulfram Gerstner,et al.  Intrinsic Stabilization of Output Rates by Spike-Based Hebbian Learning , 2001, Neural Computation.

[51]  Rajesh P. N. Rao,et al.  Spike-Timing-Dependent Hebbian Plasticity as Temporal Difference Learning , 2001, Neural Computation.

[52]  Gastone C. Castellani,et al.  Converging evidence for a simplified biophysical model of synaptic plasticity , 2002, Biological Cybernetics.

[53]  Eugene M. Izhikevich,et al.  Relating STDP to BCM , 2003, Neural Computation.

[54]  Patrick D. Roberts,et al.  Computational Consequences of Temporally Asymmetric Learning Rules: I. Differential Hebbian Learning , 1999, Journal of Computational Neuroscience.

[55]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.

[56]  J. Leo van Hemmen,et al.  Modeling Synaptic Plasticity in Conjunction with the Timing of Pre- and Postsynaptic Action Potentials , 2000, Neural Computation.

[57]  L. Abbott,et al.  Cortical Development and Remapping through Spike Timing-Dependent Plasticity , 2001, Neuron.

[58]  R. Zucker Calcium- and activity-dependent synaptic plasticity , 1999, Current Opinion in Neurobiology.

[59]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[60]  R. Kempter,et al.  How spiking neurons give rise to a temporal-feature map: from synaptic plasticity to axonal selection. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[61]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[62]  Anthony N. Burkitt Balanced neurons: analysis of leaky integrate-and-fire neurons with reversal potentials , 2001, Biological Cybernetics.

[63]  R. Nicoll,et al.  Long-term potentiation--a decade of progress? , 1999, Science.

[64]  Niraj S. Desai,et al.  BDNF regulates the intrinsic excitability of cortical neurons. , 1999, Learning & memory.

[65]  Sacha B. Nelson,et al.  Postsynaptic Depolarization Scales Quantal Amplitude in Cortical Pyramidal Neurons , 2001, The Journal of Neuroscience.

[66]  B. Sakmann,et al.  Active propagation of somatic action potentials into neocortical pyramidal cell dendrites , 1994, Nature.