Intrinsic Stabilization of Output Rates by Spike-Based Hebbian Learning

We study analytically a model of long-term synaptic plasticity where synaptic changes are triggered by presynaptic spikes, postsynaptic spikes, and the time differences between presynaptic and postsynaptic spikes. The changes due to correlated input and output spikes are quantified by means of a learning window. We show that plasticity can lead to an intrinsic stabilization of the mean firing rate of the postsynaptic neuron. Subtractive normalization of the synaptic weights (summed over all presynaptic inputs converging on a postsynaptic neuron) follows if, in addition, the mean input rates and the mean input correlations are identical at all synapses. If the integral over the learning window is positive, firing-rate stabilization requires a non-Hebbian component, whereas such a component is not needed if the integral of the learning window is negative. A negative integral corresponds to anti-Hebbian learning in a model with slowly varying firing rates. For spike-based learning, a strict distinction between Hebbian and anti-Hebbian rules is questionable since learning is driven by correlations on the timescale of the learning window. The correlations between presynaptic and postsynaptic firing are evaluated for a piecewise-linear Poisson model and for a noisy spiking neuron model with refractoriness. While a negative integral over the learning window leads to intrinsic rate stabilization, the positive part of the learning window picks up spatial and temporal correlations in the input.

[1]  Wulfram Gerstner,et al.  Hebbian learning of pulse timing in the Barn Owl auditory system , 1999 .

[2]  G Christofi,et al.  The postsynaptic induction of nonassociative long-term depression of excitatory synaptic transmission in rat hippocampal slices. , 1993, Journal of neurophysiology.

[3]  G. Barrionuevo,et al.  Induction of Hebbian and Non-Hebbian Mossy Fiber Long-Term Potentiation by Distinct Patterns of High-Frequency Stimulation , 1996, The Journal of Neuroscience.

[4]  Thomas H. Brown,et al.  Hebbian Synaptic Plasticity: Evolution of the Contemporary Concept , 1994 .

[5]  Kenneth D. Miller,et al.  The Role of Constraints in Hebbian Learning , 1994, Neural Computation.

[6]  Teuvo Kohonen,et al.  Self-Organization and Associative Memory , 1988 .

[7]  Wulfram Gerstner,et al.  What Matters in Neuronal Locking? , 1996, Neural Computation.

[8]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[9]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[10]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[11]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[12]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[13]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[14]  Wulfram Gerstner,et al.  Temporal coding in the sub-millisecond range: Model of barn owl auditory pathway , 1995, NIPS.

[15]  W. Singer,et al.  Long-term depression of excitatory synaptic transmission and its relationship to long-term potentiation , 1993, Trends in Neurosciences.

[16]  J. Hemmen Chapter 18 Theory of synaptic plasticity , 2001 .

[17]  Jack D. Cowan,et al.  DYNAMICS OF SELF-ORGANIZED DELAY ADAPTATION , 1999 .

[18]  K. Miller Receptive Fields and Maps in the Visual Cortex: Models of Ocular Dominance and Orientation Columns* , 1996 .

[19]  R. Kempter,et al.  Formation of temporal-feature maps by axonal propagation of synaptic learning , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[20]  R K Powers,et al.  Effects of background noise on the response of rat and cat motoneurones to excitatory current transients. , 1996, The Journal of physiology.

[21]  Wulfram Gerstner,et al.  Associative memory in a network of ‘spiking’ neurons , 1992 .

[22]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[23]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[24]  Misha Mahowald,et al.  A Spike Based Learning Neuron in Analog VLSI , 1996, NIPS.

[25]  J. Hemmen,et al.  The Hebb rule: storing static and dynamic objects in an associative neural network , 1988 .

[26]  Wulfram Gerstner,et al.  Encoding and Decoding of Patterns which are Correlated in Space and Time , 1990, ÖGAI.

[27]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[28]  L. Cooper,et al.  A unified model of NMDA receptor-dependent bidirectional synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[29]  W Singer,et al.  Induction of LTP and LTD in visual cortex neurones by intracellular tetanization , 1994, Neuroreport.

[30]  Michael P. Perrone,et al.  Post-Hebbian learning rules , 1998 .

[31]  Henry Markram,et al.  An Algorithm for Modifying Neurotransmitter Release Probability Based on Pre- and Postsynaptic Spike Timing , 2001, Neural Computation.

[32]  Niraj S. Desai,et al.  Plasticity in the intrinsic excitability of cortical pyramidal neurons , 1999, Nature Neuroscience.

[33]  Christof Koch,et al.  How voltage-dependent conductances can adapt to maximize the information encoded by neuronal firing rate , 1999, Nature Neuroscience.

[34]  T. Sejnowski,et al.  Associative long-term depression in the hippocampus induced by hebbian covariance , 1989, Nature.

[35]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[36]  David J C MacKaytS,et al.  Analysis of Linsker's application of Hebbian rules to linear networks , 1990 .

[37]  R. Kempter,et al.  How spiking neurons give rise to a temporal-feature map: from synaptic plasticity to axonal selection. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[38]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[39]  James M. Bower,et al.  Computational Neuroscience: Trends in Research , 1996 .

[40]  W. Bialek,et al.  Universal Statistical Behavior of Neural Spike Trains , 1998 .

[41]  H. W. Veen,et al.  Handbook of Biological Physics , 1996 .

[42]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[43]  Wulfram Gerstner,et al.  Noise in Integrate-and-Fire Neurons: From Stochastic Input to Escape Rates , 2000, Neural Computation.

[44]  Terrence J. Sejnowski,et al.  Constrained Optimization for Neural Map Formation: A Unifying Framework for Weight Growth and Normalization , 1998, Neural Computation.

[45]  Teuvo Kohonen,et al.  Self-organization and associative memory: 3rd edition , 1989 .

[46]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[47]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[48]  Wulfram Gerstner,et al.  Spike-Based Compared to Rate-Based Hebbian Learning , 1998, NIPS.

[49]  Wulfram Gerstner,et al.  A developmental learing rule for coincidence tuning in the barn owl auditory system , 1997 .

[50]  B. Kosco Differential Hebbian learning , 1987 .

[51]  Alan F. Murray,et al.  Neural Information Processing Systems (NIPS) Conference , 1993 .

[52]  Henry Markram,et al.  An Algorithm for Synaptic Modification Based on Exact Timing of Pre- and Post-Synaptic Action Potentials , 1997, ICANN.

[53]  K. I. Blum,et al.  Functional significance of long-term potentiation for sequence learning and prediction. , 1996, Cerebral cortex.

[54]  M. Tsodyks Spike-timing-dependent synaptic plasticity – the long road towards understanding neuronal mechanisms of learning and memory , 2002, Trends in Neurosciences.

[55]  Terrence J. Sejnowski,et al.  The Hebb Rule for Synaptic Plasticity: Algorithms and Implementations , 1989 .

[56]  Michael Schmitt,et al.  Unsupervised Learning in Networks of Spiking Neurons Using Temporal Coding , 1997, ICANN.

[57]  E E Fetz,et al.  Relation between shapes of post‐synaptic potentials and changes in firing probability of cat motoneurones , 1983, The Journal of physiology.

[58]  Xiaohui Xie,et al.  Spike-based Learning Rules and Stabilization of Persistent Neural Activity , 1999, NIPS.

[59]  R Linsker,et al.  From basic network principles to neural architecture: emergence of spatial-opponent cells. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[60]  S. Nelson,et al.  Hebb and homeostasis in neuronal plasticity , 2000, Current Opinion in Neurobiology.

[61]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[62]  E. Oja Simplified neuron model as a principal component analyzer , 1982, Journal of mathematical biology.

[63]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[64]  K. Miller,et al.  Synaptic Economics: Competition and Cooperation in Synaptic Plasticity , 1996, Neuron.

[65]  E. Capaldi,et al.  The organization of behavior. , 1992, Journal of applied behavior analysis.

[66]  T. Sejnowski,et al.  Natural patterns of activity and long-term synaptic plasticity , 2000, Current Opinion in Neurobiology.

[67]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[68]  D. Linden The Return of the Spike Postsynaptic Action Potentials and the Induction of LTP and LTD , 1999, Neuron.

[69]  G. Bi,et al.  Distributed synaptic modification in neural networks induced by patterned stimulation , 1999, Nature.

[70]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.

[71]  J. Leo van Hemmen,et al.  Modeling Synaptic Plasticity in Conjunction with the Timing of Pre- and Postsynaptic Action Potentials , 2000, Neural Computation.

[72]  Allen Munro,et al.  6 – Neural information processing , 1977 .

[73]  B. Sakmann,et al.  Coincidence detection and changes of synaptic efficacy in spiny stellate neurons in rat barrel cortex , 1999, Nature Neuroscience.

[74]  G. Turrigiano Homeostatic plasticity in neuronal networks: the more things change, the more they stay the same , 1999, Trends in Neurosciences.

[75]  Wulfram Gerstner,et al.  Extracting Oscillations: Neuronal Coincidence Detection with Noisy Periodic Spike Input , 1998, Neural Computation.