Spike-Timing-Dependent Plasticity and Relevant Mutual Information Maximization

Synaptic plasticity was recently shown to depend on the relative timing of the pre- and postsynaptic spikes. This article analytically derives a spike-dependent learning rule based on the principle of information maximization for a single neuron with spiking inputs. This rule is then transformed into a biologically feasible rule, which is compared to the experimentally observed plasticity. This comparison reveals that the biological rule increases information to a near-optimal level and provides insights into the structure of biological plasticity. It shows that the time dependency of synaptic potentiation should be determined by the synaptic transfer function and membrane leak. Potentiation consists of weight-dependent and weight-independent components whose weights are of the same order of magnitude. It further suggests that synaptic depression should be triggered by rare and relevant inputs but at the same time serves to unlearn the baseline statistics of the network's inputs. The optimal depression curve is uniformly extended in time, but biological constraints that cause the cell to forget past events may lead to a different shape, which is not specified by our current model. The structure of the optimal rule thus suggests a computational account for several temporal characteristics of the biological spike-timing-dependent rules.

[1]  Sen Song,et al.  Temporally Asymmetric Hebbian Learning, Spike liming and Neural Response Variability , 1998, NIPS.

[2]  B. Sakmann,et al.  Coincidence detection and changes of synaptic efficacy in spiny stellate neurons in rat barrel cortex , 1999, Nature Neuroscience.

[3]  Isaac Meilijson,et al.  Effective Neuronal Learning with Ineffective Hebbian Learning Rules , 2001, Neural Computation.

[4]  D. Debanne,et al.  Asynchronous pre- and postsynaptic activity induces associative long-term depression in area CA1 of the rat hippocampus in vitro. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[5]  James M. Bower,et al.  Computational Neuroscience: Trends in Research , 1996 .

[6]  Wulfram Gerstner,et al.  Intrinsic Stabilization of Output Rates by Spike-Based Hebbian Learning , 2001, Neural Computation.

[7]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[8]  James M. Bower Computational Neuroscience: Trends in Research 2001 , 2000 .

[9]  Ralph Linsker,et al.  Local Synaptic Learning Rules Suffice to Maximize Mutual Information in a Linear Network , 1992, Neural Computation.

[10]  Eytan Ruppin,et al.  Hebbian learning and neuronal regulation , 2002 .

[11]  T. Sejnowski Statistical constraints on synaptic plasticity. , 1977, Journal of theoretical biology.

[12]  Li I. Zhang,et al.  A critical window for cooperation and competition among developing retinotectal synapses , 1998, Nature.

[13]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[14]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[15]  Rajesh P. N. Rao,et al.  Predictive Sequence Learning in Recurrent Neocortical Circuits , 1999, NIPS.

[16]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[17]  M. Poo,et al.  Calcium stores regulate the polarity and input specificity of synaptic modification , 2000, Nature.

[18]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[19]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[20]  P. Dayan,et al.  Optimising synaptic learning rules in linear associative memories , 1991, Biological Cybernetics.

[21]  Y. Dan,et al.  Hebbian depression of isolated neuromuscular synapses in vitro. , 1992, Science.

[22]  Isaac Meilijson,et al.  Distributed Synchrony of Spiking Neurons in a Hebbian Cell Assembly , 1999, NIPS.

[23]  B. Sakmann,et al.  Developmental and regional expression in the rat brain and functional properties of four NMDA receptors , 1994, Neuron.

[24]  Michael A. Arbib,et al.  The handbook of brain theory and neural networks , 1995, A Bradford book.

[25]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[26]  E. Lehmann Elements of large-sample theory , 1998 .

[27]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[28]  I Segev,et al.  Untangling dendrites with quantitative models. , 2000, Science.

[29]  T. Sejnowski,et al.  Natural patterns of activity and long-term synaptic plasticity , 2000, Current Opinion in Neurobiology.

[30]  James M. Bower,et al.  Computational Neuroscience: Trends in Research 1995 , 1996 .

[31]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[32]  Patrick D. Roberts,et al.  Spike timing dependent synaptic plasticity in biological systems , 2002, Biological Cybernetics.

[33]  Daniel D. Lee,et al.  Equilibrium properties of temporally asymmetric Hebbian plasticity. , 2000, Physical review letters.

[34]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[35]  Matthew A. Wilson,et al.  From hippocampus to V1: Effect of LTP on spatio-temporal dynamics of receptive fields , 2000, Neurocomputing.

[36]  C. Holmgren,et al.  Coincident Spiking Activity Induces Long-Term Changes in Inhibition of Neocortical Pyramidal Cells , 2001, The Journal of Neuroscience.

[37]  Y. Dan,et al.  Stimulus Timing-Dependent Plasticity in Cortical Processing of Orientation , 2001, Neuron.

[38]  E. Shimizu,et al.  Genetic enhancement of learning and memory in mice , 1999, Nature.

[39]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[40]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.

[41]  D. Johnston,et al.  A Synaptically Controlled, Associative Signal for Hebbian Plasticity in Hippocampal Neurons , 1997, Science.

[42]  Menahem Segal,et al.  Dendritic spines shaped by synaptic activity , 2000, Current Opinion in Neurobiology.

[43]  V. Han,et al.  Synaptic plasticity in a cerebellum-like structure depends on temporal order , 1997, Nature.

[44]  Anne Lohrli Chapman and Hall , 1985 .

[45]  T. Ferguson A Course in Large Sample Theory , 1996 .

[46]  Y. Dan,et al.  Spike-timing-dependent synaptic modification induced by natural spike trains , 2002, Nature.