Depression-Biased Reverse Plasticity Rule Is Required for Stable Learning at Top-Down Connections

Top-down synapses are ubiquitous throughout neocortex and play a central role in cognition, yet little is known about their development and specificity. During sensory experience, lower neocortical areas are activated before higher ones, causing top-down synapses to experience a preponderance of post-synaptic activity preceding pre-synaptic activity. This timing pattern is the opposite of that experienced by bottom-up synapses, which suggests that different versions of spike-timing dependent synaptic plasticity (STDP) rules may be required at top-down synapses. We consider a two-layer neural network model and investigate which STDP rules can lead to a distribution of top-down synaptic weights that is stable, diverse and avoids strong loops. We introduce a temporally reversed rule (rSTDP) where top-down synapses are potentiated if post-synaptic activity precedes pre-synaptic activity. Combining analytical work and integrate-and-fire simulations, we show that only depression-biased rSTDP (and not classical STDP) produces stable and diverse top-down weights. The conclusions did not change upon addition of homeostatic mechanisms, multiplicative STDP rules or weak external input to the top neurons. Our prediction for rSTDP at top-down synapses, which are distally located, is supported by recent neurophysiological evidence showing the existence of temporally reversed STDP in synapses that are distal to the post-synaptic cell body.

[1]  Y. Dan,et al.  Spike timing-dependent plasticity: a Hebbian learning rule. , 2008, Annual review of neuroscience.

[2]  S. Ullman,et al.  Retinotopic Axis Specificity and Selective Clustering of Feedback Projections from V2 to V1 in the Owl Monkey , 2005, The Journal of Neuroscience.

[3]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Y. Dan,et al.  Spike-timing-dependent synaptic plasticity depends on dendritic location , 2005, Nature.

[5]  Niraj S. Desai,et al.  Activity-dependent scaling of quantal amplitude in neocortical neurons , 1998, Nature.

[6]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[7]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[8]  J. Lund,et al.  Specificity and non-specificity of synaptic connections within mammalian visual cortex , 2002, Journal of neurocytology.

[9]  A. Burkhalter,et al.  Hierarchical organization of areas in rat visual cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[11]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[12]  Matthieu Gilson,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[13]  Haim Sompolinsky,et al.  Learning Input Correlations through Nonlinear Temporally Asymmetric Hebbian Plasticity , 2003, The Journal of Neuroscience.

[14]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[15]  A. Bacciotti,et al.  Liapunov functions and stability in control theory , 2001 .

[16]  A. Fine,et al.  Are binary synapses superior to graded weight representations in stochastic attractor networks? , 2009, Cognitive Neurodynamics.

[17]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[18]  Y. Dan,et al.  Spike timing-dependent plasticity: from synapse to perception. , 2006, Physiological reviews.

[19]  John H. R. Maunsell,et al.  Physiological Evidence for Two Visual Subsystems , 1987 .

[20]  John H. R. Maunsell,et al.  On the relationship between synaptic input and spike output jitter in individual neurons. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[21]  K. Svoboda,et al.  Experience-dependent structural synaptic plasticity in the mammalian brain , 2009, Nature Reviews Neuroscience.

[22]  Johannes J. Letzkus,et al.  Learning Rules for Spike Timing-Dependent Plasticity Depend on Dendritic Synapse Location , 2006, The Journal of Neuroscience.

[23]  Daniel D. Lee,et al.  Equilibrium properties of temporally asymmetric Hebbian plasticity. , 2000, Physical review letters.

[24]  C. Koch,et al.  Constraints on cortical and thalamic projections: the no-strong-loops hypothesis , 1998, Nature.

[25]  K. Rockland,et al.  Laminar origins and terminations of cortical connections of the occipital lobe in the rhesus monkey , 1979, Brain Research.

[26]  H. Jörntell,et al.  Presynaptic Calcium Signalling in Cerebellar Mossy Fibres , 2009, Front. Neural Circuits.

[27]  K. Rockland,et al.  Terminal arbors of individual “Feedback” axons projecting from area V2 to V1 in the macaque monkey: A study using immunohistochemistry of anterogradely transported Phaseolus vulgaris‐leucoagglutinin , 1989, The Journal of comparative neurology.

[28]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[29]  P. J. Sjöström,et al.  A Cooperative Switch Determines the Sign of Synaptic Plasticity in Distal Dendrites of Neocortical Pyramidal Neurons , 2006, Neuron.

[30]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[31]  Jean Bennett,et al.  Lateral Connectivity and Contextual Interactions in Macaque Primary Visual Cortex , 2002, Neuron.

[32]  L. Vaina Matters of Intelligence , 1987 .

[33]  Mark C. W. van Rossum,et al.  Stable Hebbian Learning from Spike Timing-Dependent Plasticity , 2000, The Journal of Neuroscience.

[34]  Jesper Tegnér,et al.  Spike-timing-dependent plasticity: common themes and divergent vistas , 2002, Biological Cybernetics.

[35]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[36]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[37]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[38]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[39]  Guillermo A. Cecchi,et al.  A Theory of Loop Formation and Elimination by Spike Timing-Dependent Plasticity , 2009, Front. Neural Circuits.

[40]  David B. Grayden,et al.  Spike-Timing-Dependent Plasticity: The Relationship to Rate-Based Learning for Models with Weight Dynamics Determined by a Stable Fixed Point , 2004, Neural Computation.

[41]  John H. R. Maunsell,et al.  Visual response latencies in striate cortex of the macaque monkey. , 1992, Journal of neurophysiology.

[42]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[43]  Fredric M. Wolf,et al.  Frontiers in Computational Neuroscience Materials and Methods Measures of Correlation , 2022 .

[44]  Florentin Wörgötter,et al.  Temporal Sequence Learning, Prediction, and Control: A Review of Different Models and Their Relation to Biological Mechanisms , 2005, Neural Computation.

[45]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[46]  J. Bullier Integrated model of visual processing , 2001, Brain Research Reviews.

[47]  Edward M. Callaway,et al.  Feedforward, feedback and inhibitory connections in primate visual cortex , 2004, Neural Networks.

[48]  P A Salin,et al.  Corticocortical connections in the visual system: structure and function. , 1995, Physiological reviews.

[49]  Erkki Oja,et al.  Image feature extraction by sparse coding and independent component analysis , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[50]  Rajesh P. N. Rao,et al.  Spike-Timing-Dependent Hebbian Plasticity as Temporal Difference Learning , 2001, Neural Computation.

[51]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[52]  Baktash Babadi,et al.  Intrinsic Stability of Temporally Shifted Spike-Timing Dependent Plasticity , 2010, PLoS Comput. Biol..

[53]  A. Burkhalter Development of forward and feedback connections between areas V1 and V2 of human visual cortex. , 1993, Cerebral cortex.

[54]  D. Debanne,et al.  Long‐term synaptic plasticity between pairs of individual CA3 pyramidal cells in rat hippocampal slice cultures , 1998, The Journal of physiology.