Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks

Synaptic plasticity, the putative basis of learning and memory formation, manifests in various forms and across different timescales. Here we show that the interaction of Hebbian homosynaptic plasticity with rapid non-Hebbian heterosynaptic plasticity is, when complemented with slower homeostatic changes and consolidation, sufficient for assembly formation and memory recall in a spiking recurrent network model of excitatory and inhibitory neurons. In the model, assemblies were formed during repeated sensory stimulation and characterized by strong recurrent excitatory connections. Even days after formation, and despite ongoing network activity and synaptic plasticity, memories could be recalled through selective delay activity following the brief stimulation of a subset of assembly neurons. Blocking any component of plasticity prevented stable functioning as a memory network. Our modelling results suggest that the diversity of plasticity phenomena in the brain is orchestrated towards achieving common functional goals.

[1]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[2]  John H. Holland,et al.  Tests on a cell assembly theory of the action of the brain, using a large digital computer , 1956, IRE Trans. Inf. Theory.

[3]  T. Crow.  Cortical Synapses and Reinforcement: a Hypothesis , 1968, Nature.

[4]  T. Bliss,et al.  Long‐lasting potentiation of synaptic transmission in the dentate area of the anaesthetized rabbit following stimulation of the perforant path , 1973, The Journal of physiology.

[5]  G. Lynch,et al.  Heterosynaptic depression: a postsynaptic correlate of long-term potentiation , 1977, Nature.

[6]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[7]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  J M Fuster,et al.  Neuronal firing in the inferotemporal cortex of the monkey in a visual memory task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  F. Crick.  Neurobiology: Memory and molecular turnover , 1984, Nature.

[10]  J. Lisman.  A mechanism for memory storage insensitive to molecular turnover: a bistable autophosphorylating kinase. , 1985, Proceedings of the National Academy of Sciences of the United States of America.

[11]  W. Singer,et al.  Different voltage-dependent thresholds for inducing long-term depression and long-term potentiation in slices of rat visual cortex , 1990, Nature.

[12]  Wulfram Gerstner,et al.  Associative memory in a network of ‘spiking’ neurons , 1992 .

[13]  A. Treves.  Mean-field analysis of neuronal spike dynamics , 1993 .

[14]  P. Goldman-Rakic.  Cellular basis of working memory , 1995, Neuron.

[15]  M. Bear,et al.  Metaplasticity: the plasticity of synaptic plasticity , 1996, Trends in Neurosciences.

[16]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[17]  L. Abbott,et al.  Synaptic Depression and Cortical Gain Control , 1997, Science.

[18]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[19]  U. Frey,et al.  Synaptic tagging and long-term potentiation , 1997, Nature.

[20]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[21]  Bard Ermentrout,et al.  Linearization of F-I Curves by Adaptation , 1998, Neural Computation.

[22]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[23]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[24]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[25]  L. Abbott,et al.  Synaptic plasticity: taming the beast , 2000, Nature Neuroscience.

[26]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[27]  S. Nelson,et al.  Hebb and homeostasis in neuronal plasticity , 2000, Current Opinion in Neurobiology.

[28]  Henry Markram,et al.  An Algorithm for Modifying Neurotransmitter Release Probability Based on Pre- and Postsynaptic Spike Timing , 2001, Neural Computation.

[29]  Wulfram Gerstner,et al.  Intrinsic Stabilization of Output Rates by Spike-Based Hebbian Learning , 2001, Neural Computation.

[30]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[31]  K. Svoboda,et al.  Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex , 2002, Nature.

[32]  L. Cooper,et al.  A unified model of NMDA receptor-dependent bidirectional synaptic plasticity , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[33]  D. Chklovskii,et al.  Geometry and Structural Plasticity of Synaptic Connectivity , 2002, Neuron.

[34]  Stefano Fusi,et al.  Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates , 2002, Biological Cybernetics.

[35]  M. Poo,et al.  Reversal and Stabilization of Synaptic Modifications in a Developing Visual System , 2003, Science.

[36]  M. Poo,et al.  Coincident Pre- and Postsynaptic Activity Modifies GABAergic Synapses by Postsynaptic Changes in Cl− Transporter Activity , 2003, Neuron.

[37]  Alex M. Andrew,et al.  Spiking Neuron Models: Single Neurons, Populations, Plasticity , 2003 .

[38]  S. Sajikumar,et al.  Resetting of ‘synaptic tags’ is time- and activity-dependent in rat hippocampal CA1in vitro , 2004, Neuroscience.

[39]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[40]  L. Abbott,et al.  Cascade Models of Synaptically Stored Memories , 2005, Neuron.

[41]  Sandro Romani,et al.  Learning in realistic networks of spiking neurons and spike‐driven plastic synapses , 2005, The European journal of neuroscience.

[42]  L. Abbott,et al.  Neural network dynamics. , 2005, Annual review of neuroscience.

[43]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[44]  E. Izhikevich.  Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[45]  G. Turrigiano,et al.  Rapid Synaptic Scaling Induced by Changes in Postsynaptic Firing , 2008, Neuron.

[46]  I. Fried,et al.  Internally Generated Reactivation of Single Neurons in Human Hippocampus During Free Recall , 2008, Science.

[47]  Wulfram Gerstner,et al.  Tag-Trigger-Consolidation: A Model of Early and Late Long-Term-Potentiation and Depression , 2008, PLoS Comput. Biol..

[48]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[49]  Rainer W. Friedrich,et al.  Olfactory pattern classification by discrete neuronal network states , 2010, Nature.

[50]  J. Wickens,et al.  Timing is not Everything: Neuromodulation Opens the STDP Gate , 2010, Front. Syn. Neurosci..

[51]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[52]  André Longtin,et al.  Linear versus nonlinear signal transmission in neuron models with adaptation currents or dynamic thresholds. , 2010, Journal of neurophysiology.

[53]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[54]  Wulfram Gerstner,et al.  A History of Spike-Timing-Dependent Plasticity , 2011, Front. Syn. Neurosci..

[55]  S. Rumpel,et al.  Discrete Neocortical Dynamics Predict Behavioral Categorization of Sounds , 2012, Neuron.

[56]  Gianluigi Mongillo,et al.  Bistability and spatiotemporal irregularity in neuronal networks with nonlinear synaptic transmission. , 2012, Physical review letters.

[57]  G. Turrigiano.  Homeostatic synaptic plasticity: local and global mechanisms for stabilizing neuronal function. , 2012, Cold Spring Harbor perspectives in biology.

[58]  David Hansel,et al.  Short-Term Plasticity Explains Irregular Persistent Activity in Working Memory Tasks , 2013, The Journal of Neuroscience.

[59]  Henning Sprekeler,et al.  Inhibitory synaptic plasticity: spike timing-dependence and putative network function , 2013, Front. Neural Circuits.

[60]  Christopher M. Lee,et al.  Heterosynaptic Plasticity Prevents Runaway Synaptic Dynamics , 2013, The Journal of Neuroscience.

[61]  W. Gerstner,et al.  Temporal whitening by power-law adaptation in neocortical neurons , 2013, Nature Neuroscience.

[62]  Wulfram Gerstner,et al.  Synaptic Plasticity in Neural Networks Needs Homeostasis with a Fast Rate Detector , 2013, PLoS Comput. Biol..

[63]  C. Clopath,et al.  The emergence of functional microcircuits in visual cortex , 2013, Nature.

[64]  Wulfram Gerstner,et al.  Limits to high-speed simulations of spiking neural networks using general-purpose computers , 2014, Front. Neuroinform..

[65]  A. Litwin-Kumar,et al.  Formation and maintenance of neuronal assemblies through synaptic plasticity , 2014, Nature Communications.