Adaptation of short-term plasticity parameters via error-driven learning may explain the correlation between activity-dependent synaptic properties, connectivity motifs and target specificity

The anatomical connectivity among neurons has been experimentally found to be largely non-random across brain areas. This means that certain connectivity motifs occur at a higher frequency than would be expected by chance. Of particular interest, short-term synaptic plasticity properties were found to colocalize with specific motifs: an over-expression of bidirectional motifs has been found in neuronal pairs where short-term facilitation dominates synaptic transmission among the neurons, whereas an over-expression of unidirectional motifs has been observed in neuronal pairs where short-term depression dominates. In previous work we found that, given a network with fixed short-term properties, the interaction between short- and long-term plasticity of synaptic transmission is sufficient for the emergence of specific motifs. Here, we introduce an error-driven learning mechanism for short-term plasticity that may explain how such observed correspondences develop from randomly initialized dynamic synapses. By allowing synapses to change their properties, neurons are able to adapt their own activity depending on an error signal. This results in more rich dynamics and also, provided that the learning mechanism is target-specific, leads to specialized groups of synapses projecting onto functionally different targets, qualitatively replicating the experimental results of Wang and collaborators.

[1]  Fiona E. N. LeBeau,et al.  Microcircuits in action – from CPGs to neocortex , 2005, Trends in Neurosciences.

[2]  Camin Dean,et al.  Neuroligins and neurexins: linking cell adhesion, synapse formation and cognitive function , 2006, Trends in Neurosciences.

[3]  Henry Markram,et al.  Synaptic pathways in neural microcircuits , 2005, Trends in Neurosciences.

[4]  J. Shappir,et al.  In-cell recordings by extracellular microelectrodes , 2010, Nature Methods.

[5]  H. Markram,et al.  Spontaneous and evoked synaptic rewiring in the neonatal neocortex , 2006, Proceedings of the National Academy of Sciences.

[6]  Fritjof Helmchen,et al.  Chronic imaging of cortical sensory map dynamics using a genetically encoded calcium indicator , 2012, The Journal of physiology.

[7]  P. Dayan,et al.  Synapses with short-term plasticity are optimal estimators of presynaptic membrane potentials , 2010, Nature Neuroscience.

[8]  Franklin A. Graybill,et al.  Introduction to The theory , 1974 .

[9]  E. Miller,et al.  A Neural Circuit Model of Flexible Sensorimotor Mapping: Learning and Forgetting on Multiple Timescales , 2007, Neuron.

[10]  Michele Giugliano,et al.  Measuring Symmetry, Asymmetry and Randomness in Neural Network Connectivity , 2014, PloS one.

[11]  K. Deisseroth,et al.  Circuit-breakers: optical technologies for probing neural signals and systems , 2007, Nature Reviews Neuroscience.

[12]  C. Stevens,et al.  Excitatory and Feed-Forward Inhibitory Hippocampal Synapses Work Synergistically as an Adaptive Filter of Natural Spike Trains , 2006, PLoS biology.

[13]  Kate Cummings,et al.  Introduction to the Theory , 2015 .

[14]  Panayiota Poirazi,et al.  Computational modeling of the effects of amyloid-beta on release probability at hippocampal synapses , 2013, Front. Comput. Neurosci..

[15]  Henry Markram,et al.  Coding of temporal information by activity-dependent synapses. , 2002, Journal of neurophysiology.

[16]  Thomas K. Berger,et al.  Heterogeneity in the pyramidal network of the medial prefrontal cortex , 2006, Nature Neuroscience.

[17]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[18]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[19]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[20]  Arne V. Blackman,et al.  Target-Specific Expression of Presynaptic NMDA Receptors in Neocortical Microcircuits , 2012, Neuron.

[21]  H. Markram,et al.  Redistribution of synaptic efficacy between neocortical pyramidal neurons , 1996, Nature.

[22]  H. Markram,et al.  Potential for multiple mechanisms, phenomena and algorithms for synaptic plasticity at single synapses , 1998, Neuropharmacology.

[23]  D. Buonomano,et al.  Cortical plasticity: from synapses to maps. , 1998, Annual review of neuroscience.

[24]  Douglas L. Rosene,et al.  The Geometric Structure of the Brain Fiber Pathways , 2012, Science.

[25]  X. Wang,et al.  Differential short-term synaptic plasticity and transmission of complex spike trains: to depress or to facilitate? , 2000, Cerebral cortex.

[26]  Bartlett W. Mel,et al.  Cortical rewiring and information storage , 2004, Nature.

[27]  P. J. Sjöström,et al.  Multiple forms of long-term plasticity at unitary neocortical layer 5 synapses , 2007, Neuropharmacology.

[28]  E. Izhikevich Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[29]  Misha Tsodyks,et al.  Persistent Activity in Neural Networks with Dynamic Synapses , 2007, PLoS Comput. Biol..

[30]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[31]  J. Livet,et al.  A technicolour approach to the connectome , 2008, Nature Reviews Neuroscience.

[32]  P. Somogyi,et al.  Target-cell-specific facilitation and depression in neocortical circuits , 1998, Nature Neuroscience.

[33]  Wulfram Gerstner,et al.  A History of Spike-Timing-Dependent Plasticity , 2011, Front. Syn. Neurosci..

[34]  Maria Blatow,et al.  Ca2+ Buffer Saturation Underlies Paired Pulse Facilitation in Calbindin-D28k-Containing Terminals , 2003, Neuron.

[35]  A. Thomson Facilitation, augmentation and potentiation at central synapses , 2000, Trends in Neurosciences.

[36]  L. Abbott,et al.  A Quantitative Description of Short-Term Plasticity at Excitatory Synapses in Layer 2/3 of Rat Primary Visual Cortex , 1997, The Journal of Neuroscience.

[37]  Ian R. Wickersham,et al.  Monosynaptic Restriction of Transsynaptic Tracing from Single, Genetically Targeted Neurons , 2007, Neuron.

[38]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[39]  Karl J. Friston Functional and Effective Connectivity: A Review , 2011, Brain Connect..

[40]  H. Markram,et al.  Disynaptic Inhibition between Neocortical Pyramidal Cells Mediated by Martinotti Cells , 2007, Neuron.

[41]  Henry Markram,et al.  Synapses as dynamic memory buffers , 2002, Neural Networks.

[42]  Lars Buesing,et al.  Democratic Population Decisions Result in Robust Policy-Gradient Learning: A Parametric Study with GPU Simulations , 2011, PloS one.

[43]  R. Douglas,et al.  Mapping the Matrix: The Ways of Neocortex , 2007, Neuron.

[44]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[45]  R. Douglas,et al.  Recurrent neuronal circuits in the neocortex , 2007, Current Biology.

[46]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[47]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[48]  P. J. Sjöström,et al.  Neocortical LTD via Coincident Activation of Presynaptic NMDA and Cannabinoid Receptors , 2003, Neuron.

[49]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[50]  Kira E. Poskanzer,et al.  Temporally distinct demands for classic cadherins in synapse formation and maturation , 2004, Molecular and Cellular Neuroscience.

[51]  D. Buonomano,et al.  A Novel Learning Rule for Long-Term Plasticity of Short-Term Synaptic Plasticity Enhances Temporal Processing , 2011, Front. Integr. Neurosci..

[52]  C. D. de Kock,et al.  Hyperconnectivity and slow synapses during early development of medial prefrontal cortex in a mouse model for mental retardation and autism. , 2012, Cerebral cortex.

[53]  Ziv Rotman,et al.  Role of synaptic dynamics and heterogeneity in neuronal learning of temporal code. , 2013, Journal of neurophysiology.

[54]  W. Maass,et al.  Efficient temporal processing with biologically realistic dynamic synapses , 2001, Network.

[55]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[56]  Robert A. Legenstein,et al.  A Learning Theory for Reward-Modulated Spike-Timing-Dependent Plasticity with Application to Biofeedback , 2008, PLoS Comput. Biol..

[57]  Arne V. Blackman,et al.  Target-cell-specific short-term plasticity in local circuits , 2013, Front. Synaptic Neurosci..

[58]  Louis K. Scheffer,et al.  Semi-automated reconstruction of neural circuits using electron microscopy , 2010, Current Opinion in Neurobiology.

[59]  Michele Giugliano,et al.  Emergence of Connectivity Motifs in Networks of Model Neurons with Short- and Long-Term Plastic Synapses , 2013, PloS one.

[60]  Michele Giugliano,et al.  Emergence of Connectivity Patterns from Long-Term and Short-Term Plasticities , 2012, ICANN.

[61]  W. Schultz,et al.  Discrete Coding of Reward Probability and Uncertainty by Dopamine Neurons , 2003, Science.

[62]  W. Schultz,et al.  Adaptive Coding of Reward Value by Dopamine Neurons , 2005, Science.

[63]  Thomas C. Südhof,et al.  RIM Proteins Activate Vesicle Priming by Reversing Autoinhibitory Homodimerization of Munc13 , 2011, Neuron.

[64]  H. Markram,et al.  Hyper-Connectivity and Hyper-Plasticity in the Medial Prefrontal Cortex in the Valproic Acid Animal Model of Autism , 2008, Frontiers in neural circuits.

[65]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[66]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[67]  R. H. White,et al.  Competitive Hebbian learning , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[68]  W. Denk,et al.  Serial Block-Face Scanning Electron Microscopy to Reconstruct Three-Dimensional Tissue Nanostructure , 2004, PLoS biology.

[69]  Mark C. W. van Rossum,et al.  Probabilistic inference of short-term synaptic plasticity in neocortical microcircuits , 2013, Front. Comput. Neurosci..

[70]  Michele Pignatelli Structure and function of the olfactory bulb microcircuit , 2009 .

[71]  Xiao-Jing Wang,et al.  Learning flexible sensori-motor mappings in a complex network , 2009, Biological Cybernetics.

[72]  Wulfram Gerstner,et al.  Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail , 2009, PLoS Comput. Biol..

[73]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[74]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[75]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[76]  K Richard Ridderinkhof,et al.  Adaptive Coding , 2005, Science.

[77]  W. Senn,et al.  Reinforcement learning in populations of spiking neurons , 2008, Nature Neuroscience.

[78]  R. Douglas,et al.  A Quantitative Map of the Circuit of Cat Primary Visual Cortex , 2004, The Journal of Neuroscience.

[79]  H. Markram,et al.  The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[80]  H. Sebastian Seung,et al.  Reading the Book of Memory: Sparse Sampling versus Dense Mapping of Connectomes , 2009, Neuron.

[81]  Matthias H. Hennig,et al.  Theoretical models of synaptic short term plasticity , 2013, Front. Comput. Neurosci..