Autonomous emergence of connectivity assemblies via spike triplet interactions

Non-random connectivity can emerge without structured external input driven by activity-dependent mechanisms of synaptic plasticity based on precise spiking patterns. Here we analyze the emergence of global structures in recurrent networks based on a triplet model of spike timing dependent plasticity (STDP), which depends on the interactions of three precisely-timed spikes, and can describe plasticity experiments with varying spike frequency better than the classical pair-based STDP rule. We derive synaptic changes arising from correlations up to third-order and describe them as the sum of structural motifs, which determine how any spike in the network influences a given synaptic connection through possible connectivity paths. This motif expansion framework reveals novel structural motifs under the triplet STDP rule, which support the formation of bidirectional connections and ultimately the spontaneous emergence of global network structure in the form of self-connected groups of neurons, or assemblies. We propose that under triplet STDP assembly structure can emerge without the need for externally patterned inputs or assuming a symmetric pair-based STDP rule common in previous studies. The emergence of non-random network structure under triplet STDP occurs through internally-generated higher-order correlations, which are ubiquitous in natural stimuli and neuronal spiking activity, and important for coding. We further demonstrate how neuromodulatory mechanisms that modulate the shape of the triplet STDP rule or the synaptic transmission function differentially promote structural motifs underlying the emergence of assemblies, and quantify the differences using graph theoretic measures.

[1]  Julijana Gjorgjieva,et al.  Homeostatic Activity-Dependent Tuning of Recurrent Networks for Robust Propagation of Activity , 2015, The Journal of Neuroscience.

[2]  W. Gerstner,et al.  Connectivity reflects coding: a model of voltage-based STDP with homeostasis , 2010, Nature Neuroscience.

[3]  Eric Shea-Brown,et al.  Triplet correlations among similarly tuned cells impact population coding , 2015, Front. Comput. Neurosci..

[4]  David W. Nauen,et al.  Coactivation and timing-dependent integration of synaptic potentiation and depression , 2005, Nature Neuroscience.

[5]  J. Lichtman,et al.  From Cajal to Connectome and Beyond. , 2016, Annual review of neuroscience.

[6]  Germán Sumbre,et al.  Principles of Functional Circuit Connectivity: Insights From Spontaneous Activity in the Zebrafish Optic Tectum , 2018, Front. Neural Circuits.

[7]  M. Bethge,et al.  Common input explains higher-order correlations and entropy in a simple model of neural population activity. , 2011, Physical review letters.

[8]  C. Clopath,et al.  The emergence of functional microcircuits in visual cortex , 2013, Nature.

[9]  Jonathan D. Victor,et al.  Information-geometric measure of 3-neuron firing patterns characterizes scale-dependence in cortical networks , 2011, Journal of Computational Neuroscience.

[10]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[11]  Eric Shea-Brown,et al.  When do microcircuits produce beyond-pairwise correlations? , 2014, Front. Comput. Neurosci..

[12]  M. Crair,et al.  Retinal waves coordinate patterned activity throughout the developing visual system , 2012, Nature.

[13]  Everton J. Agnes,et al.  Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks , 2015, Nature Communications.

[14]  V Latora,et al.  Efficient behavior of small-world networks. , 2001, Physical review letters.

[15]  Yoram Burak,et al.  Shaping Neural Circuits by High Order Synaptic Interactions , 2016, PLoS Comput. Biol..

[16]  E. Marder,et al.  Computational implications of biophysical diversity and multiple timescales in neurons and synapses for circuit performance , 2016, Current Opinion in Neurobiology.

[17]  Fernando Montani,et al.  Common inputs in subthreshold membrane potential: The role of quiescent states in neuronal activity. , 2018, Physical review. E.

[18]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[19]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[20]  Christoph Miehl,et al.  Heterosynaptic Plasticity Determines the Set Point for Cortical Excitatory-Inhibitory Balance , 2020, Neuron.

[21]  Alexandre Mendes,et al.  Modulation of Spike-Timing Dependent Plasticity: Towards the Inclusion of a Third Factor in Computational Models , 2018, Front. Comput. Neurosci..

[22]  R. Yuste,et al.  Imprinting and recalling cortical ensembles , 2016, Science.

[23]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[24]  D. Feldman,et al.  Timing-Based LTP and LTD at Vertical Inputs to Layer II/III Pyramidal Cells in Rat Barrel Cortex , 2000, Neuron.

[25]  Nathalie L Rochefort,et al.  Sparsification of neuronal activity in the visual cortex at eye-opening , 2009, Proceedings of the National Academy of Sciences.

[26]  A. Litwin-Kumar,et al.  Formation and maintenance of neuronal assemblies through synaptic plasticity , 2014, Nature Communications.

[27]  J. Pfister,et al.  A triplet spike-timing–dependent plasticity model generalizes the Bienenstock–Cooper–Munro rule to higher-order spatiotemporal correlations , 2011, Proceedings of the National Academy of Sciences.

[28]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[29]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[30]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[31]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[32]  C. Clopath,et al.  The Role of Neuromodulators in Cortical Plasticity. A Computational Perspective , 2017, Front. Synaptic Neurosci..

[33]  T. Bliss,et al.  Synaptic plasticity, memory and the hippocampus: a neural network approach to causality , 2012, Nature Reviews Neuroscience.

[34]  Jonathan E. Rubin,et al.  The Interaction of Intrinsic Dynamics and Network Topology in Determining Network Burst Synchrony , 2011, Front. Comput. Neurosci..

[35]  Bruno Cessac,et al.  On Dynamics of Integrate-and-Fire Neural Networks with Conductance Based Synapses , 2007, Frontiers Comput. Neurosci..

[36]  Baktash Babadi,et al.  Pairwise Analysis Can Account for Network Structures Arising from Spike-Timing Dependent Plasticity , 2013, PLoS Comput. Biol..

[37]  Nathan Intrator,et al.  Receptive Field Formation in Natural Scene Environments: Comparison of Single-Cell Learning Rules , 1997, Neural Computation.

[38]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.

[39]  M. Feller,et al.  Mechanisms underlying spontaneous patterned activity in developing neural circuits , 2010, Nature Reviews Neuroscience.

[40]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[41]  A. Lansner Associative memory models: from the cell-assembly theory to biophysically detailed cortex simulations , 2009, Trends in Neurosciences.

[42]  Moritz Helmstaedter,et al.  Connectomics at the cutting edge: Challenges and opportunities in high-resolution brain mapping , 2014 .

[43]  Nathan Intrator,et al.  Objective function formulation of the BCM theory of visual cortical plasticity: Statistical connections, stability conditions , 1992, Neural Networks.

[44]  Stefan Rotter,et al.  Cumulants of Hawkes point processes. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  W. Gerstner,et al.  Triplets of Spikes in a Model of Spike Timing-Dependent Plasticity , 2006, The Journal of Neuroscience.

[46]  Stefan Rotter,et al.  Interplay between Graph Topology and Correlations of Third Order in Spiking Neuronal Networks , 2016, PLoS Comput. Biol..

[47]  C. Shatz,et al.  A Burst-Based “Hebbian” Learning Rule at Retinogeniculate Synapses Links Retinal Waves to Activity-Dependent Refinement , 2007, PLoS biology.

[48]  Eric Shea-Brown,et al.  Input nonlinearities can shape beyond-pairwise correlations and improve information transmission by neural populations. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[49]  Christian Lohmann,et al.  Spontaneous Activity Drives Local Synaptic Plasticity In Vivo , 2015, Neuron.

[50]  Brody Sandel,et al.  Human impacts drive a global topographic signature in tree cover , 2013, Nature Communications.

[51]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[52]  Julijana Gjorgjieva,et al.  Understanding neural circuit development through theory and models , 2017, Current Opinion in Neurobiology.

[53]  Y. Dan,et al.  Spike-timing-dependent synaptic plasticity depends on dendritic location , 2005, Nature.

[54]  Wolf Singer,et al.  Chapter 37 Neuronal representations, assemblies and temporal coherence , 1993 .

[55]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[56]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[57]  Moritz Helias,et al.  Correlations in spiking neuronal networks with distance dependent connections , 2009, Journal of Computational Neuroscience.

[58]  Eric Shea-Brown,et al.  Local paths to global coherence: cutting networks down to size. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[59]  Wulfram Gerstner,et al.  A History of Spike-Timing-Dependent Plasticity , 2011, Front. Syn. Neurosci..

[60]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[61]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[62]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks III: Partially connected neurons driven by spontaneous activity , 2009, Biological Cybernetics.

[63]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[64]  Yotam Luz,et al.  Balancing Feed-Forward Excitation and Inhibition via Hebbian Inhibitory Synaptic Plasticity , 2012, PLoS Comput. Biol..

[65]  Tomoki Fukai,et al.  Interplay between Short- and Long-Term Plasticity in Cell-Assembly Formation , 2014, PloS one.

[66]  Brent Doiron,et al.  Training and Spontaneous Reinforcement of Neuronal Assemblies by Spike Timing Plasticity , 2019, Cerebral cortex.

[67]  Germán Mato,et al.  Asynchronous States and the Emergence of Synchrony in Large Networks of Interacting Excitatory and Inhibitory Neurons , 2003, Neural Computation.

[68]  Jason N. MacLean,et al.  Functional triplet motifs underlie accurate predictions of single-trial responses in populations of tuned and untuned V1 neurons , 2017, bioRxiv.

[69]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[70]  R. Yuste,et al.  Visual stimuli recruit intrinsically generated cortical ensembles , 2014, Proceedings of the National Academy of Sciences.

[71]  K. Harris Neural signatures of cell assembly organization , 2005, Nature Reviews Neuroscience.

[72]  Germán Sumbre,et al.  Spontaneous Neuronal Network Dynamics Reveal Circuit’s Functional Adaptations for Behavior , 2015, Neuron.

[73]  J. Leo van Hemmen,et al.  Modeling Synaptic Plasticity in Conjunction with the Timing of Pre- and Postsynaptic Action Potentials , 2000, Neural Computation.

[74]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks IV , 2009, Biological Cybernetics.

[75]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[76]  Matthieu Gilson,et al.  Spike-timing-dependent plasticity for neurons with recurrent connections , 2007, Biological Cybernetics.

[77]  Moritz Helias,et al.  The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics , 2013, PLoS Comput. Biol..

[78]  Herwig Baier,et al.  Direction selectivity in the visual system of the zebrafish larva , 2013, Front. Neural Circuits.

[79]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. II. Input selectivity—symmetry breaking , 2009, Biological Cybernetics.

[80]  Raj Rao Nadakuditi,et al.  Spectra of random graphs with arbitrary expected degrees , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[81]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[82]  Alex Roxin,et al.  The Role of Degree Distribution in Shaping the Dynamics in Networks of Sparsely Connected Spiking Neurons , 2011, Front. Comput. Neurosci..

[83]  Pieter R. Roelfsema,et al.  The Effects of Pair-wise and Higher-order Correlations on the Firing Rate of a Postsynaptic Neuron , 1998, Neural Computation.

[84]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[85]  W Singer,et al.  Neuronal representations, assemblies and temporal coherence. , 1993, Progress in brain research.

[86]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[87]  Brett J. Graham,et al.  Anatomy and function of an excitatory network in the visual cortex , 2016, Nature.

[88]  Danielle S. Bassett,et al.  Stability of spontaneous, correlated activity in mouse auditory cortex , 2018, bioRxiv.

[89]  E A Leicht,et al.  Community structure in directed networks. , 2007, Physical review letters.

[90]  Nicholas D Schiff,et al.  Central Lateral Thalamic Nucleus Stimulation Awakens Cortex via Modulation of Cross-Regional, Laminar-Specific Activity during General Anesthesia , 2020, Neuron.

[91]  R. Kempter,et al.  Hebbian learning and spiking neurons , 1999 .

[92]  D. R. Muir,et al.  Functional organization of excitatory synaptic strength in primary visual cortex , 2015, Nature.

[93]  A. Kirkwood,et al.  Neuromodulators Control the Polarity of Spike-Timing-Dependent Synaptic Plasticity , 2007, Neuron.

[94]  Lilach Avitan,et al.  Emergence of spontaneous assembly activity in developing neural networks without afferent input , 2018, PLoS Comput. Biol..

[95]  G. Fagiolo Clustering in complex directed networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[96]  Jochen Triesch,et al.  Plasticity-Driven Self-Organization under Topological Constraints Accounts for Non-random Features of Cortical Synaptic Wiring , 2015, bioRxiv.

[97]  Stefano Panzeri,et al.  The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[98]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[99]  Fernando Montani,et al.  Quantifying higher-order correlations in a neuronal pool , 2015 .

[100]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[101]  J. Tiago Gonçalves,et al.  Internally Mediated Developmental Desynchronization of Neocortical Network Activity , 2009, The Journal of Neuroscience.

[102]  Eric Shea-Brown,et al.  From the statistics of connectivity to the statistics of spike times in neuronal networks , 2017, Current Opinion in Neurobiology.

[103]  Stefan Rotter,et al.  The relevance of network micro-structure for neural dynamics , 2013, Front. Comput. Neurosci..

[104]  Johannes J. Letzkus,et al.  Cortical feed-forward networks for binding different streams of sensory information , 2006, Nature Neuroscience.

[105]  W. Singer,et al.  Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. , 1992, Science.

[106]  Haim Sompolinsky,et al.  Balanced excitation and inhibition are required for high-capacity, noise-robust neuronal selectivity , 2017, Proceedings of the National Academy of Sciences.

[107]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[108]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[109]  Pascal Wallisch,et al.  Natural Firing Patterns Imply Low Sensitivity of Synaptic Plasticity to Spike Timing Compared with Firing Rate , 2016, The Journal of Neuroscience.

[110]  J. Reichardt,et al.  Statistical mechanics of community detection. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[111]  W. Gerstner,et al.  Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules , 2016, Front. Neural Circuits.

[112]  Michele Giugliano,et al.  Emergence of Connectivity Motifs in Networks of Model Neurons with Short- and Long-Term Plastic Synapses , 2013, PloS one.

[113]  Jason N MacLean,et al.  Circuit reactivation dynamically regulates synaptic plasticity in neocortex , 2013, Nature Communications.

[114]  Geoffrey J. Goodhill,et al.  Spontaneous Activity in the Zebrafish Tectum Reorganizes over Development and Is Influenced by Visual Experience , 2017, Current Biology.

[115]  G. Laurent,et al.  Conditional modulation of spike-timing-dependent plasticity for olfactory learning , 2012, Nature.

[116]  Germán Sumbre,et al.  The Emergence of the Spatial Structure of Tectal Spontaneous Activity Is Independent of Visual Inputs , 2017, Cell reports.

[117]  P. J. Sjöström,et al.  Correction: Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS Biology.

[118]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways , 2009, Biological Cybernetics.

[119]  A. Holtmaat,et al.  Functional and structural underpinnings of neuronal assembly formation in learning , 2016, Nature Neuroscience.

[120]  Danielle M. Santarelli The developing brain. , 1969, Nature.

[121]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[122]  Thomas Miconi,et al.  Spontaneous emergence of fast attractor dynamics in a model of developing primary visual cortex , 2016, Nature Communications.

[123]  Shan Yu,et al.  Higher-Order Interactions Characterized in Cortical Activity , 2011, The Journal of Neuroscience.

[124]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[125]  Y. Humeau,et al.  Dopamine gates LTP induction in lateral amygdala by suppressing feedforward inhibition , 2003, Nature Neuroscience.

[126]  A. Hawkes Spectra of some self-exciting and mutually exciting point processes , 1971 .

[127]  Eric Shea-Brown,et al.  Motif statistics and spike correlations in neuronal networks , 2012, BMC Neuroscience.

[128]  Brent Doiron,et al.  Self-Organization of Microcircuits in Networks of Spiking Neurons with Plastic Synapses , 2015, PLoS Comput. Biol..

[129]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[130]  Theoden I. Netoff,et al.  Synchronization from Second Order Network Connectivity Statistics , 2011, Front. Comput. Neurosci..

[131]  E. Callaway,et al.  Excitatory cortical neurons form fine-scale functional networks , 2005, Nature.