Emergence of spontaneous assembly activity in developing neural networks without afferent input

Spontaneous activity is a fundamental characteristic of the developing nervous system. Intriguingly, it often takes the form of multiple structured assemblies of neurons. Such assemblies can form even in the absence of afferent input, for instance in the zebrafish optic tectum after bilateral enucleation early in life. While the development of neural assemblies based on structured afferent input has been theoretically well-studied, it is less clear how they could arise in systems without afferent input. Here we show that a recurrent network of binary threshold neurons with initially random weights can form neural assemblies based on a simple Hebbian learning rule. Over development the network becomes increasingly modular while being driven by initially unstructured spontaneous activity, leading to the emergence of neural assemblies. Surprisingly, the set of neurons making up each assembly then continues to evolve, despite the number of assemblies remaining roughly constant. In the mature network assembly activity builds over several timesteps before the activation of the full assembly, as recently observed in calcium-imaging experiments. Our results show that Hebbian learning is sufficient to explain the emergence of highly structured patterns of neural activity in the absence of structured input.

[1]  Geoffrey J. Goodhill,et al.  Spontaneous Activity in the Zebrafish Tectum Reorganizes over Development and Is Influenced by Visual Experience , 2017, Current Biology.

[2]  M. Crair,et al.  Retinal waves coordinate patterned activity throughout the developing visual system , 2012, Nature.

[3]  Vítor Lopes-dos-Santos,et al.  Detecting cell assemblies in large neuronal populations , 2013, Journal of Neuroscience Methods.

[4]  Geoffrey J. Goodhill,et al.  Theoretical Models of Neural Development , 2018, iScience.

[5]  R. Yuste,et al.  Visual stimuli recruit intrinsically generated cortical ensembles , 2014, Proceedings of the National Academy of Sciences.

[6]  K. Harris Neural signatures of cell assembly organization , 2005, Nature Reviews Neuroscience.

[7]  John M. Beggs,et al.  Behavioral / Systems / Cognitive Neuronal Avalanches Are Diverse and Precise Activity Patterns That Are Stable for Many Hours in Cortical Slice Cultures , 2004 .

[8]  Kenneth D. Harris,et al.  The Convallis Rule for Unsupervised Learning in Cortical Networks , 2013, PLoS Comput. Biol..

[9]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[10]  Everton J. Agnes,et al.  Diverse synaptic plasticity mechanisms orchestrated to form and retrieve memories in spiking neural networks , 2015, Nature Communications.

[11]  Selmaan N. Chettih,et al.  Dynamic Reorganization of Neuronal Activity Patterns in Parietal Cortex , 2017, Cell.

[12]  T. Hensch Critical period plasticity in local cortical circuits , 2005, Nature Reviews Neuroscience.

[13]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[14]  J. Alexander Heimel,et al.  Peripheral and Central Inputs Shape Network Dynamics in the Developing Visual Cortex In Vivo , 2012, Current Biology.

[15]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[16]  Stefan Rotter,et al.  Emergence of Functional Specificity in Balanced Networks with Synaptic Plasticity , 2015, PLoS Comput. Biol..

[17]  Ethan K. Scott,et al.  Topographic wiring of the retinotectal connection in zebrafish , 2015, Developmental neurobiology.

[18]  S. Royer,et al.  Conservation of total synaptic weight through balanced synaptic depression and potentiation , 2003, Nature.

[19]  Mark C. W. van Rossum,et al.  Memory retention and spike-timing-dependent plasticity. , 2009, Journal of neurophysiology.

[20]  D. Muller,et al.  Heterosynaptic interactions between UP and LTD in CA1 hippocampal slices , 1995, Neuron.

[21]  Markus Diesmann,et al.  Spike-Timing-Dependent Plasticity in Balanced Random Networks , 2007, Neural Computation.

[22]  Edward M. Reingold,et al.  Graph drawing by force‐directed placement , 1991, Softw. Pract. Exp..

[23]  Marc-Thorsten Hütt,et al.  Modular topology emerges from plasticity in a minimalistic excitable network model. , 2017, Chaos.

[24]  A. Litwin-Kumar,et al.  Formation and maintenance of neuronal assemblies through synaptic plasticity , 2014, Nature Communications.

[25]  M. A. Carreira-Perpiñán,et al.  Influence of lateral connections on the structure of cortical maps. , 2004, Journal of neurophysiology.

[26]  Malik Magdon-Ismail,et al.  Measuring Similarity between Sets of Overlapping Clusters , 2010, 2010 IEEE Second International Conference on Social Computing.

[27]  Daniel A. Butts,et al.  The Applicability of Spike Time Dependent Plasticity to Development , 2010, Front. Syn. Neurosci..

[28]  G. Goodhill Contributions of Theoretical Modeling to the Understanding of Neural Map Development , 2007, Neuron.

[29]  Germán Sumbre,et al.  Spontaneous Neuronal Network Dynamics Reveal Circuit’s Functional Adaptations for Behavior , 2015, Neuron.

[30]  C. Clopath,et al.  The emergence of functional microcircuits in visual cortex , 2013, Nature.

[31]  Ethan K. Scott,et al.  Functional Profiles of Visual-, Auditory-, and Water Flow-Responsive Neurons in the Zebrafish Tectum , 2016, Current Biology.

[32]  Richard Hans Robert Hahnloser,et al.  Spike-Time-Dependent Plasticity and Heterosynaptic Competition Organize Networks to Produce Long Scale-Free Sequences of Neural Activity , 2010, Neuron.

[33]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[34]  Lacey J. Kitch,et al.  Long-term dynamics of CA1 hippocampal place codes , 2013, Nature Neuroscience.

[35]  E. Bullmore,et al.  Emergence of Rich-Club Topology and Coordinated Dynamics in Development of Hippocampal Functional Networks In Vitro , 2015, The Journal of Neuroscience.

[36]  Rafael Yuste,et al.  Endogenous Sequential Cortical Activity Evoked by Visual Stimuli , 2015, The Journal of Neuroscience.

[37]  Marc-Thorsten Hütt,et al.  Topological reinforcement as a principle of modularity emergence in brain networks , 2018, bioRxiv.

[38]  N. Swindale The development of topography in the visual cortex: a review of models. , 1996, Network.

[39]  Nicolas Brunel,et al.  Burst-Dependent Bidirectional Plasticity in the Cerebellum Is Driven by Presynaptic NMDA Receptors. , 2016, Cell reports.

[40]  Germán Sumbre,et al.  The Emergence of the Spatial Structure of Tectal Spontaneous Activity Is Independent of Visual Inputs , 2017, Cell reports.

[41]  Brent Doiron,et al.  Training and spontaneous reinforcement of neuronal assemblies by spike timing plasticity , 2016, bioRxiv.

[42]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[43]  Brent Doiron,et al.  Training and spontaneous reinforcement of neuronal assemblies by spike timing plasticity , 2016 .

[44]  Thomas Miconi,et al.  Spontaneous emergence of fast attractor dynamics in a model of developing primary visual cortex , 2016, Nature Communications.

[45]  T. Sejnowski,et al.  Storing covariance with nonlinearly interacting neurons , 1977, Journal of mathematical biology.

[46]  M E J Newman,et al.  Modularity and community structure in networks. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[47]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[48]  Stefan R. Pulver,et al.  Ultra-sensitive fluorescent proteins for imaging neuronal activity , 2013, Nature.

[49]  Christos Dimitrakakis,et al.  Network Self-Organization Explains the Statistics and Dynamics of Synaptic Connection Strengths in Cortex , 2013, PLoS Comput. Biol..

[50]  Michel A. Picardo,et al.  GABAergic Hub Neurons Orchestrate Synchrony in Developing Hippocampal Networks , 2009, Science.

[51]  Thilo Gross,et al.  Adaptive self-organization in a realistic neural network model. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  C. Shatz,et al.  A Burst-Based “Hebbian” Learning Rule at Retinogeniculate Synapses Links Retinal Waves to Activity-Dependent Refinement , 2007, PLoS biology.

[53]  Mauricio Barahona,et al.  Emergence of Slow-Switching Assemblies in Structured Neuronal Networks , 2015, PLoS Comput. Biol..

[54]  Paul Miller,et al.  Itinerancy between attractor states in neural systems , 2016, Current Opinion in Neurobiology.

[55]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[56]  Xiao Zhang,et al.  Spectra of random graphs with community structure and arbitrary degrees , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[57]  Jochen Triesch,et al.  Where’s the Noise? Key Features of Spontaneous Activity and Neural Variability Arise through Learning in a Deterministic Network , 2015, PLoS Comput. Biol..

[58]  Dario L Ringach,et al.  Spontaneous and driven cortical activity: implications for computation , 2009, Current Opinion in Neurobiology.

[59]  Jochen Triesch,et al.  Plasticity-Driven Self-Organization under Topological Constraints Accounts for Non-random Features of Cortical Synaptic Wiring , 2015, bioRxiv.

[60]  Cees van Leeuwen,et al.  Robust emergence of small-world structure in networks of spiking neurons , 2007, Cognitive Neurodynamics.