Balanced Active Core in Heterogeneous Neuronal Networks

It is hypothesized that cortical neuronal circuits operate in a global balanced state, i.e., the majority of neurons fire irregularly by receiving balanced inputs of excitation and inhibition. Meanwhile, it has been observed in experiments that sensory information is often sparsely encoded by only a small set of firing neurons, while neurons in the rest of the network are silent. The phenomenon of sparse coding challenges the hypothesis of a global balanced state in the brain. To reconcile this, here we address the issue of whether a balanced state can exist in a small number of firing neurons by taking account of the heterogeneity of network structure such as scale-free and small-world networks. We propose necessary conditions and show that, under these conditions, for sparsely but strongly connected heterogeneous networks with various types of single-neuron dynamics, despite the fact that the whole network receives external inputs, there is a small active subnetwork (active core) inherently embedded within it. The neurons in this active core have relatively high firing rates while the neurons in the rest of the network are quiescent. Surprisingly, although the whole network is heterogeneous and unbalanced, the active core possesses a balanced state and its connectivity structure is close to a homogeneous Erdös-Rényi network. The dynamics of the active core can be well-predicted using the Fokker-Planck equation. Our results suggest that the balanced state may be maintained by a small group of spiking neurons embedded in a large heterogeneous network in the brain. The existence of the small active core reconciles the balanced state and the sparse coding, and also provides a potential dynamical scenario underlying sparse coding in neuronal networks.

[1]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[2]  M. Newman,et al.  Mixing patterns in networks. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[4]  F. Wolf,et al.  Dynamic Flux Tubes Form Reservoirs of Stability in Neuronal Circuits , 2012 .

[5]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[6]  D. Hansel,et al.  On the Distribution of Firing Rates in Networks of Cortical Neurons , 2011, The Journal of Neuroscience.

[7]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[8]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[9]  Yi Sun,et al.  Spectrum of Lyapunov exponents of non-smooth dynamical systems of integrate-and-fire type , 2010, Journal of Computational Neuroscience.

[10]  Aaditya V. Rangan,et al.  Architectural and synaptic mechanisms underlying coherent spontaneous activity in V1. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[12]  Peter Andras,et al.  Simulation of robustness against lesions of cortical networks , 2007, The European journal of neuroscience.

[13]  L. Abbott,et al.  Neural network dynamics. , 2005, Annual review of neuroscience.

[14]  R Pastor-Satorras,et al.  Dynamical and correlation properties of the internet. , 2001, Physical review letters.

[15]  O. Sporns,et al.  Identification and Classification of Hubs in Brain Networks , 2007, PloS one.

[16]  O. Sporns Small-world connectivity, motif composition, and complexity of fractal neuronal connections. , 2006, Bio Systems.

[17]  J. Isaacson,et al.  Odor Representations in Olfactory Cortex: “Sparse” Coding, Global Inhibition, and Oscillations , 2009, Neuron.

[18]  David Golomb,et al.  Does Layer 4 in the Barrel Cortex Function as a Balanced Circuit when Responding to Whisker Movements? , 2018, Neuroscience.

[19]  Zhijie Wang,et al.  Optimum neural tuning curves for information efficiency with rate coding and finite-time window , 2015, Front. Comput. Neurosci..

[20]  S. Redner,et al.  Organization of growing random networks. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[21]  Nicholas T. Carnevale,et al.  Simulation of networks of spiking neurons: A review of tools and strategies , 2006, Journal of Computational Neuroscience.

[22]  H. Sompolinsky,et al.  The Impact of Structural Heterogeneity on Excitation-Inhibition Balance in Cortical Networks , 2016, Neuron.

[23]  Katherine Whalley,et al.  Neural coding: Timing is key in the olfactory system , 2013, Nature Reviews Neuroscience.

[24]  O. Sporns,et al.  Organization, development and function of complex brain networks , 2004, Trends in Cognitive Sciences.

[25]  E. Çinlar,et al.  On the Superposition of Point Processes , 1968 .

[26]  William R. Softky,et al.  Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. , 1996, Journal of neurophysiology.

[27]  K. H. Britten,et al.  Responses of neurons in macaque MT to stochastic motion signals , 1993, Visual Neuroscience.

[28]  Aaditya V. Rangan,et al.  Architectural and functional connectivity in scale-free integrate-and-fire networks , 2009 .

[29]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[30]  Reka Albert,et al.  Mean-field theory for scale-free random networks , 1999 .

[31]  Shilpa Chakravartula,et al.  Complex Networks: Structure and Dynamics , 2014 .

[32]  Sen Song,et al.  Highly Nonrandom Features of Synaptic Connectivity in Local Cortical Circuits , 2005, PLoS biology.

[33]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[34]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[35]  M. Newman,et al.  Random graphs with arbitrary degree distributions and their applications. , 2000, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Aaditya V. Rangan,et al.  Spatiotemporal dynamics of neuronal population response in the primary visual cortex , 2013, Proceedings of the National Academy of Sciences.

[37]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[38]  T. Harkany,et al.  Pyramidal cell communication within local networks in layer 2/3 of rat neocortex , 2003, The Journal of physiology.

[39]  M. A. O'Neil,et al.  The connectional organization of the cortico-thalamic system of the cat. , 1999, Cerebral cortex.

[40]  B J Richmond,et al.  Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. II. Information transmission. , 1990, Journal of neurophysiology.

[41]  T. Hromádka,et al.  Sparse Representation of Sounds in the Unanesthetized Auditory Cortex , 2008, PLoS biology.

[42]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[43]  Kenneth D. Miller,et al.  Physiological Gain Leads to High ISI Variability in a Simple Model of a Cortical Regular Spiking Cell , 1997, Neural Computation.

[44]  Aaditya V. Rangan,et al.  Network-induced chaos in integrate-and-fire neuronal ensembles. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[46]  Olaf Sporns,et al.  The small world of the cerebral cortex , 2007, Neuroinformatics.

[47]  Guosong Liu,et al.  Local structural balance and functional interaction of excitatory and inhibitory synapses in hippocampal dendrites , 2004, Nature Neuroscience.

[48]  J. Movshon,et al.  Spike train encoding by regular-spiking cells of the visual cortex. , 1996, Journal of neurophysiology.

[49]  Aaditya V. Rangan,et al.  Modeling the spatiotemporal cortical activity associated with the line-motion illusion in primary visual cortex. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[50]  E J Chichilnisky,et al.  Prediction and Decoding of Retinal Ganglion Cell Responses with a Probabilistic Spiking Model , 2005, The Journal of Neuroscience.

[51]  M. Scanziani,et al.  Equalizing Excitation-Inhibition Ratios across Visual Cortical Neurons , 2014, Nature.

[52]  Igor M. Sokolov,et al.  Changing Correlations in Networks: Assortativity and Dissortativity , 2005 .

[53]  Fan Chung Graham,et al.  A random graph model for massive graphs , 2000, STOC '00.

[54]  P. Goldman-Rakic,et al.  Temporally irregular mnemonic persistent activity in prefrontal neurons of monkeys during a delayed response task. , 2003, Journal of neurophysiology.

[55]  Aaditya V. Rangan,et al.  DYNAMICS OF CURRENT-BASED, POISSON DRIVEN, INTEGRATE-AND-FIRE NEURONAL NETWORKS " , 2010 .

[56]  Bin Deng,et al.  Input-output relation and energy efficiency in the neuron with different spike threshold dynamics , 2015, Front. Comput. Neurosci..

[57]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[58]  K. Svoboda,et al.  Neural Activity in Barrel Cortex Underlying Vibrissa-Based Object Localization in Mice , 2010, Neuron.

[59]  H. Sompolinsky,et al.  The tempotron: a neuron that learns spike timing–based decisions , 2006, Nature Neuroscience.

[60]  W. Senn,et al.  Neocortical pyramidal cells respond as integrate-and-fire neurons to in vivo-like input currents. , 2003, Journal of neurophysiology.

[61]  Tomoki Fukai,et al.  Balanced Excitatory and Inhibitory Inputs to Cortical Neurons Decouple Firing Irregularity from Rate Modulations , 2007, The Journal of Neuroscience.

[62]  Louis Tao,et al.  KINETIC THEORY FOR NEURONAL NETWORK DYNAMICS , 2006 .

[63]  Michel A. Picardo,et al.  GABAergic Hub Neurons Orchestrate Synchrony in Developing Hippocampal Networks , 2009, Science.

[64]  Alex Roxin,et al.  The Role of Degree Distribution in Shaping the Dynamics in Networks of Sparsely Connected Spiking Neurons , 2011, Front. Comput. Neurosci..

[65]  Markus Diesmann,et al.  Activity dynamics and propagation of synchronous spiking in locally connected random networks , 2003, Biological Cybernetics.

[66]  Robert Rosenbaum,et al.  Highly connected neurons spike less frequently in balanced networks. , 2016, Physical review. E.

[67]  J. Hertz,et al.  Learning short synfire chains by self-organization. , 1996, Network.

[68]  William J. Reed,et al.  A BRIEF INTRODUCTION TO SCALE‐FREE NETWORKS , 2006 .