Hopf Bifurcation in Mean Field Explains Critical Avalanches in Excitation-Inhibition Balanced Neuronal Networks: A Mechanism for Multiscale Variability

Cortical neural circuits display highly irregular spiking in individual neurons but variably sized collective firing, oscillations and critical avalanches at the population level, all of which have functional importance for information processing. Theoretically, the balance of excitation and inhibition inputs is thought to account for spiking irregularity and critical avalanches may originate from an underlying phase transition. However, the theoretical reconciliation of these multilevel dynamic aspects in neural circuits remains an open question. Herein, we study excitation-inhibition (E-I) balanced neuronal network with biologically realistic synaptic kinetics. It can maintain irregular spiking dynamics with different levels of synchrony and critical avalanches emerge near the synchronous transition point. We propose a novel semi-analytical mean-field theory to derive the field equations governing the network macroscopic dynamics. It reveals that the E-I balanced state of the network manifesting irregular individual spiking is characterized by a macroscopic stable state, which can be either a fixed point or a periodic motion and the transition is predicted by a Hopf bifurcation in the macroscopic field. Furthermore, by analyzing public data, we find the coexistence of irregular spiking and critical avalanches in the spontaneous spiking activities of mouse cortical slice in vitro, indicating the universality of the observed phenomena. Our theory unveils the mechanism that permits complex neural activities in different spatiotemporal scales to coexist and elucidates a possible origin of the criticality of neural systems. It also provides a novel tool for analyzing the macroscopic dynamics of E-I balanced networks and its relationship to the microscopic counterparts, which can be useful for large-scale modeling and computation of cortical dynamics.

[1]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[2]  G. Sell,et al.  The Hopf Bifurcation and Its Applications , 1976 .

[3]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[4]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  William R. Softky,et al.  Comparison of discharge variability in vitro and in vivo in cat visual cortex neurons. , 1996, Journal of neurophysiology.

[6]  Paul Antoine Salin,et al.  Spontaneous GABAA receptor-mediated inhibitory currents in adult rat somatosensory cortex. , 1996, Journal of neurophysiology.

[7]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[8]  M. Teich,et al.  Fractal character of the neural spike train in the visual system of the cat. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[9]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[10]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[11]  C. Stevens,et al.  Input synchrony and the irregular firing of cortical neurons , 1998, Nature Neuroscience.

[12]  F. Zhou,et al.  AMPA receptor-mediated EPSCs in rat neocortical layer II/III interneurons have rapid kinetics , 1998, Brain Research.

[13]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[14]  Maria V. Sanchez-Vives,et al.  Cellular and network mechanisms of rhythmic recurrent activity in neocortex , 2000, Nature Neuroscience.

[15]  J. Sethna,et al.  Crackling noise , 2001, Nature.

[16]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[17]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[18]  Xiao-Jing Wang,et al.  Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks , 2003 .

[19]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[20]  Xiao-Jing Wang,et al.  What determines the frequency of fast network oscillations with irregular neural discharges? I. Synaptic dynamics and excitation-inhibition balance. , 2003, Journal of neurophysiology.

[21]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[22]  A.M. Litke,et al.  What does the eye tell the brain?: Development of a system for the large scale recording of retinal output activity , 2003, 2003 IEEE Nuclear Science Symposium. Conference Record (IEEE Cat. No.03CH37515).

[23]  Oren Shriki,et al.  Rate Models for Conductance-Based Cortical Neuronal Networks , 2003, Neural Computation.

[24]  N. Parga,et al.  Role of synaptic filtering on the firing response of simple model neurons. , 2004, Physical review letters.

[25]  A. Engel,et al.  Cognitive functions of gamma-band activity: memory match and utilization , 2004, Trends in Cognitive Sciences.

[26]  Xiao-Jing Wang,et al.  Effects of Neuromodulation in a Cortical Network Model of Object Working Memory Dominated by Recurrent Inhibition , 2004, Journal of Computational Neuroscience.

[27]  Louis Tao,et al.  Efficient and Accurate Time-Stepping Schemes for Integrate-and-Fire Neuronal Networks , 2001, Journal of Computational Neuroscience.

[28]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[29]  L. Ricciardi,et al.  The Ornstein-Uhlenbeck process as a model for neuronal activity , 1979, Biological Cybernetics.

[30]  Wulfram Gerstner,et al.  Synaptic Shot Noise and Conductance Fluctuations Affect the Membrane Voltage with Equal Significance , 2005, Neural Computation.

[31]  J. Skilling Turning ON (and OFF) , 2005 .

[32]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[33]  Xiao-Jing Wang,et al.  A Recurrent Network Mechanism of Time Integration in Perceptual Decisions , 2006, The Journal of Neuroscience.

[34]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[35]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[36]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[37]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[38]  David Golomb,et al.  Neuronal synchrony measures , 2007, Scholarpedia.

[39]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[40]  G. Buzsáki,et al.  Sequential structure of neocortical spontaneous activity in vivo , 2007, Proceedings of the National Academy of Sciences.

[41]  M. Tsodyks,et al.  Synaptic Theory of Working Memory , 2008, Science.

[42]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[43]  Nicolas Brunel,et al.  Sparsely synchronized neuronal oscillations. , 2008, Chaos.

[44]  D. Plenz,et al.  Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3 , 2008, Proceedings of the National Academy of Sciences.

[45]  Michael Okun,et al.  Balance of excitation and inhibition , 2009, Scholarpedia.

[46]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[47]  Stefan Mihalas,et al.  Self-organized criticality occurs in non-conservative neuronal networks during Up states , 2010, Nature physics.

[48]  Biyu J. He,et al.  The Temporal Structures and Functional Significance of Scale-free Brain Activity , 2010, Neuron.

[49]  Marc Benayoun,et al.  Avalanches in a Stochastic Model of Spiking Neurons , 2010, PLoS Comput. Biol..

[50]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[51]  E. Brown,et al.  General anesthesia, sleep, and coma. , 2010, The New England journal of medicine.

[52]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[53]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[54]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[55]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[56]  John M. Beggs,et al.  Universal critical dynamics in high resolution neuronal avalanche data. , 2012, Physical review letters.

[57]  Woodrow L. Shew,et al.  Maximal Variability of Phase Synchrony in Cortical Networks with Neuronal Avalanches , 2012, The Journal of Neuroscience.

[58]  K. Linkenkaer-Hansen,et al.  Critical-State Dynamics of Avalanches and Oscillations Jointly Emerge from Balanced Excitation/Inhibition in Neuronal Networks , 2012, The Journal of Neuroscience.

[59]  D. Plenz,et al.  Balance between excitation and inhibition controls the temporal organization of neuronal avalanches. , 2012, Physical review letters.

[60]  D. Plenz,et al.  Neuronal Avalanches in the Resting MEG of the Human Brain , 2012, The Journal of Neuroscience.

[61]  L. F. Abbott,et al.  A Complex-Valued Firing-Rate Model That Approximates the Dynamics of Spiking Networks , 2013, PLoS Comput. Biol..

[62]  Dante R Chialvo,et al.  Brain organization into resting state networks emerges at criticality on a model of the human connectome. , 2012, Physical review letters.

[63]  K. Linkenkaer-Hansen,et al.  Neuronal long-range temporal correlations and avalanche dynamics are correlated with behavioral scaling laws , 2013, Proceedings of the National Academy of Sciences.

[64]  M. Scanziani,et al.  Equalizing Excitation-Inhibition Ratios across Visual Cortical Neurons , 2014, Nature.

[65]  Biyu J. He Scale-free brain activity: past, present, and future , 2014, Trends in Cognitive Sciences.

[66]  John M. Beggs,et al.  Large-Scale, High-Resolution Multielectrode-Array Recording Depicts Functional Network Differences of Cortical and Hippocampal Cultures , 2014, PloS one.

[67]  Xiao-Jing Wang,et al.  Erratum to: Effects of neuromodulation in a cortical network model of object working memory dominated by recurrent inhibition , 2014, Journal of Computational Neuroscience.

[68]  Michael J. Berry,et al.  Thermodynamics and signatures of criticality in a network of neurons , 2015, Proceedings of the National Academy of Sciences.

[69]  Andreas Klaus,et al.  Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state , 2015, eLife.

[70]  Pulin Gong,et al.  Propagating Waves Can Explain Irregular Neural Dynamics , 2015, The Journal of Neuroscience.

[71]  J. Touboul,et al.  Power-law statistics and universal scaling are generic features of large ensembles of weakly correlated units , 2015 .

[72]  H. Kennedy,et al.  A Large-Scale Circuit Mechanism for Hierarchical Dynamical Processing in the Primate Cortex , 2015, Neuron.

[73]  Woodrow L. Shew,et al.  State-dependent intrinsic predictability of cortical network dynamics , 2015, PLoS Comput. Biol..

[74]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[75]  Andreas Klaus,et al.  Author response: Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state , 2015 .

[76]  Woodrow L. Shew,et al.  Adaptation to sensory input tunes visual cortex to criticality , 2015, Nature Physics.

[77]  Carlo R. Laing,et al.  Exact Neural Fields Incorporating Gap Junctions , 2015, SIAM J. Appl. Dyn. Syst..

[78]  Ernest Montbri'o,et al.  Macroscopic description for networks of spiking neurons , 2015, 1506.06581.

[79]  Thierry Mora,et al.  Dynamical criticality in the collective activity of a population of retinal neurons. , 2014, Physical review letters.

[80]  John M. Beggs,et al.  Unveiling causal activity of complex networks , 2016, 1603.05659.

[81]  H. Sompolinsky,et al.  The Impact of Structural Heterogeneity on Excitation-Inhibition Balance in Cortical Networks , 2016, Neuron.

[82]  K. Y. Wong,et al.  Stochastic Oscillation in Self-Organized Critical States of Small Systems: Sensitive Resting State in Neural Systems. , 2016, Physical review letters.

[83]  Nicholas Bennett,et al.  Analysis of Power Laws, Shape Collapses, and Neural Complexity: New Techniques and MATLAB Support via the NCC Toolbox , 2016, Front. Physiol..

[84]  Christian K. Machens,et al.  Efficient codes and balanced networks , 2016, Nature Neuroscience.

[85]  M. A. Smith,et al.  The spatial structure of correlated neuronal variability , 2016, Nature Neuroscience.

[86]  Elisa M. Tartaglia,et al.  Bistability and up/down state alternations in inhibition-dominated randomly connected networks of LIF neurons , 2017, Scientific Reports.

[87]  R. Ramaswamy,et al.  General mechanism for the 1/f noise. , 2016, Physical review. E.

[88]  Jaime de la Rocha,et al.  Author response: UP-DOWN cortical dynamics reflect state transitions in a bistable network , 2017 .

[89]  Klaus Obermayer,et al.  Low-dimensional spike rate models derived from networks of adaptive integrate-and-fire neurons: Comparison and implementation , 2016, PLoS Comput. Biol..

[90]  Wulfram Gerstner,et al.  Towards a theory of cortical columns: From spiking neurons to interacting neural populations of finite size , 2016, PLoS Comput. Biol..

[91]  P. Barthó,et al.  UP-DOWN cortical dynamics reflect state transitions in a bistable network , 2017, eLife.

[92]  M. A. Muñoz,et al.  Neutral Theory and Scale-Free Neural Dynamics , 2017, 1703.05079.

[93]  M. A. Muñoz,et al.  Simple unified view of branching process statistics: Random walks in balanced logarithmic potentials. , 2016, Physical review. E.

[94]  J. Touboul,et al.  Power-law statistics and universal scaling in the absence of criticality. , 2015, Physical review. E.

[95]  Changsong Zhou,et al.  Co-emergence of multi-scale cortical activities of irregular firing, oscillations and avalanches achieves cost-efficient information capacity , 2017, PLoS Comput. Biol..

[96]  M. A. Muñoz,et al.  Landau–Ginzburg theory of cortex dynamics: Scale-free avalanches emerge at the edge of synchronization , 2018, Proceedings of the National Academy of Sciences.

[97]  Johannes Zierenberg,et al.  Homeostatic plasticity and external input shape neural network dynamics , 2018, bioRxiv.

[98]  Carl van Vreeswijk,et al.  Strength of Correlations in Strongly Recurrent Neuronal Networks , 2018, Physical Review X.

[99]  Leonardo Dalla Porta,et al.  Modeling neuronal avalanches and long-range temporal correlations at the emergence of collective oscillations: continuously varying exponents mimic M/EEG results , 2019, PLoS Comput. Biol..

[100]  J. A. Henderson,et al.  Dynamical patterns underlying response properties of cortical circuits , 2018, Journal of The Royal Society Interface.

[101]  Pedro V. Carelli,et al.  Criticality between cortical states , 2018, bioRxiv.

[102]  Shan Yu,et al.  The scale-invariant, temporal profile of neuronal avalanches in relation to cortical γ–oscillations , 2019, bioRxiv.

[103]  Ralf Wessel,et al.  Cortical Circuit Dynamics Are Homeostatically Tuned to Criticality In Vivo , 2019, Neuron.

[104]  J Wilting,et al.  Between Perfectly Critical and Fully Irregular: A Reverberating Model Captures and Predicts Cortical Spike Propagation , 2018, Cerebral cortex.

[105]  J. Wilting,et al.  25 years of criticality in neuroscience — established results, open controversies, novel concepts , 2019, Current Opinion in Neurobiology.

[106]  Brent Doiron,et al.  Circuit Models of Low-Dimensional Shared Variability in Cortical Networks , 2019, Neuron.

[107]  Rong Wang,et al.  Hierarchical Connectome Modes and Critical State Jointly Maximize Human Brain Functional Diversity. , 2019, Physical review letters.

[108]  C. Webb,et al.  Spatio-temporal patterns and characteristics of swine shipments in the U.S. based on Interstate Certificates of Veterinary Inspection , 2019, Scientific Reports.

[109]  Pedro V. Carelli,et al.  Criticality between cortical states , 2018, bioRxiv.

[110]  Nicholas A. Steinmetz,et al.  Spontaneous behaviors drive multidimensional, brainwide activity , 2019, Science.

[111]  Yang Qi,et al.  Rich-club connectivity, diverse population coupling, and dynamical activity patterns emerging from local cortical circuits , 2019, PLoS Comput. Biol..

[112]  M. Copelli,et al.  Modeling neuronal avalanches and long-range temporal correlations at the emergence of collective oscillations: Continuously varying exponents mimic M/EEG results , 2018, bioRxiv.

[113]  Nicholas A. Steinmetz,et al.  High-dimensional geometry of population responses in visual cortex , 2018, Nature.

[114]  Boris Gutkin,et al.  Macroscopic phase resetting-curves determine oscillatory coherence and signal transfer in inter-coupled neural circuits , 2018, PLoS Comput. Biol..

[115]  B. Győrffy,et al.  SETD3 acts as a prognostic marker in breast cancer patients and modulates the viability and invasion of breast cancer cells , 2020, Scientific Reports.

[116]  M. Wibral,et al.  Control of criticality and computation in spiking neuromorphic networks with plasticity , 2019, Nature Communications.

[117]  G. Pruessner,et al.  Time-dependent branching processes: a model of oscillating neuronal avalanches , 2020, Scientific Reports.

[118]  J. Latgé,et al.  The negative cofactor 2 complex is a key regulator of drug resistance in Aspergillus fumigatus , 2020, Nature Communications.