Spontaneous and stimulus-induced coherent states of critically balanced neuronal networks

How the information microscopically processed by individual neurons is integrated and used in organizing the behavior of an animal is a central question in neuroscience. The coherence of neuronal dynamics over different scales has been suggested as a clue to the mechanisms underlying this integration. Balanced excitation and inhibition may amplify microscopic fluctuations to a macroscopic level, thus providing a mechanism for generating coherent multiscale dynamics. Previous theories of brain dynamics, however, were restricted to cases in which inhibition dominated excitation and suppressed fluctuations in the macroscopic population activity. In the present study, we investigate the dynamics of neuronal networks at a critical point between excitation-dominant and inhibition-dominant states. In these networks, the microscopic fluctuations are amplified by the strong excitation and inhibition to drive the macroscopic dynamics, while the macroscopic dynamics determine the statistics of the microscopic fluctuations. Developing a novel type of mean-field theory applicable to this class of interscale interactions, we show that the amplification mechanism generates spontaneous, irregular macroscopic rhythms similar to those observed in the brain. Through the same mechanism, microscopic inputs to a small number of neurons effectively entrain the dynamics of the whole network. These network dynamics undergo a probabilistic transition to a coherent state, as the magnitude of either the balanced excitation and inhibition or the external inputs is increased. Our mean-field theory successfully predicts the behavior of this model. Furthermore, we numerically demonstrate that the coherent dynamics can be used for state-dependent read-out of information from the network. These results show a novel form of neuronal information processing that connects neuronal dynamics on different scales.

[1]  Harald Haas,et al.  Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication , 2004, Science.

[2]  W. Singer,et al.  Dynamic predictions: Oscillations and synchrony in top–down processing , 2001, Nature Reviews Neuroscience.

[3]  Zengcai V. Guo,et al.  Maintenance of persistent activity in a frontal thalamocortical loop , 2017, Nature.

[4]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[5]  H Sompolinsky,et al.  Dynamics of random neural networks with bistable units. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[7]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[8]  U. Karmarkar,et al.  Timing in the Absence of Clocks: Encoding Time in Neural Network States , 2007, Neuron.

[9]  Benjamin Schrauwen,et al.  Reservoir Computing Trends , 2012, KI - Künstliche Intelligenz.

[10]  L. Appeltant,et al.  Information processing using a single dynamical node as complex system , 2011, Nature communications.

[11]  Moritz Helias,et al.  Optimal Sequence Memory in Driven Random Networks , 2016, Physical Review X.

[12]  Michael A. Buice,et al.  Path Integral Methods for Stochastic Differential Equations , 2015, Journal of mathematical neuroscience.

[13]  K. Ganguly,et al.  Reactivation of emergent task-related ensembles during slow-wave sleep after neuroprosthetic learning , 2014, Nature Neuroscience.

[14]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[15]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[16]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[17]  H. Sompolinsky,et al.  Transition to chaos in random neuronal networks , 2015, 1508.06486.

[18]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[19]  B. Doiron,et al.  Balanced Networks of Spiking Neurons with Spatially Dependent Recurrent Connections , 2013, 1308.6014.

[20]  J. Herskowitz,et al.  Proceedings of the National Academy of Sciences, USA , 1996, Current Biology.

[21]  Minoru Asada,et al.  Information processing in echo state networks at the edge of chaos , 2011, Theory in Biosciences.

[22]  Dean V. Buonomano,et al.  ROBUST TIMING AND MOTOR PATTERNS BY TAMING CHAOS IN RECURRENT NEURAL NETWORKS , 2012, Nature Neuroscience.

[23]  Selmaan N. Chettih,et al.  The influence of visual cortex on perception is modulated by behavioural state , 2019, bioRxiv.

[24]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[25]  L. Abbott,et al.  Eigenvalue spectra of random matrices for neural networks. , 2006, Physical review letters.

[26]  Leonardo L. Gollo,et al.  Criticality in the brain: A synthesis of neurobiology, models and cognition , 2017, Progress in Neurobiology.

[27]  G. Buzsáki Theta Oscillations in the Hippocampus , 2002, Neuron.

[28]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[29]  Moritz Helias,et al.  Correlated fluctuations in strongly-coupled binary networks beyond equilibrium , 2015, 1512.01073.

[30]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[31]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[32]  G. Buzsáki,et al.  Spike train dynamics predicts theta-related phase precession in hippocampal pyramidal cells , 2002, Nature.

[33]  John A. Hertz,et al.  Path integral methods for the dynamics of stochastic and disordered systems , 2016, 1604.05775.

[34]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[35]  T. Pedley Current Practice of Clinical Electroenceph‐alography , 1980, Neurology.

[36]  W. Singer,et al.  The gamma cycle , 2007, Trends in Neurosciences.

[37]  Geoffrey North Current Biology at 20 , 2010, Current Biology.

[38]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[39]  Rainer Engelken,et al.  A reanalysis of “Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons” , 2016, F1000Research.

[40]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[41]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[42]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[43]  Robert Rosenbaum,et al.  Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks. , 2016, Physical review letters.

[44]  Bert Sakmann,et al.  Spontaneous persistent activity in entorhinal cortex modulates cortico-hippocampal interaction in vivo , 2012, Nature Neuroscience.

[45]  J. Cowan,et al.  Field-theoretic approach to fluctuation effects in neural networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[46]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[47]  H. J. Gamble Trends in Neurosciences , 1980 .

[48]  R. Romo,et al.  Neuronal correlates of parametric working memory in the prefrontal cortex , 1999, Nature.

[49]  J. Lisman Working Memory: The Importance of Theta and Gamma Oscillations , 2010, Current Biology.

[50]  J. Poulet,et al.  Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice , 2008, Nature.

[51]  Theoden I. Netoff,et al.  Synchronization from Second Order Network Connectivity Statistics , 2011, Front. Comput. Neurosci..

[52]  J. Kaiser,et al.  Human gamma-frequency oscillations associated with attention and memory , 2007, Trends in Neurosciences.

[53]  Jonathan Touboul,et al.  Synchronization in random balanced networks. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  W. Maass,et al.  What makes a dynamical system computationally powerful ? , 2022 .

[55]  Wolfgang Maass,et al.  Liquid State Machines: Motivation, Theory, and Applications , 2010 .

[56]  Michael A. Buice,et al.  Dynamic Finite Size Effects in Spiking Neural Networks , 2013, PLoS Comput. Biol..

[57]  Shun-ichi Amari,et al.  Learning Patterns and Pattern Sequences by Self-Organizing Nets of Threshold Elements , 1972, IEEE Transactions on Computers.

[58]  Peter Ford Dominey,et al.  Recurrent temporal networks and language acquisition—from corticostriatal neurophysiology to reservoir computing , 2013, Front. Psychol..

[59]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[60]  A. Engel,et al.  Antiphasic 40 Hz Oscillatory Current Stimulation Affects Bistable Motion Perception , 2013, Brain Topography.

[61]  Jérémie Barral,et al.  Synaptic scaling rule preserves excitatory–inhibitory balance and salient neuronal network dynamics , 2016, Nature Neuroscience.

[62]  J. A. Hobson,et al.  Neuronal Basis of Behavioral State Control , 2011 .

[63]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[64]  M. Scanziani,et al.  Instantaneous Modulation of Gamma Oscillation Frequency by Balancing Excitation with Inhibition , 2009, Neuron.

[65]  Schuster,et al.  Suppressing chaos in neural networks by noise. , 1992, Physical review letters.

[66]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[67]  T. Tao Outliers in the spectrum of iid matrices with bounded rank perturbations , 2010 .

[68]  Peter Ford Dominey,et al.  Reservoir Computing Properties of Neural Dynamics in Prefrontal Cortex , 2016, PLoS Comput. Biol..

[69]  Selmaan N. Chettih,et al.  Single-neuron perturbations reveal feature-specific competition in V1 , 2019, Nature.

[70]  J. V. van Berkum,et al.  How robust is the language architecture? The case of mood , 2013, Front. Psychol..

[71]  David J. Field,et al.  Sparse coding with an overcomplete basis set: A strategy employed by V1? , 1997, Vision Research.

[72]  B. Schrauwen,et al.  Isolated word recognition with the Liquid State Machine: a case study , 2005, Inf. Process. Lett..

[73]  Moritz Helias,et al.  Functional methods for disordered neural networks , 2016 .

[74]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[75]  Nils Bertschinger,et al.  Real-Time Computation at the Edge of Chaos in Recurrent Neural Networks , 2004, Neural Computation.

[76]  H. Sompolinsky,et al.  Relaxational dynamics of the Edwards-Anderson model and the mean-field theory of spin-glasses , 1982 .

[77]  D. Hansel,et al.  A canonical neural mechanism for behavioral variability , 2016, Nature Communications.

[78]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[79]  M. Carandini,et al.  Orientation tuning of input conductance, excitation, and inhibition in cat primary visual cortex. , 2000, Journal of neurophysiology.

[80]  K. Svoboda,et al.  Long-term in vivo imaging of experience-dependent synaptic plasticity in adult cortex , 2002, Nature.

[81]  Haim Sompolinsky,et al.  Coherent chaos in a recurrent neural network with structured connectivity , 2018, PLoS Comput. Biol..

[82]  Nicolas Brunel,et al.  Correlations between synapses in pairs of neurons slow down dynamics in randomly connected neural networks. , 2017, Physical review. E.

[83]  P. Goldman-Rakic,et al.  Prefrontal neuronal activity in rhesus monkeys performing a delayed anti-saccade task , 1993, Nature.

[84]  M. A. Smith,et al.  The spatial structure of correlated neuronal variability , 2016, Nature Neuroscience.

[85]  L. Abbott,et al.  Stimulus-dependent suppression of chaos in recurrent neural networks. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[86]  J. O’Keefe,et al.  Phase relationship between hippocampal place units and the EEG theta rhythm , 1993, Hippocampus.