The correlated state in balanced neuronal networks

Understanding the magnitude and structure of inter-neuronal correlations and their relationship to synaptic connectivity structure is an important and difficult problem in computational neuroscience. Early studies show that neuronal network models with excitatory-inhibitory balance naturally create very weak spike train correlations, defining the “asynchronous state.” Later work showed that, under some connectivity structures, balanced networks can produce larger correlations between some neuron pairs, even when the average correlation is very small. All of these previous studies assume that the local network receives feedforward synaptic input from a population of uncorrelated spike trains. We show that when spike trains providing feedforward input are correlated, the downstream recurrent network produces much larger correlations. We provide an in-depth analysis of the resulting “correlated state” in balanced networks and show that, unlike the asynchronous state, it produces a tight excitatory-inhibitory balance consistent with in vivo cortical recordings.

[1]  Benjamin Lindner,et al.  Statistics of a neuron model driven by asymmetric colored noise. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[2]  Xiao-Jing Wang,et al.  What determines the frequency of fast network oscillations with irregular neural discharges? I. Synaptic dynamics and excitation-inhibition balance. , 2003, Journal of neurophysiology.

[3]  John H. Reynolds,et al.  Laminar Organization of Attentional Modulation in Macaque Visual Area V4 , 2017, Neuron.

[4]  A. Zador,et al.  Balanced inhibition underlies tuning and sharpens spike timing in auditory cortex , 2003, Nature.

[5]  Brent Doiron,et al.  Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  Antonio Politi,et al.  Ubiquity of collective irregular dynamics in balanced networks of spiking neurons , 2017, bioRxiv.

[7]  R. Nelson,et al.  Motor Planning under Unpredictable Reward: Modulations of Movement Vigor and Primate Striatum Activity , 2011, Front. Neurosci..

[8]  Eric Shea-Brown,et al.  Motif statistics and spike correlations in neuronal networks , 2012, BMC Neuroscience.

[9]  Everton J. Agnes,et al.  Inhibitory Plasticity: Balance, Control, and Codependence. , 2017, Annual review of neuroscience.

[10]  Adam Kohn,et al.  Laminar dependence of neuronal correlations in visual cortex. , 2013, Journal of neurophysiology.

[11]  Stefan Rotter,et al.  Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons , 2003, Neural Computation.

[12]  Robert Rosenbaum,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[13]  Ilan Lampl,et al.  Local and thalamic origins of correlated ongoing and sensory-evoked cortical activities , 2016, Nature Communications.

[14]  Albert Compte,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[15]  Robert Oostenveld,et al.  Neuronal Oscillations with Non-sinusoidal Morphology Produce Spurious Phase-to-Amplitude Coupling and Directionality , 2016, Front. Comput. Neurosci..

[16]  Eric Shea-Brown,et al.  From the statistics of connectivity to the statistics of spike times in neuronal networks , 2017, Current Opinion in Neurobiology.

[17]  Magnus J. E. Richardson,et al.  Spike-train spectra and network response functions for non-linear integrate-and-fire neurons , 2008, Biological Cybernetics.

[18]  Benjamin Lindner,et al.  Self-consistent determination of the spike-train power spectrum in a neural network with sparse connectivity , 2014, Front. Comput. Neurosci..

[19]  Moritz Helias,et al.  Two types of criticality in the brain , 2017 .

[20]  Robert Rosenbaum,et al.  A Diffusion Approximation and Numerical Methods for Adaptive Neuron Models with Stochastic Inputs , 2016, Front. Comput. Neurosci..

[21]  Sabrina Maniscalco,et al.  Fluctuation relations for driven coupled classical two-level systems with incomplete measurements. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Robert Rosenbaum,et al.  Imbalanced amplification: A mechanism of amplification and suppression from local imbalance of excitation and inhibition in cortical circuits , 2017, bioRxiv.

[23]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[24]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[25]  Wulfram Gerstner,et al.  Synaptic Shot Noise and Conductance Fluctuations Affect the Membrane Voltage with Equal Significance , 2005, Neural Computation.

[26]  Stefan Rotter,et al.  Dependence of Neuronal Correlations on Filter Characteristics and Marginal Spike Train Statistics , 2008, Neural Computation.

[27]  A. Riehle,et al.  Mapping the spatio-temporal structure of motor cortical LFP and spiking activities during reach-to-grasp movements , 2013, Front. Neural Circuits.

[28]  Carl van Vreeswijk,et al.  Strength of Correlations in Strongly Recurrent Neuronal Networks , 2018, Physical Review X.

[29]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[30]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[31]  Robert Rosenbaum,et al.  Highly connected neurons spike less frequently in balanced networks. , 2016, Physical review. E.

[32]  Li I. Zhang,et al.  Scaling down of balanced excitation and inhibition by active behavioral states in auditory cortex , 2014, Nature Neuroscience.

[33]  A. Reyes,et al.  Spatial Profile of Excitatory and Inhibitory Synaptic Connectivity in Mouse Primary Auditory Cortex , 2012, The Journal of Neuroscience.

[34]  Stefan Rotter,et al.  Solving the two-dimensional Fokker-Planck equation for strongly correlated neurons. , 2016, Physical review. E.

[35]  H. Koester,et al.  Correlations Decrease with Propagation of Spiking Activity in the Mouse Barrel Cortex , 2011, Front. Neural Circuits.

[36]  Robert Rosenbaum,et al.  Finite volume and asymptotic methods for stochastic neuron models with correlated inputs , 2010, Journal of mathematical biology.

[37]  Benjamin Lindner,et al.  Statistical structure of neural spiking under non-Poissonian or other non-white stimulation , 2015, Journal of Computational Neuroscience.

[38]  J. Poulet,et al.  Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice , 2008, Nature.

[39]  M. J. Richardson,et al.  Dynamics of populations and networks of neurons with voltage-activated and calcium-activated currents. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[40]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[41]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[42]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[43]  Néstor Parga,et al.  Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. , 2006, Physical review letters.

[44]  Rupert Swarbrick,et al.  Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise. , 2010, Physical review letters.

[45]  Kenneth D Harris,et al.  Stochastic transitions into silence cause noise correlations in cortical circuits , 2015, Proceedings of the National Academy of Sciences.

[46]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[47]  Antonio Politi,et al.  Collective irregular dynamics in balanced networks of leaky integrate-and-fire neurons , 2018 .

[48]  Rune W. Berg,et al.  Premotor Spinal Network with Balanced Excitation and Inhibition during Motor Patterns Has High Resilience to Structural Division , 2014, The Journal of Neuroscience.

[49]  J. García-Ojalvo,et al.  Effects of noise in excitable systems , 2004 .

[50]  Eric Shea-Brown,et al.  Correlation and synchrony transfer in integrate-and-fire neurons: basic properties and consequences for coding. , 2008, Physical review letters.

[51]  Robert Rosenbaum,et al.  Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks. , 2016, Physical review letters.

[52]  Moritz Helias,et al.  Decorrelation of Neural-Network Activity by Inhibitory Feedback , 2012, PLoS Comput. Biol..

[53]  Brent Doiron,et al.  Spatial Profile and Differential Recruitment of GABAB Modulate Oscillatory Activity in Auditory Cortex , 2009, The Journal of Neuroscience.

[54]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[55]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[56]  B. Doiron,et al.  Balanced Networks of Spiking Neurons with Spatially Dependent Recurrent Connections , 2013, 1308.6014.

[57]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[58]  Marc A Sommer,et al.  Spatial and Temporal Scales of Neuronal Correlation in Visual Area V4 , 2013, The Journal of Neuroscience.

[59]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[60]  F. Wolf,et al.  Dynamic Flux Tubes Form Reservoirs of Stability in Neuronal Circuits , 2012 .

[61]  C. Gardiner Handbook of Stochastic Methods , 1983 .

[62]  Jérémie Barral,et al.  Synaptic scaling rule preserves excitatory–inhibitory balance and salient neuronal network dynamics , 2016, Nature Neuroscience.

[63]  Valentin Dragoi,et al.  Correlated Variability in Laminar Cortical Circuits , 2012, Neuron.

[64]  M. A. Smith,et al.  The spatial structure of correlated neuronal variability , 2016, Nature Neuroscience.

[65]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[66]  David Hansel,et al.  How strong are correlations in strongly recurrent neuronal networks? , 2018, bioRxiv.

[67]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[68]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[69]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[70]  M. A. Smith,et al.  Correlations and brain states: from electrophysiology to functional imaging , 2009, Current Opinion in Neurobiology.

[71]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[72]  H. Sompolinsky,et al.  Correlation Functions in a Large Stochastic Neural Network , 1993, NIPS 1993.

[73]  M. J. Richardson,et al.  Firing-rate response of linear and nonlinear integrate-and-fire neurons to modulated current-based and conductance-based synaptic drive. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[74]  H. Sompolinsky,et al.  The Impact of Structural Heterogeneity on Excitation-Inhibition Balance in Cortical Networks , 2016, Neuron.

[75]  Brent Doiron,et al.  Circuit-based models of shared variability in cortical networks , 2017, bioRxiv.

[76]  Mu Zhou,et al.  Fine-tuning of pre-balanced excitation and inhibition during auditory cortical development , 2010, Nature.

[77]  Nicolas Brunel,et al.  Dynamics of the Instantaneous Firing Rate in Response to Changes in Input Statistics , 2005, Journal of Computational Neuroscience.

[78]  Yuzhi Chen,et al.  Sensory stimulation shifts visual cortex from synchronous to asynchronous states , 2014, Nature.

[79]  Moritz Helias,et al.  The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics , 2013, PLoS Comput. Biol..

[80]  Adi R. Bulsara,et al.  Analytic Expressions for Rate and CV of a Type I Neuron Driven by White Gaussian Noise , 2003, Neural Computation.

[81]  Christoph E. Schreiner,et al.  Developmental sensory experience balances cortical excitation and inhibition , 2010, Nature.

[82]  Moritz Helias,et al.  How pattern formation in ring networks of excitatory and inhibitory spiking neurons depends on the input current regime , 2013, Front. Comput. Neurosci..

[83]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[84]  Néstor Parga,et al.  ournal of Statistical Mechanics : J Theory and Experiment Towards a self-consistent description of irregular and asynchronous cortical activity , 2013 .

[85]  Haim Sompolinsky,et al.  Correlation Functions in a Large Stochastic Network , 1993, NIPS.

[86]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[87]  Tatjana Tchumatchenko,et al.  How linear response shaped models of neural circuits and the quest for alternatives , 2017, Current Opinion in Neurobiology.

[88]  Robert Rosenbaum,et al.  The Effects of Pooling on Spike Train Correlations , 2011, Front. Neurosci..

[89]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[90]  Stefan Rotter,et al.  Recurrent interactions in spiking networks with arbitrary topology. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[91]  Adam Kohn,et al.  Correlations in V1 Are Reduced by Stimulation Outside the Receptive Field , 2014, The Journal of Neuroscience.

[92]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[93]  R. Kümmerli,et al.  Quorum sensing triggers the stochastic escape of individual cells from Pseudomonas putida biofilms , 2015, Nature Communications.

[94]  Benjamin Lindner,et al.  Comparative study of different integrate-and-fire neurons: spontaneous activity, dynamical response, and stimulus-induced correlation. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[95]  Maoz Shamir,et al.  Emerging principles of population coding: in search for the neural code , 2014, Current Opinion in Neurobiology.

[96]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[97]  Pulin Gong,et al.  Propagating Waves Can Explain Irregular Neural Dynamics , 2015, The Journal of Neuroscience.

[98]  Moritz Helias,et al.  A unified view on weakly correlated recurrent networks , 2013, Front. Comput. Neurosci..

[99]  Brent Doiron,et al.  Circuit Models of Low-Dimensional Shared Variability in Cortical Networks , 2019, Neuron.

[100]  S. Sharma,et al.  The Fokker-Planck Equation , 2010 .

[101]  Néstor Parga,et al.  Theory of Input Spike Auto- and Cross-Correlations and Their Effect on the Response of Spiking Neurons , 2007, Neural Computation.

[102]  D. McCormick,et al.  Waking State: Rapid Variations Modulate Neural and Behavioral Responses , 2015, Neuron.