Correlated states in balanced neuronal networks.

Understanding the magnitude and structure of interneuronal correlations and their relationship to synaptic connectivity structure is an important and difficult problem in computational neuroscience. Early studies show that neuronal network models with excitatory-inhibitory balance naturally create very weak spike train correlations, defining the "asynchronous state." Later work showed that, under some connectivity structures, balanced networks can produce larger correlations between some neuron pairs, even when the average correlation is very small. All of these previous studies assume that the local network receives feedforward synaptic input from a population of uncorrelated spike trains. We show that when spike trains providing feedforward input are correlated, the downstream recurrent network produces much larger correlations. We provide an in-depth analysis of the resulting "correlated state" in balanced networks and show that, unlike the asynchronous state, it produces a tight excitatory-inhibitory balance consistent with in vivo cortical recordings.

[1]  A. Zador,et al.  Balanced inhibition underlies tuning and sharpens spike timing in auditory cortex , 2003, Nature.

[2]  M. J. Richardson,et al.  Firing-rate response of linear and nonlinear integrate-and-fire neurons to modulated current-based and conductance-based synaptic drive. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  H. Sompolinsky,et al.  The Impact of Structural Heterogeneity on Excitation-Inhibition Balance in Cortical Networks , 2016, Neuron.

[4]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[5]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[6]  Moritz Helias,et al.  A unified view on weakly correlated recurrent networks , 2013, Front. Comput. Neurosci..

[7]  Rupert Swarbrick,et al.  Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise. , 2010, Physical review letters.

[8]  Kenneth D Harris,et al.  Stochastic transitions into silence cause noise correlations in cortical circuits , 2015, Proceedings of the National Academy of Sciences.

[9]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[10]  Rune W. Berg,et al.  Premotor Spinal Network with Balanced Excitation and Inhibition during Motor Patterns Has High Resilience to Structural Division , 2014, The Journal of Neuroscience.

[11]  Mu Zhou,et al.  Fine-tuning of pre-balanced excitation and inhibition during auditory cortical development , 2010, Nature.

[12]  Nicolas Brunel,et al.  Dynamics of the Instantaneous Firing Rate in Response to Changes in Input Statistics , 2005, Journal of Computational Neuroscience.

[13]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[14]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[15]  M. A. Smith,et al.  Correlations and brain states: from electrophysiology to functional imaging , 2009, Current Opinion in Neurobiology.

[16]  P. J. Sjöström,et al.  Functional specificity of local synaptic connections in neocortical networks , 2011, Nature.

[17]  Brent Doiron,et al.  Circuit Models of Low-Dimensional Shared Variability in Cortical Networks , 2019, Neuron.

[18]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[19]  Tatjana Tchumatchenko,et al.  How linear response shaped models of neural circuits and the quest for alternatives , 2017, Current Opinion in Neurobiology.

[20]  Robert Rosenbaum,et al.  The Effects of Pooling on Spike Train Correlations , 2011, Front. Neurosci..

[21]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[22]  Stefan Rotter,et al.  Recurrent interactions in spiking networks with arbitrary topology. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  Adam Kohn,et al.  Correlations in V1 Are Reduced by Stimulation Outside the Receptive Field , 2014, The Journal of Neuroscience.

[24]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[25]  H. Koester,et al.  Correlations Decrease with Propagation of Spiking Activity in the Mouse Barrel Cortex , 2011, Front. Neural Circuits.

[26]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[27]  Benjamin Lindner,et al.  Statistics of a neuron model driven by asymmetric colored noise. , 2015, Physical review. E, Statistical, nonlinear, and soft matter physics.

[28]  Xiao-Jing Wang,et al.  What determines the frequency of fast network oscillations with irregular neural discharges? I. Synaptic dynamics and excitation-inhibition balance. , 2003, Journal of neurophysiology.

[29]  D. Hansel,et al.  Role of delays in shaping spatiotemporal dynamics of neuronal activity in large networks. , 2005, Physical review letters.

[30]  Benjamin Lindner,et al.  Comparative study of different integrate-and-fire neurons: spontaneous activity, dynamical response, and stimulus-induced correlation. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Wulfram Gerstner,et al.  Synaptic Shot Noise and Conductance Fluctuations Affect the Membrane Voltage with Equal Significance , 2005, Neural Computation.

[32]  Maoz Shamir,et al.  Emerging principles of population coding: in search for the neural code , 2014, Current Opinion in Neurobiology.

[33]  Moritz Helias,et al.  The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics , 2013, PLoS Comput. Biol..

[34]  Stefan Rotter,et al.  Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons , 2003, Neural Computation.

[35]  Robert Rosenbaum,et al.  Frontiers in Computational Neuroscience Computational Neuroscience , 2022 .

[36]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[37]  Robert Rosenbaum,et al.  Highly connected neurons spike less frequently in balanced networks. , 2016, Physical review. E.

[38]  A. Reyes,et al.  Spatial Profile of Excitatory and Inhibitory Synaptic Connectivity in Mouse Primary Auditory Cortex , 2012, The Journal of Neuroscience.

[39]  Néstor Parga,et al.  ournal of Statistical Mechanics : J Theory and Experiment Towards a self-consistent description of irregular and asynchronous cortical activity , 2013 .

[40]  Robert Rosenbaum,et al.  Imbalanced amplification: A mechanism of amplification and suppression from local imbalance of excitation and inhibition in cortical circuits , 2017, bioRxiv.

[41]  Yuzhi Chen,et al.  Sensory stimulation shifts visual cortex from synchronous to asynchronous states , 2014, Nature.

[42]  Eric Shea-Brown,et al.  Correlation and synchrony transfer in integrate-and-fire neurons: basic properties and consequences for coding. , 2008, Physical review letters.

[43]  Robert Rosenbaum,et al.  Finite volume and asymptotic methods for stochastic neuron models with correlated inputs , 2010, Journal of Mathematical Biology.

[44]  Robert Rosenbaum,et al.  A Diffusion Approximation and Numerical Methods for Adaptive Neuron Models with Stochastic Inputs , 2016, Front. Comput. Neurosci..

[45]  Benjamin Lindner,et al.  Statistical structure of neural spiking under non-Poissonian or other non-white stimulation , 2015, Journal of Computational Neuroscience.

[46]  J. Poulet,et al.  Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice , 2008, Nature.

[47]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[48]  A. Riehle,et al.  Mapping the spatio-temporal structure of motor cortical LFP and spiking activities during reach-to-grasp movements , 2013, Front. Neural Circuits.

[49]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[50]  Adi R. Bulsara,et al.  Analytic Expressions for Rate and CV of a Type I Neuron Driven by White Gaussian Noise , 2003, Neural Computation.

[51]  Christoph E. Schreiner,et al.  Developmental sensory experience balances cortical excitation and inhibition , 2010, Nature.

[52]  Adam Kohn,et al.  Laminar dependence of neuronal correlations in visual cortex. , 2013, Journal of neurophysiology.

[53]  Eric Shea-Brown,et al.  From the statistics of connectivity to the statistics of spike times in neuronal networks , 2017, Current Opinion in Neurobiology.

[54]  Magnus J. E. Richardson,et al.  Spike-train spectra and network response functions for non-linear integrate-and-fire neurons , 2008, Biological Cybernetics.

[55]  Benjamin Lindner,et al.  Self-consistent determination of the spike-train power spectrum in a neural network with sparse connectivity , 2014, Front. Comput. Neurosci..

[56]  John H. Reynolds,et al.  Laminar Organization of Attentional Modulation in Macaque Visual Area V4 , 2017, Neuron.

[57]  Everton J. Agnes,et al.  Inhibitory Plasticity: Balance, Control, and Codependence. , 2017, Annual review of neuroscience.

[58]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[59]  Brent Doiron,et al.  Spatial Profile and Differential Recruitment of GABAB Modulate Oscillatory Activity in Auditory Cortex , 2009, The Journal of Neuroscience.

[60]  M. A. Smith,et al.  The spatial structure of correlated neuronal variability , 2016, Nature Neuroscience.

[61]  Néstor Parga,et al.  Theory of Input Spike Auto- and Cross-Correlations and Their Effect on the Response of Spiking Neurons , 2007, Neural Computation.

[62]  D. McCormick,et al.  Waking State: Rapid Variations Modulate Neural and Behavioral Responses , 2015, Neuron.

[63]  Ilan Lampl,et al.  Local and thalamic origins of correlated ongoing and sensory-evoked cortical activities , 2016, Nature Communications.

[64]  Albert Compte,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[65]  Brent Doiron,et al.  Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[66]  Antonio Politi,et al.  Ubiquity of collective irregular dynamics in balanced networks of spiking neurons , 2017, bioRxiv.

[67]  Stefan Rotter,et al.  Dependence of Neuronal Correlations on Filter Characteristics and Marginal Spike Train Statistics , 2008, Neural Computation.

[68]  Li I. Zhang,et al.  Scaling down of balanced excitation and inhibition by active behavioral states in auditory cortex , 2014, Nature Neuroscience.

[69]  Carl van Vreeswijk,et al.  Strength of Correlations in Strongly Recurrent Neuronal Networks , 2018, Physical Review X.

[70]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[71]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[72]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[73]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[74]  Marc A Sommer,et al.  Spatial and Temporal Scales of Neuronal Correlation in Visual Area V4 , 2013, The Journal of Neuroscience.

[75]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[76]  Valentin Dragoi,et al.  Correlated Variability in Laminar Cortical Circuits , 2012, Neuron.

[77]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[78]  Néstor Parga,et al.  Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. , 2006, Physical review letters.

[79]  M. J. Richardson,et al.  Dynamics of populations and networks of neurons with voltage-activated and calcium-activated currents. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[80]  Robert Rosenbaum,et al.  Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks. , 2016, Physical review letters.

[81]  Moritz Helias,et al.  Decorrelation of Neural-Network Activity by Inhibitory Feedback , 2012, PLoS Comput. Biol..

[82]  Stefan Rotter,et al.  Solving the two-dimensional Fokker-Planck equation for strongly correlated neurons. , 2016, Physical review. E.

[83]  Jérémie Barral,et al.  Synaptic scaling rule preserves excitatory–inhibitory balance and salient neuronal network dynamics , 2016, Nature Neuroscience.

[84]  H. Risken Fokker-Planck Equation , 1996 .

[85]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[86]  Pulin Gong,et al.  Propagating Waves Can Explain Irregular Neural Dynamics , 2015, The Journal of Neuroscience.

[87]  Antonio Politi,et al.  Collective irregular dynamics in balanced networks of leaky integrate-and-fire neurons , 2018 .

[88]  J. García-Ojalvo,et al.  Effects of noise in excitable systems , 2004 .

[89]  B. Doiron,et al.  Balanced Networks of Spiking Neurons with Spatially Dependent Recurrent Connections , 2013, 1308.6014.