Interpretation of correlated neural variability from models of feed-forward and recurrent circuits

Neural populations respond to the repeated presentations of a sensory stimulus with correlated variability. These correlations have been studied in detail, with respect to their mechanistic origin, as well as their influence on stimulus discrimination and on the performance of population codes. A number of theoretical studies have endeavored to link network architecture to the nature of the correlations in neural activity. Here, we contribute to this effort: in models of circuits of stochastic neurons, we elucidate the implications of various network architectures—recurrent connections, shared feed-forward projections, and shared gain fluctuations—on the stimulus dependence in correlations. Specifically, we derive mathematical relations that specify the dependence of population-averaged covariances on firing rates, for different network architectures. In turn, these relations can be used to analyze data on population activity. We examine recordings from neural populations in mouse auditory cortex. We find that a recurrent network model with random effective connections captures the observed statistics. Furthermore, using our circuit model, we investigate the relation between network parameters, correlations, and how well different stimuli can be discriminated from one another based on the population activity. As such, our approach allows us to relate properties of the neural circuit to information processing.

[1]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[2]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[3]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[4]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[5]  Moritz Helias,et al.  A unified view on weakly correlated recurrent networks , 2013, Front. Comput. Neurosci..

[6]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[7]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[8]  Alexander S. Ecker,et al.  On the Structure of Neuronal Population Activity under Fluctuations in Attentional State , 2015, The Journal of Neuroscience.

[9]  Alexandre Pouget,et al.  Insights from a Simple Expression for Linear Fisher Information in a Recurrently Connected Population of Spiking Neurons , 2011, Neural Computation.

[10]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[11]  A. Hawkes Point Spectra of Some Mutually Exciting Point Processes , 1971 .

[12]  K. Harris,et al.  Gating of Sensory Input by Spontaneous Cortical Activity , 2013, The Journal of Neuroscience.

[13]  John P. Cunningham,et al.  Empirical models of spiking in neural populations , 2011, NIPS.

[14]  Gasper Tkacik,et al.  Optimal population coding by noisy spiking neurons , 2010, Proceedings of the National Academy of Sciences.

[15]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[16]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[17]  Rava Azeredo da Silveira,et al.  High-Fidelity Coding with Correlated Neurons , 2013, PLoS Comput. Biol..

[18]  Yu Hu,et al.  The Sign Rule and Beyond: Boundary Effects, Flexibility, and Noise Correlations in Neural Population Codes , 2013, PLoS Comput. Biol..

[19]  Maxwell H. Turner,et al.  Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code , 2016, Neuron.

[20]  Eero P. Simoncelli,et al.  Modeling the Impact of Common Noise Inputs on the Network Activity of Retinal Ganglion Cells Action Editor: Brent Doiron , 2022 .

[21]  Carlos D. Brody,et al.  Correlations Without Synchrony , 1999, Neural Computation.

[22]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[23]  Stefan Rotter,et al.  Orientation Selectivity in Inhibition-Dominated Networks of Spiking Neurons: Effect of Single Neuron Properties and Network Dynamics , 2015, PLoS Comput. Biol..

[24]  Haim Sompolinsky,et al.  Nonlinear Population Codes , 2004, Neural Computation.

[25]  Rava Azeredo da Silveira,et al.  Structures of Neural Correlation and How They Favor Coding , 2016, Neuron.

[26]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[27]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[28]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[29]  Cheng Ly,et al.  When do correlations increase with firing rates in recurrent networks? , 2016, PLoS Comput. Biol..

[30]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[31]  S. Rumpel,et al.  Discrete Neocortical Dynamics Predict Behavioral Categorization of Sounds , 2012, Neuron.

[32]  M. Carandini,et al.  Cortical State Determines Global Variability and Correlations in Visual Cortex , 2015, The Journal of Neuroscience.

[33]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[34]  I. Nelken,et al.  Functional organization and population dynamics in the mouse primary auditory cortex , 2010, Nature Neuroscience.

[35]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[36]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[37]  Alexandre Pouget,et al.  Origin of information-limiting noise correlations , 2015, Proceedings of the National Academy of Sciences.

[38]  Stefan Rotter,et al.  Correlations and Population Dynamics in Cortical Networks , 2008, Neural Computation.

[39]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[40]  Tatjana Tchumatchenko,et al.  Temporal pairwise spike correlations fully capture single-neuron information , 2016, Nature Communications.

[41]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[42]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[43]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[44]  Christoph E. Schreiner,et al.  Diverse effects of stimulus history in waking mouse auditory cortex. , 2017, Journal of neurophysiology.

[45]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[46]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[47]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[48]  Mark C. W. van Rossum,et al.  Transmission of Population-Coded Information , 2012, Neural Computation.

[49]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[50]  Christian W. Eurich,et al.  Representational Accuracy of Stochastic Neural Populations , 2002, Neural Computation.

[51]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[52]  Christopher M. Lee,et al.  Neural spike-timing patterns vary with sound shape and periodicity in three auditory cortical fields. , 2016, Journal of neurophysiology.

[53]  Moritz Helias,et al.  Decorrelation of Neural-Network Activity by Inhibitory Feedback , 2012, PLoS Comput. Biol..

[54]  D. Hansel,et al.  The Mechanism of Orientation Selectivity in Primary Visual Cortex without a Functional Map , 2012, The Journal of Neuroscience.