The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics

Correlated neuronal activity is a natural consequence of network connectivity and shared inputs to pairs of neurons, but the task-dependent modulation of correlations in relation to behavior also hints at a functional role. Correlations influence the gain of postsynaptic neurons, the amount of information encoded in the population activity and decoded by readout neurons, and synaptic plasticity. Further, it affects the power and spatial reach of extracellular signals like the local-field potential. A theory of correlated neuronal activity accounting for recurrent connectivity as well as fluctuating external sources is currently lacking. In particular, it is unclear how the recently found mechanism of active decorrelation by negative feedback on the population level affects the network response to externally applied correlated stimuli. Here, we present such an extension of the theory of correlations in stochastic binary networks. We show that (1) for homogeneous external input, the structure of correlations is mainly determined by the local recurrent connectivity, (2) homogeneous external inputs provide an additive, unspecific contribution to the correlations, (3) inhibitory feedback effectively decorrelates neuronal activity, even if neurons receive identical external inputs, and (4) identical synaptic input statistics to excitatory and to inhibitory cells increases intrinsically generated fluctuations and pairwise correlations. We further demonstrate how the accuracy of mean-field predictions can be improved by self-consistently including correlations. As a byproduct, we show that the cancellation of correlations between the summed inputs to pairs of neurons does not originate from the fast tracking of external input, but from the suppression of fluctuations on the population level by the local network. This suppression is a necessary constraint, but not sufficient to determine the structure of correlations; specifically, the structure observed at finite network size differs from the prediction based on perfect tracking, even though perfect tracking implies suppression of population fluctuations.

[1]  Philip Sterne,et al.  Information Recall Using Relative Spike Timing in a Spiking Neural Network , 2012, Neural Computation.

[2]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[3]  Chris Eliasmith,et al.  Neural populations can induce reliable postsynaptic currents without observable spike rate changes or precise spike timing. , 2007, Cerebral cortex.

[4]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[5]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[6]  Moritz Helias,et al.  Invariance of covariances arises out of noise , 2013 .

[7]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[8]  Stefan Rotter,et al.  Correlations and Population Dynamics in Cortical Networks , 2008, Neural Computation.

[9]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[10]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[11]  Wulfram Gerstner,et al.  Phenomenological models of synaptic plasticity based on spike timing , 2008, Biological Cybernetics.

[12]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[13]  Michael A. Buice,et al.  Systematic Fluctuation Expansion for Neural Network Activity Equations , 2009, Neural Computation.

[14]  Tobias C. Potjans,et al.  The Cell-Type Specific Cortical Microcircuit: Relating Structure and Activity in a Full-Scale Spiking Network Model , 2012, Cerebral cortex.

[15]  Brent Doiron,et al.  The Spatial Structure of Stimuli Shapes the Timescale of Correlations in Population Spiking Activity , 2012, PLoS Comput. Biol..

[16]  J. Poulet,et al.  Synaptic Mechanisms Underlying Sparse Coding of Active Touch , 2011, Neuron.

[17]  Alex S. Ferecskó,et al.  The fractions of short- and long-range connections in the visual cortex , 2009, Proceedings of the National Academy of Sciences.

[18]  Sonja Grün,et al.  Long-Term Modifications in Motor Cortical Dynamics Induced by Intensive Practice , 2009, The Journal of Neuroscience.

[19]  Moritz Helias,et al.  Echoes in correlated neural systems , 2012, 1207.0298.

[20]  Professor Moshe Abeles,et al.  Local Cortical Circuits , 1982, Studies of Brain Function.

[21]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[22]  J. Poulet,et al.  Internal brain state regulates membrane potential synchrony in barrel cortex of behaving mice , 2008, Nature.

[23]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[24]  Eric Shea-Brown,et al.  Motif statistics and spike correlations in neuronal networks , 2012, BMC Neuroscience.

[25]  John Hertz,et al.  Cross-Correlations in High-Conductance States of a Model Cortical Network , 2010, Neural Computation.

[26]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[27]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[28]  E. Bienenstock.  A model of neocortex , 1995 .

[29]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[30]  W. Singer,et al.  Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. , 2008, Journal of neurophysiology.

[31]  Xiao-Jing Wang,et al.  Decorrelation by Recurrent Inhibition in Heterogeneous Neural Circuits , 2011, Neural Computation.

[32]  J. Poulet,et al.  Synaptic Mechanisms Underlying Sparse Coding of Active Touch , 2011, Neuron.

[33]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[34]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[35]  D. Georgescauld.  Local Cortical Circuits, An Electrophysiological Study , 1983 .

[36]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[37]  Moritz Helias,et al.  Decorrelation of Neural-Network Activity by Inhibitory Feedback , 2012, PLoS Comput. Biol..

[38]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[39]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[40]  Stefan Rotter,et al.  Dependence of Neuronal Correlations on Filter Characteristics and Marginal Spike Train Statistics , 2008, Neural Computation.

[41]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[42]  Moritz Helias,et al.  Neuroinformatics Original Research Article a General and Efficient Method for Incorporating Precise Spike times in Globally Time-driven Simulations , 2010 .

[43]  N. Urban,et al.  Intrinsic biophysical diversity decorrelates neuronal firing while increasing information content , 2010, Nature Neuroscience.

[44]  B. Doiron,et al.  Short-term synaptic depression and stochastic vesicle dynamics reduce and shape neuronal correlations. , 2013, Journal of neurophysiology.

[45]  Robert Rosenbaum,et al.  Mechanisms That Modulate the Transfer of Spiking Correlations , 2011, Neural Computation.

[46]  Nicolas Brunel,et al.  How Connectivity, Background Activity, and Synaptic Properties Shape the Cross-Correlation between Spike Trains , 2009, The Journal of Neuroscience.

[47]  T. Wiesel,et al.  Clustered intrinsic connections in cat visual cortex , 1983, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[48]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[49]  Sonja Grün,et al.  Saccade-Related Modulations of Neuronal Excitability Support Synchrony of Visually Elicited Spikes , 2011, Cerebral cortex.

[50]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways , 2009, Biological Cybernetics.

[51]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[52]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[53]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[54]  Moritz Helias,et al.  A unified view on weakly correlated recurrent networks , 2013, Front. Comput. Neurosci..

[55]  R. Douglas,et al.  A Quantitative Map of the Circuit of Cat Primary Visual Cortex , 2004, The Journal of Neuroscience.

[56]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[57]  Carl van Vreeswijk,et al.  Temporal Correlations in Stochastic Networks of Spiking Neurons , 2002, Neural Computation.

[58]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[59]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[60]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[61]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[62]  Néstor Parga,et al.  ournal of Statistical Mechanics : J Theory and Experiment Towards a self-consistent description of irregular and asynchronous cortical activity , 2013 .

[63]  C. Petersen,et al.  Membrane Potential Dynamics of GABAergic Neurons in the Barrel Cortex of Behaving Mice , 2010, Neuron.

[64]  Brent Doiron,et al.  Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  Klas H. Pettersen,et al.  Modeling the Spatial Reach of the LFP , 2011, Neuron.

[66]  Stefan Rotter,et al.  Recurrent interactions in spiking networks with arbitrary topology. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[67]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[68]  Ad Aertsen,et al.  A modeler's view on the spatial structure of intrinsic horizontal connectivity in the neocortex , 2010, Progress in Neurobiology.