Decorrelation of Neural-Network Activity by Inhibitory Feedback

Correlations in spike-train ensembles can seriously impair the encoding of information by their spatio-temporal structure. An inevitable source of correlation in finite neural networks is common presynaptic input to pairs of neurons. Recent studies demonstrate that spike correlations in recurrent neural networks are considerably smaller than expected based on the amount of shared presynaptic input. Here, we explain this observation by means of a linear network model and simulations of networks of leaky integrate-and-fire neurons. We show that inhibitory feedback efficiently suppresses pairwise correlations and, hence, population-rate fluctuations, thereby assigning inhibitory neurons the new role of active decorrelation. We quantify this decorrelation by comparing the responses of the intact recurrent network (feedback system) and systems where the statistics of the feedback channel is perturbed (feedforward system). Manipulations of the feedback statistics can lead to a significant increase in the power and coherence of the population response. In particular, neglecting correlations within the ensemble of feedback channels or between the external stimulus and the feedback amplifies population-rate fluctuations by orders of magnitude. The fluctuation suppression in homogeneous inhibitory networks is explained by a negative feedback loop in the one-dimensional dynamics of the compound activity. Similarly, a change of coordinates exposes an effective negative feedback loop in the compound dynamics of stable excitatory-inhibitory networks. The suppression of input correlations in finite networks is explained by the population averaged correlations in the linear network model: In purely inhibitory networks, shared-input correlations are canceled by negative spike-train correlations. In excitatory-inhibitory networks, spike-train correlations are typically positive. Here, the suppression of input correlations is not a result of the mere existence of correlations between excitatory (E) and inhibitory (I) neurons, but a consequence of a particular structure of correlations among the three possible pairings (EE, EI, II).

[1]  M. Timme,et al.  Stable irregular dynamics in complex neural networks. , 2007, Physical review letters.

[2]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[3]  N. Levan,et al.  Systems and signals , 1983 .

[4]  Joanna Pressley,et al.  Complementary responses to mean and variance modulations in the perfect integrate-and-fire model , 2009, Biological Cybernetics.

[5]  Sommers,et al.  Spectrum of large random asymmetric matrices. , 1988, Physical review letters.

[6]  Sven Jahnke,et al.  How Chaotic is the Balanced State? , 2009, Front. Comput. Neurosci..

[7]  Markus Diesmann,et al.  Activity dynamics and propagation of synchronous spiking in locally connected random networks , 2003, Biological Cybernetics.

[8]  Antonio Politi,et al.  Desynchronization in diluted neural networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Anders M. Dale,et al.  Estimation of Thalamocortical and Intracortical Network Models from Joint Thalamic Single-Electrode and Cortical Laminar-Electrode Recordings in the Rat Barrel System , 2009, PLoS Comput. Biol..

[10]  Lawrence Sirovich,et al.  Dynamics of Neuronal Populations: The Equilibrium Solution , 2000, SIAM J. Appl. Math..

[11]  Ad Aertsen,et al.  Dynamical Response Properties of Neocortical Neuron Ensembles: Multiplicative versus Additive Noise , 2009, The Journal of Neuroscience.

[12]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[13]  Néstor Parga,et al.  Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. , 2006, Physical review letters.

[14]  Lyle J. Graham,et al.  Efficient evaluation of neuron populations receiving colored-noise current based on a refractory density method. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Henry Markram,et al.  Multiquantal release underlies the distribution of synaptic effi cacies in the neocortex , 2022 .

[16]  John Hertz,et al.  Cross-Correlations in High-Conductance States of a Model Cortical Network , 2010, Neural Computation.

[17]  Moshe Abeles,et al.  On Embedding Synfire Chains in a Balanced Network , 2003, Neural Computation.

[18]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[19]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[20]  Fredric M. Wolf,et al.  Action Potential Onset Dynamics and the Response Speed of Neuronal Populations , 2004, Journal of Computational Neuroscience.

[21]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[22]  Martin Jacobsen,et al.  Exit times for a class of piecewise exponential Markov processes with two-sided jumps , 2007 .

[23]  F. Wolf,et al.  Dynamical entropy production in spiking neuron networks in the balanced state. , 2010, Physical review letters.

[24]  J. Knott.  The organization of behavior: A neuropsychological theory , 1951 .

[25]  Stefan Rotter,et al.  Recurrent interactions in spiking networks with arbitrary topology. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[26]  L Schimansky-Geier,et al.  Transmission of noise coded versus additive signals through a neuronal ensemble. , 2001, Physical review letters.

[27]  Stefan Rotter,et al.  Exact digital simulation of time-invariant linear systems with applications to neuronal modeling , 1999, Biological Cybernetics.

[28]  A. Hawkes.  Spectra of some self-exciting and mutually exciting point processes , 1971 .

[29]  Stefan Rotter,et al.  Dependence of Neuronal Correlations on Filter Characteristics and Marginal Spike Train Statistics , 2008, Neural Computation.

[30]  K. Harris,et al.  Laminar Structure of Spontaneous and Sensory-Evoked Population Activity in Auditory Cortex , 2009, Neuron.

[31]  Moritz Helias,et al.  Structural Plasticity Controlled by Calcium Based Correlation Detection , 2008, Frontiers Comput. Neurosci..

[32]  Bruce W. Knight,et al.  Dynamics of Encoding in a Population of Neurons , 1972, The Journal of general physiology.

[33]  Moshe Abeles,et al.  Memory Capacity of Balanced Networks , 2005, Neural Computation.

[34]  Moritz Helias,et al.  Equilibrium and response properties of the integrate-and-fi re neuron in discrete time , 2022 .

[35]  Robert A. Legenstein,et al.  2007 Special Issue: Edge of chaos and prediction of computational performance for neural circuit models , 2007 .

[36]  L Abbott.  Beyond the edge: Amplification and temporal integration by recurrent networks in the chaotic regime. , 2010 .

[37]  S. Scarpetta,et al.  Mathematical analysis and simulations of the neural circuit for locomotion in lampreys. , 2004, Physical review letters.

[38]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[39]  L. Abbott,et al.  Eigenvalue spectra of random matrices for neural networks. , 2006, Physical review letters.

[40]  Carl van Vreeswijk,et al.  Temporal Correlations in Stochastic Networks of Spiking Neurons , 2002, Neural Computation.

[41]  Stefano Fusi,et al.  The dynamical response properties of neocortical neurons to temporally modulated noisy inputs in vitro. , 2008, Cerebral cortex.

[42]  Kamiar Rahnama Rad,et al.  Mean-Field Approximations for Coupled Populations of Generalized Linear Model Spiking Neurons with Markov Refractoriness , 2009, Neural Computation.

[43]  Néstor Parga,et al.  Theory of Input Spike Auto- and Cross-Correlations and Their Effect on the Response of Spiking Neurons , 2007, Neural Computation.

[44]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[45]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[46]  Sommers,et al.  Chaos in random neural networks. , 1988, Physical review letters.

[47]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[48]  Matthieu Gilson,et al.  Spike-timing-dependent plasticity for neurons with recurrent connections , 2007, Biological Cybernetics.

[49]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[50]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[51]  Markus Diesmann,et al.  The ground state of cortical feed-forward networks , 2002, Neurocomputing.

[52]  Markus Diesmann,et al.  Consequences of realistic network size on the stability of embedded synfire chains , 2004, Neurocomputing.

[53]  Stan C. A. M. Gielen,et al.  Correlation Between Uncoupled Conductance-Based Integrate-and-Fire Neurons Due to Common and Synchronous Presynaptic Firing , 2001, Neural Computation.

[54]  Markus Diesmann,et al.  Implementing neuromodulated plasticity in distributed simulations , 1970 .

[55]  Frances S. Chance,et al.  Effects of synaptic noise and filtering on the frequency response of spiking neurons. , 2001, Physical review letters.

[56]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[57]  Nicolas Brunel,et al.  Phase diagrams of sparsely connected networks of excitatory and inhibitory spiking neurons , 2000, Neurocomputing.

[58]  Egon Wanke,et al.  Optimization of cortical hierarchies with continuous scales and ranges , 2009, NeuroImage.

[59]  S. Sharma,et al.  The Fokker-Planck Equation , 2010 .

[60]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[61]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[62]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[63]  Stefan Rotter,et al.  Measurement of variability dynamics in cortical spike trains , 2008, Journal of Neuroscience Methods.

[64]  Brent Doiron,et al.  Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[65]  Marc-Oliver Gewaltig,et al.  NEST (NEural Simulation Tool) , 2007, Scholarpedia.

[66]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[67]  B. Knight.  The Relationship between the Firing Rate of a Single Neuron and the Level of Activity in a Population of Neurons , 1972, The Journal of general physiology.

[68]  Chris Eliasmith,et al.  Neural populations can induce reliable postsynaptic currents without observable spike rate changes or precise spike timing. , 2007, Cerebral cortex.

[69]  Jean-Pascal Pfister,et al.  STDP in Oscillatory Recurrent Networks: Theoretical Conditions for Desynchronization and Applications to Deep Brain Stimulation , 2010, Front. Comput. Neurosci..

[70]  Jonathan Bell,et al.  Introduction to Theoretical Neurobiology. Volume 1: Linear Cable Theory and Dendritic Structure. Volume 2: Nonlinear and Stochastic Theories (Henry C. Tuckwell) , 1990, SIAM Rev..

[71]  Moritz Helias,et al.  Instantaneous Non-Linear Processing by Pulse-Coupled Threshold Units , 2010, PLoS Comput. Biol..

[72]  C. Petersen,et al.  Membrane Potential Dynamics of GABAergic Neurons in the Barrel Cortex of Behaving Mice , 2010, Neuron.

[73]  Markus Diesmann,et al.  The spread of rate and correlation in stationary cortical networks , 2003, Neurocomputing.

[74]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[75]  S. Lalley.  RENEWAL THEORY , 2014 .

[76]  D. Hansel,et al.  Temporal decorrelation of collective oscillations in neural networks with local inhibition and long-range excitation. , 2007, Physical review letters.

[77]  A. Siegert.  On the First Passage Time Probability Problem , 1951 .

[78]  Robert Rosenbaum,et al.  Mechanisms That Modulate the Transfer of Spiking Correlations , 2011, Neural Computation.

[79]  Matthieu Gilson,et al.  Emergence of network structure due to spike-timing-dependent plasticity in recurrent neuronal networks. I. Input selectivity–strengthening correlated input pathways , 2009, Biological Cybernetics.

[80]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[81]  K. Harris,et al.  Cortical state and attention , 2011, Nature Reviews Neuroscience.

[82]  K. Miller,et al.  LGN input to simple cells and contrast-invariant orientation tuning: an analysis. , 2002, Journal of neurophysiology.

[83]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[84]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[85]  E. Bienenstock.  A model of neocortex , 1995 .

[86]  Rupert Swarbrick,et al.  Firing-rate response of a neuron receiving excitatory and inhibitory synaptic shot noise. , 2010, Physical review letters.

[87]  Michael A. Buice,et al.  Systematic Fluctuation Expansion for Neural Network Activity Equations , 2009, Neural Computation.

[88]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[89]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[90]  Gaute T. Einevoll,et al.  Rate Dynamics of Leaky Integrate-and-Fire Neurons with Strong Synapses , 2010, Front. Comput. Neurosci..

[91]  Stefan Rotter,et al.  Correlations and Population Dynamics in Cortical Networks , 2008, Neural Computation.

[92]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[93]  A. Hawkes.  Point Spectra of Some Mutually Exciting Point Processes , 1971 .