Internally generated population activity in cortical networks hinders information transmission

How neuronal variability impacts neuronal codes is a central question in systems neuroscience, often with complex and model dependent answers. Most population models are parametric, with a tacitly assumed structure of neuronal tuning and population-wide variability. While these models provide key insights, they purposely divorce any mechanistic relationship between trial average and trial variable neuronal activity. By contrast, circuit based models produce activity with response statistics that are reflection of the underlying circuit structure, and thus any relations between trial averaged and trial variable activity are emergent rather than assumed. In this work, we study information transfer in networks of spatially ordered spiking neuron models with strong excitatory and inhibitory interactions, capable of producing rich population-wide neuronal variability. Motivated by work in the visual system we embed a columnar stimulus orientation map in the network and measure the population estimation of an orientated input. We show that the spatial structure of feedforward and recurrent connectivity are critical determinants for population code performance. In particular, when network wiring supports stable firing rate activity then with a sufficiently large number of decoded neurons all available stimulus information is transmitted. However, if the inhibitory projections place network activity in a pattern forming regime then the population-wide dynamics compromise information flow. In total, network connectivity determines both the stimulus tuning as well as internally generated population-wide fluctuations and thereby dictates population code performance in complicated ways where modeling efforts provide essential understanding.

[1]  Matthias Kaschube,et al.  The development of cortical circuits for motion discrimination , 2014, Nature Neuroscience.

[2]  Eric Shea-Brown,et al.  Correlation and synchrony transfer in integrate-and-fire neurons: basic properties and consequences for coding. , 2008, Physical review letters.

[3]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[4]  F. Wolf,et al.  Dynamic Flux Tubes Form Reservoirs of Stability in Neuronal Circuits , 2012 .

[5]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[6]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[7]  Brent Doiron,et al.  Theory of oscillatory firing induced by spatially correlated noise and delayed inhibitory feedback. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[8]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[9]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[10]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[11]  Amy M. Ni,et al.  Cognition as a Window into Neuronal Population Space. , 2018, Annual review of neuroscience.

[12]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[13]  B. Doiron,et al.  Balanced Networks of Spiking Neurons with Spatially Dependent Recurrent Connections , 2013, 1308.6014.

[14]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[15]  Pulin Gong,et al.  Propagating Waves Can Explain Irregular Neural Dynamics , 2015, The Journal of Neuroscience.

[16]  Eric Shea-Brown,et al.  From the statistics of connectivity to the statistics of spike times in neuronal networks , 2017, Current Opinion in Neurobiology.

[17]  Alexandre Pouget,et al.  Measuring Fisher Information Accurately in Correlated Neural Populations , 2015, PLoS Comput. Biol..

[18]  A. Pouget,et al.  Perceptual learning as improved probabilistic inference in early sensory areas , 2011, Nature Neuroscience.

[19]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[20]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[21]  A. Reyes Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro , 2003, Nature Neuroscience.

[22]  Yoram Burak,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2008, PLoS Comput. Biol..

[23]  M. Cohen,et al.  Low rank mechanisms underlying flexible visual representations , 2019, Proceedings of the National Academy of Sciences.

[24]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[25]  Byron M. Yu,et al.  Distinct population codes for attention in the absence and presence of visual stimulation , 2018, Nature Communications.

[26]  Z L Lu,et al.  Perceptual learning reflects external noise filtering and internal noise reduction through channel reweighting. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[27]  M. Sur,et al.  Invariant computations in local cortical networks with balanced excitation and inhibition , 2005, Nature Neuroscience.

[28]  Brent Doiron,et al.  Scaling Properties of Dimensionality Reduction for Neural Populations and Network Models , 2016, PLoS Comput. Biol..

[29]  D. Ferster,et al.  Neural mechanisms of orientation selectivity in the visual cortex. , 2000, Annual review of neuroscience.

[30]  Maxwell H. Turner,et al.  Direction-Selective Circuits Shape Noise to Ensure a Precise Population Code , 2016, Neuron.

[31]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[32]  Christian K. Machens,et al.  Variability in neural activity and behavior , 2014, Current Opinion in Neurobiology.

[33]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[34]  J. Maunsell,et al.  Attention-related changes in correlated neuronal activity arise from normalization mechanisms , 2017, Nature Neuroscience.

[35]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[36]  Eero P. Simoncelli,et al.  Attention stabilizes the shared gain of V4 populations , 2015, eLife.

[37]  K. Harris,et al.  Gating of Sensory Input by Spontaneous Cortical Activity , 2013, The Journal of Neuroscience.

[38]  R. Shapley,et al.  Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence , 2002, The Journal of Neuroscience.

[39]  M. Cross,et al.  Pattern formation outside of equilibrium , 1993 .

[40]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[41]  Robert Rosenbaum,et al.  Spatiotemporal Dynamics and Reliable Computations in Recurrent Spiking Neural Networks. , 2016, Physical review letters.

[42]  Cody Baker,et al.  Correlated states in balanced neuronal networks. , 2019, Physical review. E.

[43]  Brent Doiron,et al.  Circuit-based models of shared variability in cortical networks , 2017, bioRxiv.

[44]  Sompolinsky,et al.  Theory of correlations in stochastic neural networks. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[45]  Martin Vinck,et al.  Arousal and Locomotion Make Distinct Contributions to Cortical Activity Patterns and Visual Encoding , 2014, Neuron.

[46]  Brent Doiron,et al.  Circuit Models of Low-Dimensional Shared Variability in Cortical Networks , 2019, Neuron.

[47]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[48]  Matthew R Whiteway,et al.  Revealing unobserved factors underlying cortical activity using a rectified latent variable model applied to neural population recordings , 2016, bioRxiv.

[49]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[50]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[51]  Nicolas Brunel,et al.  Mutual Information, Fisher Information, and Population Coding , 1998, Neural Computation.

[52]  Amy M. Ni,et al.  Learning and attention reveal a general relationship between population activity and behavior , 2018, Science.

[53]  József Fiser,et al.  Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex , 2016, Neuron.

[54]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[55]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[56]  Eero P. Simoncelli,et al.  Author response: Attention stabilizes the shared gain of V4 populations , 2015 .

[57]  Peter E. Latham,et al.  Robust information propagation through noisy neural circuits , 2016, PLoS Comput. Biol..

[58]  Kenneth D. Harris,et al.  Excitatory and inhibitory intracortical circuits for orientation and direction selectivity , 2019, bioRxiv.

[59]  Brent Doiron,et al.  Attentional modulation of neuronal variability in circuit models of cortex , 2017, eLife.

[60]  Alexandre Pouget,et al.  Insights from a Simple Expression for Linear Fisher Information in a Recurrently Connected Population of Spiking Neurons , 2011, Neural Computation.

[61]  Rava Azeredo da Silveira,et al.  Structures of Neural Correlation and How They Favor Coding , 2016, Neuron.

[62]  Eric Shea-Brown,et al.  Stimulus-Dependent Correlations and Population Codes , 2008, Neural Computation.

[63]  Haim Sompolinsky,et al.  Coherent chaos in a recurrent neural network with structured connectivity , 2018, PLoS Comput. Biol..

[64]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[65]  Sonja Grün,et al.  Computational Neuroscience: Mathematical and Statistical Perspectives. , 2018, Annual review of statistics and its application.

[66]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[67]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[68]  M. Carandini,et al.  Cortical State Determines Global Variability and Correlations in Visual Cortex , 2015, The Journal of Neuroscience.

[69]  Tatiana A. Engel,et al.  New perspectives on dimensionality and variability from large-scale cortical dynamics , 2019, Current Opinion in Neurobiology.

[70]  Nicolas Brunel,et al.  Dynamics of Networks of Excitatory and Inhibitory Neurons in Response to Time-Dependent Inputs , 2011, Front. Comput. Neurosci..

[71]  Francesca Mastrogiuseppe,et al.  Linking Connectivity, Dynamics, and Computations in Low-Rank Recurrent Neural Networks , 2017, Neuron.

[72]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[73]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[74]  B. Dosher,et al.  Mechanisms of perceptual learning , 1999, Vision Research.

[75]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[76]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[78]  Stephen Coombes,et al.  Waves, bumps, and patterns in neural field theories , 2005, Biological Cybernetics.

[79]  Jude F. Mitchell,et al.  Spatial Attention Decorrelates Intrinsic Activity Fluctuations in Macaque Area V4 , 2009, Neuron.

[80]  Mamiko Niwa,et al.  Task Engagement Selectively Modulates Neural Correlations in Primary Auditory Cortex , 2015, The Journal of Neuroscience.

[81]  Nicholas A. Steinmetz,et al.  Spontaneous behaviors drive multidimensional, brainwide activity , 2019, Science.

[82]  Matthew T. Kaufman,et al.  Single-trial neural dynamics are dominated by richly varied movements , 2019, Nature Neuroscience.

[83]  M. A. Smith,et al.  The spatial structure of correlated neuronal variability , 2016, Nature Neuroscience.

[84]  D. Hansel,et al.  On the Distribution of Firing Rates in Networks of Cortical Neurons , 2011, The Journal of Neuroscience.

[85]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[86]  Alexander S. Ecker,et al.  On the Structure of Neuronal Population Activity under Fluctuations in Attentional State , 2015, The Journal of Neuroscience.

[87]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[88]  Terrence J. Sejnowski,et al.  Cortical travelling waves: mechanisms and computational principles , 2018, Nature Reviews Neuroscience.

[89]  Alexandre Pouget,et al.  Origin of information-limiting noise correlations , 2015, Proceedings of the National Academy of Sciences.

[90]  Guillaume Hennequin,et al.  The Dynamical Regime of Sensory Cortex: Stable Dynamics around a Single Stimulus-Tuned Attractor Account for Patterns of Noise Variability , 2018, Neuron.

[91]  L. F. Abbott,et al.  A Complex-Valued Firing-Rate Model That Approximates the Dynamics of Spiking Networks , 2013, PLoS Comput. Biol..

[92]  Kenneth D Harris,et al.  Stochastic transitions into silence cause noise correlations in cortical circuits , 2015, Proceedings of the National Academy of Sciences.

[93]  Haim Sompolinsky,et al.  Patterns of Ongoing Activity and the Functional Architecture of the Primary Visual Cortex , 2004, Neuron.

[94]  Si Wu,et al.  Information processing in a neuron ensemble with the multiplicative correlation structure , 2004, Neural Networks.

[95]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[96]  Moritz Helias,et al.  How pattern formation in ring networks of excitatory and inhibitory spiking neurons depends on the input current regime , 2013, Front. Comput. Neurosci..

[97]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[98]  Carl van Vreeswijk,et al.  Strength of Correlations in Strongly Recurrent Neuronal Networks , 2018, Physical Review X.

[99]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[100]  Jaime de la Rocha,et al.  Supplementary Information for the article ‘ Correlation between neural spike trains increases with firing rate ’ , 2007 .

[101]  D. Coppola,et al.  Universality in the Evolution of Orientation Columns in the Visual Cortex , 2010, Science.

[102]  George H. Denfield,et al.  Pupil Fluctuations Track Fast Switching of Cortical States during Quiet Wakefulness , 2014, Neuron.

[103]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[104]  Mark C. W. van Rossum,et al.  Transmission of Population-Coded Information , 2012, Neural Computation.