A Causal Perspective on the Analysis of Signal and Noise Correlations and Their Role in Population Coding

The role of correlations between neuronal responses is crucial to understanding the neural code. A framework used to study this role comprises a breakdown of the mutual information between stimuli and responses into terms that aim to account for different coding modalities and the distinction between different notions of independence. Here we complete the list of types of independence and distinguish activity independence (related to total correlations), conditional independence (related to noise correlations), signal independence (related to signal correlations), coding independence (related to information transmission), and information independence (related to redundancy). For each type, we identify the probabilistic criterion that defines it, indicate the information-theoretic measure used as statistic to test for it, and provide a graphical criterion to recognize the causal configurations of stimuli and responses that lead to its existence. Using this causal analysis, we first provide sufficiency conditions relating these types. Second, we differentiate the use of the measures as statistics to test for the existence of independence from their use for quantification. We indicate that signal and noise correlation cannot be quantified separately. Third, we explicitly define alternative system configurations used to construct the measures, in which noise correlations or noise and signal correlations are eliminated. Accordingly, we examine which measures are meaningful only as a comparison across configurations and which ones provide a characterization of the actually observed responses without resorting to other configurations. Fourth, we compare the commonly used nonparametric approach to eliminate noise correlations with a functional (model-based) approach, showing that the former approach does not remove those effects of noise correlations captured by the tuning properties of the individual neurons, and implies nonlocal causal structure manipulations. These results improve the interpretation of the measures on the framework and help in understanding how to apply it to analyze the role of correlations.

[1]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[2]  Masato Okada,et al.  Information Loss Associated with Imperfect Observation and Mismatched Decoding , 2011, Front. Comput. Neurosci..

[3]  Brent Doiron,et al.  Non-classical receptive field mediates switch in a sensory neuron's frequency tuning , 2003, Nature.

[4]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[5]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[6]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[7]  M. Diamond,et al.  The Role of Spike Timing in the Coding of Stimulus Location in Rat Somatosensory Cortex , 2001, Neuron.

[8]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[9]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.

[10]  D. Chicharro,et al.  On the spectral formulation of Granger causality , 2011, Biological Cybernetics.

[11]  Peter Dayan,et al.  The Effect of Correlated Variability on the Accuracy of a Population Code , 1999, Neural Computation.

[12]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[13]  Alexander S. Ecker,et al.  The effect of noise correlations in populations of diversely tuned neurons , 2011 .

[14]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[15]  J. Victor.  Analyzing receptive fields, classification images and functional images: challenges with opportunities for synergy , 2005, Nature Neuroscience.

[16]  Peter E. Latham,et al.  Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't , 2008, PLoS Comput. Biol..

[17]  F. Mechler,et al.  Independent and Redundant Information in Nearby Cortical Neurons , 2001, Science.

[18]  O. Barak,et al.  Grid cells correlation structure suggests organized feedforward projections into superficial layers of the medial entorhinal cortex , 2015, Hippocampus.

[19]  Arthur Gretton,et al.  Low-Frequency Local Field Potentials and Spikes in Primary Visual Cortex Convey Independent Visual Information , 2008, The Journal of Neuroscience.

[20]  Daniel Chicharro,et al.  What can spike train distances tell us about the neural code? , 2011, Journal of Neuroscience Methods.

[21]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[22]  James P. Crutchfield,et al.  Intersection Information Based on Common Randomness , 2013, Entropy.

[23]  Michael Satosi Watanabe,et al.  Information Theoretical Analysis of Multivariate Correlation , 1960, IBM J. Res. Dev..

[24]  P. Latham,et al.  Synergy, Redundancy, and Independence in Population Codes, Revisited , 2005, The Journal of Neuroscience.

[25]  L. Paninski,et al.  Information about movement direction obtained from synchronous activity of motor cortical neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[26]  John P. Miller,et al.  Temporal encoding in nervous systems: A rigorous definition , 1995, Journal of Computational Neuroscience.

[27]  Andreas Bartels,et al.  A novel test to determine the significance of neural selectivity to single and multiple potentially correlated stimulus features , 2012, Journal of Neuroscience Methods.

[28]  Stefano Panzeri,et al.  On Decoding the Responses of a Population of Neurons from Short Time Windows , 1999, Neural Computation.

[29]  Jonathan D Victor,et al.  Spike train metrics , 2005, Current Opinion in Neurobiology.

[30]  Michael J. Berry,et al.  Network information and connected correlations. , 2003, Physical review letters.

[31]  Si Wu,et al.  Population Coding with Correlation and an Unfaithful Model , 2001, Neural Computation.

[32]  L. Martinez,et al.  Circuits that build visual cortical receptive fields , 2006, Trends in Neurosciences.

[33]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[34]  Randall D. Beer,et al.  Nonnegative Decomposition of Multivariate Information , 2010, ArXiv.

[35]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  Stefano Panzeri,et al.  Coding of Sensory Signals by Neuronal Populations: The Role of Correlated Activity , 2003, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[37]  P. Spirtes,et al.  Causation, Prediction, and Search, 2nd Edition , 2001 .

[38]  R. Romo,et al.  Correlated Neuronal Discharges that Increase Coding Efficiency during Perceptual Discrimination , 2003, Neuron.

[39]  William J. McGill.  Multivariate information transmission , 1954, Trans. IRE Prof. Group Inf. Theory.

[40]  Christian K. Machens,et al.  Representation of Acoustic Communication Signals by Insect Auditory Receptor Neurons , 2001, The Journal of Neuroscience.

[41]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[42]  Yury Shtyrov,et al.  Fast reconfiguration of high-frequency brain networks in response to surprising changes in auditory input. , 2012, Journal of neurophysiology.

[43]  Shun-ichi Amari,et al.  Information-Geometric Measure for Neural Spikes , 2002, Neural Computation.

[44]  Eric Shea-Brown,et al.  Stimulus-Dependent Correlations and Population Codes , 2008, Neural Computation.

[45]  TJ Gawne,et al.  How independent are the messages carried by adjacent inferior temporal cortical neurons? , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[46]  J. Fritz,et al.  Rapid task-related plasticity of spectrotemporal receptive fields in primary auditory cortex , 2003, Nature Neuroscience.

[47]  Michael J. Berry,et al.  Low error discrimination using a correlated population code. , 2012, Journal of neurophysiology.

[48]  Daeyeol Lee,et al.  Effects of noise correlations on information encoding and decoding. , 2006, Journal of neurophysiology.

[49]  Yuhong Yang.  Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[50]  Steven Reece,et al.  An information theoretic approach to the contributions of the firing rates and the correlations between the firing of neurons. , 2003, Journal of neurophysiology.

[51]  R. Shapley,et al.  An egalitarian network model for the emergence of simple and complex cells in visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[52]  Sheila Nirenberg,et al.  Decoding neuronal spike trains: How important are correlations? , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Stefano Panzeri,et al.  Information-theoretic methods for studying population codes , 2010, Neural Networks.

[54]  Yang Dan,et al.  Dynamic Modification of Cortical Orientation Tuning Mediated by Recurrent Connections , 2002, Neuron.

[55]  Daniel Chicharro,et al.  Algorithms of causal inference for the analysis of effective connectivity among brain regions , 2014, Front. Neuroinform..

[56]  Kazuya Ishibashi,et al.  Mismatched Decoding in the Brain , 2010, The Journal of Neuroscience.

[57]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[58]  P. Latham,et al.  Role of correlations in population coding , 2011, 1109.6524.

[59]  L. F. Abbott,et al.  Generating Coherent Patterns of Activity from Chaotic Neural Networks , 2009, Neuron.

[60]  M. Diamond,et al.  Population Coding of Stimulus Location in Rat Somatosensory Cortex , 2001, Neuron.

[61]  T. Shibasaki,et al.  Retinal ganglion cells act largely as independent encoders , 2001 .

[62]  Michael J. Berry,et al.  Spin glass models for a network of real neurons , 2009, 0912.5409.

[63]  Y. Dan,et al.  Coding of visual information by precisely correlated spikes in the lateral geniculate nucleus , 1998, Nature Neuroscience.

[64]  A. Ledberg,et al.  When two become one: the limits of causality analysis of brain dynamics. , 2012, PloS one.

[65]  Jorma Rissanen,et al.  Measures of mutual and causal dependence between two time series , 1987, IEEE Trans. Inf. Theory.

[66]  A. Ledberg,et al.  Framework to study dynamic dependencies in networks of interacting processes. , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[67]  M. Young,et al.  Correlations, feature‐binding and population coding in primary visual cortex , 2003, Neuroreport.

[68]  Stefano Panzeri,et al.  A critical assessment of different measures of the information carried by correlated neuronal firing. , 2002, Bio Systems.

[69]  R. Quiroga,et al.  Principles of neural coding. , 2013 .

[70]  William Bialek,et al.  Synergy in a Neural Code , 2000, Neural Computation.

[71]  Karl J. Friston,et al.  Effective connectivity: Influence, causality and biophysical modeling , 2011, NeuroImage.

[72]  Stefano Panzeri,et al.  A Unified Approach to the Study of Temporal, Correlational, and Rate Coding , 1999, Neural Computation.

[73]  Rasmus S. Petersen,et al.  Efficient population coding of naturalistic whisker motion in the ventro-posterior medial thalamus based on precise spike timing , 2015, Front. Neural Circuits.

[74]  R. Segev,et al.  The Architecture of Functional Interaction Networks in the Retina , 2011, The Journal of Neuroscience.

[75]  F. Rieke,et al.  Noise correlations improve response fidelity and stimulus encoding , 2010, Nature.

[76]  N. Logothetis,et al.  On the use of information theory for the analysis of the relationship between neural and imaging signals. , 2008, Magnetic resonance imaging.

[77]  John M. Beggs,et al.  A Maximum Entropy Model Applied to Spatial and Temporal Correlations from Cortical Networks In Vitro , 2008, The Journal of Neuroscience.

[78]  U. Ernst,et al.  Perceptual Inference Predicts Contextual Modulations of Sensory Responses , 2012, The Journal of Neuroscience.

[79]  William B. Kristan,et al.  Quantifying Stimulus Discriminability: A Comparison of Information Theory and Ideal Observer Analysis , 2005, Neural Computation.

[80]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[81]  Sergio Cerutti,et al.  Mutual Information Expansion for Studying the Role of Correlations in Population Codes: How Important Are Autocorrelations , 2008, Neural Computation.

[82]  G. Kaplan,et al.  On Information Rates for Mismatched Decoders , 1993, Proceedings. IEEE International Symposium on Information Theory.

[83]  Eero P. Simoncelli,et al.  Modeling the Impact of Common Noise Inputs on the Network Activity of Retinal Ganglion Cells Action Editor: Brent Doiron , 2022 .

[84]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[85]  S. Panzeri,et al.  An exact method to quantify the information transmitted by different mechanisms of correlational coding. , 2003, Network.

[86]  Michael J. Berry,et al.  Synergy, Redundancy, and Independence in Population Codes , 2003, The Journal of Neuroscience.

[87]  Dimitri Van De Ville,et al.  Dynamic reconfiguration of human brain functional networks through neurofeedback , 2013, NeuroImage.

[88]  Shun-ichi Amari,et al.  Correlation and Independence in the Neural Code , 2006, Neural Computation.

[89]  D. Tervo,et al.  Rapidly inducible, genetically targeted inactivation of neural and synaptic activity in vivo , 2007, Current Opinion in Neurobiology.