Understanding multivariate brain activity: Evaluating the effect of voxelwise noise correlations on population codes in functional magnetic resonance imaging

Previous studies have shown that neurons exhibit trial-by-trial correlated activity and that such noise correlations (NCs) greatly impact the accuracy of population codes. Meanwhile, multivariate pattern analysis (MVPA) has become a mainstream approach in functional magnetic resonance imaging (fMRI), but it remains unclear how NCs between voxels influence MVPA performance. Here, we tackle this issue by combining voxel-encoding modeling and MVPA. We focus on a well-established form of NC, tuning-compatible noise correlation (TCNC), whose sign and magnitude are systematically related to the tuning similarity between two units. We first replicate the classical finding that TCNCs impair population codes in a standard neuronal population. We then extend our analysis to fMRI data, and show that voxelwise TCNCs do not impair and can even improve MVPA performance when TCNCs are strong or the number of voxels is large. We also confirm these results using standard information-theoretic analyses in computational neuroscience. Further computational analyses demonstrate that the discrepancy between the effect of TCNCs in neuronal and voxel populations can be explained by tuning heterogeneity and pool sizes. Our results provide a theoretical foundation to understand the effect of correlated activity on population codes in macroscopic fMRI data. Our results also suggest that future fMRI research could benefit from a closer examination of the correlational structure of multivariate responses, which is not directly revealed by conventional MVPA approaches.

[1]  Sang-Hun Lee,et al.  Stimulus-Tuned Structure of Correlated fMRI Activity in Human Visual Cortex , 2017, Cerebral cortex.

[2]  Xin Huang,et al.  Noise correlations in cortical area MT and their potential impact on trial-by-trial variation in the direction and speed of smooth-pursuit eye movements. , 2009, Journal of neurophysiology.

[3]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[4]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[5]  H. Sompolinsky,et al.  Population coding in neuronal systems with correlated noise. , 2001, Physical review. E, Statistical, nonlinear, and soft matter physics.

[6]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[7]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[8]  Janneke F. M. Jehee,et al.  Modeling correlated noise is necessary to decode uncertainty , 2017, NeuroImage.

[9]  Adrian G Bondy,et al.  Feedback Determines the Structure of Correlated Variability in Primary Visual Cortex , 2016, Nature Neuroscience.

[10]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[11]  D. Butts,et al.  Tuning Curves, Neuronal Variability, and Sensory Coding , 2006, PLoS biology.

[12]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[13]  G Jansen,et al.  [The effect of noise]. , 1981, Zentralblatt fur Arbeitsmedizin, Arbeitsschutz, Prophylaxe und Ergonomie.

[14]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[15]  Richard D. Lange,et al.  A probabilistic population code based on neural samples , 2018, NeurIPS.

[16]  David D. Cox,et al.  Functional magnetic resonance imaging (fMRI) “brain reading”: detecting and classifying distributed patterns of fMRI activity in human visual cortex , 2003, NeuroImage.

[17]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[18]  Daeyeol Lee,et al.  Neural Noise and Movement-Related Codes in the Macaque Supplementary Motor Area , 2003, The Journal of Neuroscience.

[19]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[20]  Bharat B. Biswal,et al.  Psychophysiological interaction and beta series correlation for task modulated connectivity: modeling considerations and their relationships , 2018 .

[21]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[23]  Takeshi Norimatsu,et al.  Encoding and Decoding , 2016 .

[24]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[25]  Wei Ji Ma,et al.  Probabilistic brains: knowns and , 2013 .

[26]  Justin L. Gardner,et al.  Cortical Correlates of Human Motion Perception Biases , 2014, The Journal of Neuroscience.

[27]  J. S. Guntupalli,et al.  Decoding neural representational spaces using multivariate pattern analysis. , 2014, Annual review of neuroscience.

[28]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[29]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[30]  Jonathan D. Cohen,et al.  Noise correlations in the human brain and their impact on pattern classification , 2017, PLoS Comput. Biol..

[31]  Simon Barthelmé,et al.  Flexible mechanisms underlie the evaluation of visual confidence , 2010, Proceedings of the National Academy of Sciences.

[32]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[33]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[34]  Christian W. Eurich,et al.  Representational Accuracy of Stochastic Neural Populations , 2002, Neural Computation.

[35]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[36]  P. Goldman-Rakic,et al.  Correlated discharges among putative pyramidal neurons and interneurons in the primate prefrontal cortex. , 2002, Journal of neurophysiology.

[37]  A. P. Georgopoulos,et al.  Variability and Correlated Noise in the Discharge of Neurons in Motor and Parietal Areas of the Primate Cortex , 1998, The Journal of Neuroscience.

[38]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Janneke F. M. Jehee,et al.  Sensory uncertainty decoded from visual cortex predicts behavior , 2015, Nature Neuroscience.

[40]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[41]  A. B. Bonds,et al.  Relationship between spontaneous and evoked spike-time correlations in primate visual cortex. , 2009, Journal of neurophysiology.

[42]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[43]  Thomas Naselaris,et al.  Resolving Ambiguities of MVPA Using Explicit Models of Representation , 2015, Trends in Cognitive Sciences.

[44]  Bharat B. Biswal,et al.  Understanding psychophysiological interaction and its relations to beta series correlation , 2019 .

[45]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[46]  M. Carandini,et al.  The Nature of Shared Cortical Variability , 2015, Neuron.

[47]  Michael S. Pratte,et al.  Decoding patterns of human brain activity. , 2012, Annual review of psychology.

[48]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[49]  Valentin Dragoi,et al.  Adaptive coding of visual information in neural populations , 2008, Nature.

[50]  Aapo Hyvärinen,et al.  Interpreting Neural Response Variability as Monte Carlo Sampling of the Posterior , 2002, NIPS.

[51]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[52]  Nicolas Brunel,et al.  Mutual Information, Fisher Information, and Population Coding , 1998, Neural Computation.

[53]  József Fiser,et al.  Neural Variability and Sampling-Based Probabilistic Representations in the Visual Cortex , 2016, Neuron.