Learning and attention reveal a general relationship between neuronal variability and perception

The trial-to-trial response variability that is shared between pairs of neurons (termed spike count correlations1 or rSC) has been the subject of many recent studies largely because it might limit the amount of information that can be encoded by neuronal populations. Spike count correlations are flexible and change depending on task demands2-7. However, the relationship between correlated variability and information coding is a matter of current debate2-14. This debate has been difficult to resolve because testing the theoretical predictions would require simultaneous recordings from an experimentally unfeasible number of neurons. We hypothesized that if correlated variability limits population coding, then spike count correlations in visual cortex should a) covary with subjects’ performance on visually guided tasks and b) lie along the dimensions in neuronal population space that contain information that is used to guide behavior. We focused on two processes that are known to improve visual performance: visual attention, which allows observers to focus on important parts of a visual scene15-17, and perceptual learning, which slowly improves observers’ ability to discriminate specific, well-practiced stimuli18-20. Both attention and learning improve performance on visually guided tasks, but the two processes operate on very different timescales and are typically studied using different perceptual tasks. Here, by manipulating attention and learning in the same task, subjects, trials, and neuronal populations, we show that there is a single, robust relationship between correlated variability in populations of visual neurons and performance on a change-detection task. We also propose an explanation for the mystery of how correlated variability might affect performance: it is oriented along the dimensions of population space used by the animal to make perceptual decisions. Our results suggest that attention and learning affect the same aspects of the neuronal population activity in visual cortex, which may be responsible for learning- and attention-related improvements in behavioral performance. More generally, our study provides a framework for leveraging the activity of simultaneously recorded populations of neurons, cognitive factors, and perceptual decisions to understand the neuronal underpinnings of behavior.

[1]  Amy M. Ni,et al.  Microstimulation Reveals Limits in Detecting Different Signals from a Local Cortical Region , 2010, Current Biology.

[2]  John H. R. Maunsell,et al.  Physiological correlates of perceptual learning in monkey V1 and V2. , 2002, Journal of neurophysiology.

[3]  J. Maunsell,et al.  Attention improves performance primarily by reducing interneuronal correlations , 2009, Nature Neuroscience.

[4]  Marisa Carrasco,et al.  Attentional enhancement of spatial resolution: linking behavioural and neurophysiological evidence , 2013, Nature Reviews Neuroscience.

[5]  G. Orban,et al.  Learning to See the Difference Specifically Alters the Most Informative V4 Neurons , 2006, The Journal of Neuroscience.

[6]  J. Maunsell,et al.  Using Neuronal Populations to Study the Mechanisms Underlying Spatial and Feature Attention , 2011, Neuron.

[7]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[8]  Alexander S. Ecker,et al.  On the Structure of Neuronal Population Activity under Fluctuations in Attentional State , 2015, The Journal of Neuroscience.

[9]  Alexandre Pouget,et al.  Inferring decoding strategies for multiple correlated neural populations , 2017, bioRxiv.

[10]  G. DeAngelis,et al.  How Can Single Sensory Neurons Predict Behavior? , 2015, Neuron.

[11]  Takeo Watanabe,et al.  Advances in visual perceptual learning and plasticity , 2010, Nature Reviews Neuroscience.

[12]  C. Gilbert,et al.  Learning to Link Visual Contours , 2008, Neuron.

[13]  Timothy Q. Gentner,et al.  Associative Learning Enhances Population Coding by Inverting Interneuronal Correlation Patterns , 2013, Neuron.

[14]  S. E. Kwon,et al.  Sensory and decision-related activity propagate in a cortical feedback loop during touch perception , 2016, Nature Neuroscience.

[15]  Douglas A Ruff,et al.  Attention can increase or decrease spike count correlations between pairs of neurons depending on their role in a task , 2014, Nature Neuroscience.

[16]  Eero P. Simoncelli,et al.  Attention stabilizes the shared gain of V4 populations , 2015, eLife.

[17]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[18]  G. Orban,et al.  Practising orientation identification improves orientation coding in V1 neurons , 2001, Nature.

[19]  J. Maunsell,et al.  The Effect of Perceptual Learning on Neuronal Responses in Monkey Visual Area V4 , 2004, The Journal of Neuroscience.

[20]  Eero P. Simoncelli,et al.  Partitioning neuronal variability , 2014, Nature Neuroscience.

[21]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[22]  A. Pouget,et al.  Tuning curve sharpening for orientation selectivity: coding efficiency and the impact of correlations , 2004, Nature Neuroscience.

[23]  Si Wu,et al.  Perceptual training continuously refines neuronal population codes in primary visual cortex , 2014, Nature Neuroscience.

[24]  R. Krauzlis,et al.  Superior colliculus and visual spatial attention. , 2013, Annual review of neuroscience.

[25]  C. Gilbert,et al.  Learning to see: experience and attention in primary visual cortex , 2001, Nature Neuroscience.

[26]  D. Sagi Perceptual learning in Vision Research , 2011, Vision Research.

[27]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[28]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[29]  Douglas A Ruff,et al.  Global Cognitive Factors Modulate Correlated Response Variability between V4 Neurons , 2014, The Journal of Neuroscience.

[30]  Jude F. Mitchell,et al.  Spatial Attention Decorrelates Intrinsic Activity Fluctuations in Macaque Area V4 , 2009, Neuron.

[31]  Bruce G Cumming,et al.  Feedforward and Feedback Sources of Choice Probability in Neural Population Responses This Review Comes from a Themed Issue on Neurobiology of Cognitive Behavior Evidence for Feed-forward Models and Optimal Linear Readout? , 2022 .

[32]  Wallace Wang Using , 2019, Pro iPhone Development with Swift 5.

[33]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[34]  A. Pouget,et al.  Correlations and Neuronal Population Information. , 2016, Annual review of neuroscience.

[35]  D. Rubin,et al.  Comparing Correlated but Nonoverlapping Correlations , 1996 .

[36]  B. Cumming,et al.  Decision-Related Activity in Macaque V2 for Fine Disparity Discrimination Is Not Compatible with Optimal Linear Readout , 2017, The Journal of Neuroscience.

[37]  Yuka Sasaki,et al.  Perceptual learning: toward a comprehensive theory. , 2015, Annual review of psychology.

[38]  Douglas A Ruff,et al.  Attention Increases Spike Count Correlations between Visual Cortical Areas , 2016, The Journal of Neuroscience.

[39]  John H. R. Maunsell,et al.  Neuronal Mechanisms of Visual Attention. , 2015, Annual review of vision science.

[40]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[41]  Alexandre Pouget,et al.  Inferring decoding strategies for multiple correlated neural populations , 2017 .

[42]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[43]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.