Stimulus-choice (mis)alignment in primate area MT

For stimuli near perceptual threshold, the trial-by-trial activity of single neurons in many sensory areas is correlated with the animal’s perceptual report. This phenomenon has often been attributed to feedforward readout of the neural activity by the downstream decision-making circuits. The interpretation of choice-correlated activity is quite ambiguous, but its meaning can be better understood in the light of population-wide correlations among sensory neurons. Using a statistical nonlinear dimensionality reduction technique on single-trial ensemble recordings from the middle temporal (MT) area during perceptual-decision-making, we extracted low-dimensional latent factors that captured the population-wide fluctuations. We dissected the particular contributions of sensory-driven versus choice-correlated activity in the low-dimensional population code. We found that the latent factors strongly encoded the direction of the stimulus in single dimension with a temporal signature similar to that of single MT neurons. If the downstream circuit were optimally utilizing this information, choice-correlated signals should be aligned with this stimulus encoding dimension. Surprisingly, we found that a large component of the choice information resides in the subspace orthogonal to the stimulus representation inconsistent with the optimal readout view. This misaligned choice information allows the feedforward sensory information to coexist with the decision-making process. The time course of these signals suggest that this misaligned contribution likely is feedback from the downstream areas. We hypothesize that this non-corrupting choice-correlated feedback might be related to learning or reinforcing sensory-motor relations in the sensory population.

[1]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[2]  Eero P. Simoncelli,et al.  Dissociation of Choice Formation and Choice-Correlated Activity in Macaque Visual Cortex , 2017, The Journal of Neuroscience.

[3]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[4]  Michele A Basso,et al.  Insights into decision making using choice probability. , 2015, Journal of neurophysiology.

[5]  F. V. Smith,et al.  The relative attraction for the domestic chick of combinations of stimuli in different sensory modalities , 1963 .

[6]  A. Pouget,et al.  Information-limiting correlations , 2014, Nature Neuroscience.

[7]  Yong Gu,et al.  Perceptual Learning Reduces Interneuronal Correlations in Macaque Visual Cortex , 2011, Neuron.

[8]  Il Memming Park,et al.  Functional dissection of signal and noise in MT and LIP during decision-making , 2017, Nature Neuroscience.

[9]  Albert Compte,et al.  Sensory integration dynamics in a hierarchical network explains choice probabilities in cortical area MT , 2015, Nature Communications.

[10]  Yuan Zhao,et al.  Variational Latent Gaussian Process for Recovering Single-Trial Dynamics from Population Spike Trains , 2016, Neural Computation.

[11]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[12]  Ramon Bartolo,et al.  Information-Limiting Correlations in Large Neural Populations , 2020, The Journal of Neuroscience.

[13]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[14]  G. DeAngelis,et al.  Linking Neural Representation to Function in Stereoscopic Depth Perception: Roles of the Middle Temporal Area in Coarse versus Fine Disparity Discrimination , 2006, The Journal of Neuroscience.

[15]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[16]  Bruce G Cumming,et al.  Feedforward and Feedback Sources of Choice Probability in Neural Population Responses This Review Comes from a Themed Issue on Neurobiology of Cognitive Behavior Evidence for Feed-forward Models and Optimal Linear Readout? , 2022 .

[17]  Naoshige Uchida,et al.  Demixed principal component analysis of neural population data , 2014, eLife.

[18]  J. Gold,et al.  Representation of a perceptual decision in developing oculomotor commands , 2000, Nature.

[19]  Jonathan W Pillow,et al.  A simple linear readout of MT supports motion direction-discrimination performance. , 2019, Journal of neurophysiology.

[20]  Jan Drugowitsch,et al.  Scaling of information in large neural populations reveals signatures of information-limiting correlations , 2020, bioRxiv.

[21]  Richard D. Lange,et al.  Characterizing and interpreting the influence of internal variables on sensory activity , 2017, Current Opinion in Neurobiology.

[22]  Jakob H Macke,et al.  Can Serial Dependencies in Choices and Neural Activity Explain Choice Probabilities? , 2017, The Journal of Neuroscience.

[23]  Il Memming Park,et al.  Bayesian Spike-Triggered Covariance Analysis , 2011, NIPS.

[24]  B. Cumming,et al.  Decision-related activity in sensory neurons reflects more than a neuron’s causal effect , 2009, Nature.

[25]  Matthew T. Kaufman,et al.  Supplementary materials for : Cortical activity in the null space : permitting preparation without movement , 2014 .

[26]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[27]  W. Newsome,et al.  Context-Dependent Changes in Functional Circuitry in Visual Area MT , 2008, Neuron.

[28]  Adrian G Bondy,et al.  Feedback Determines the Structure of Correlated Variability in Primary Visual Cortex , 2016, Nature Neuroscience.

[29]  P. Latham,et al.  Cracking the Neural Code for Sensory Perception by Combining Statistics, Intervention, and Behavior , 2017, Neuron.

[30]  G. DeAngelis,et al.  How Can Single Sensory Neurons Predict Behavior? , 2015, Neuron.

[31]  Mariano Sigman,et al.  Frontiers in Computational Neuroscience Computational Neuroscience Neurophysiological Bases of Exponential Sensory Decay and Top-down Memory Retrieval: a Model , 2022 .

[32]  David J. Freedman,et al.  Choice-correlated activity fluctuations underlie learning of neuronal category representation , 2015, Nature Communications.

[33]  Surya Ganguli,et al.  A theory of multineuronal dimensionality, dynamics and measurement , 2017, bioRxiv.

[34]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[35]  John P. Cunningham,et al.  Gaussian-process factor analysis for low-dimensional single-trial analysis of neural population activity , 2008, NIPS.

[36]  Jonathan W. Pillow,et al.  Prefrontal cortex exhibits multi-dimensional dynamic encoding during decision-making , 2019, bioRxiv.

[37]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[38]  Aaron J Levi,et al.  Strategic and Dynamic Temporal Weighting for Perceptual Decisions in Humans and Macaques , 2018, eNeuro.

[39]  J. Movshon,et al.  A computational analysis of the relationship between neuronal and behavioral responses to visual motion , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[40]  Jonathan W. Pillow,et al.  Dissociated functional significance of decision-related activity in the primate dorsal stream , 2016, Nature.

[41]  M. Bethge,et al.  Inferring decoding strategies from choice probabilities in the presence of correlated variability , 2013, Nature Neuroscience.

[42]  Gregory C. DeAngelis,et al.  The Effects of Population Tuning and Trial-by-Trial Variability on Information Encoding and Behavior , 2019, The Journal of Neuroscience.

[43]  József Fiser,et al.  Perceptual Decision-Making as Probabilistic Inference by Neural Sampling , 2014, Neuron.