A neural basis of probabilistic computation in visual cortex

Bayesian models of behavior suggest that organisms represent uncertainty associated with sensory variables. However, the neural code of uncertainty remains elusive. A central hypothesis is that uncertainty is encoded in the population activity of cortical neurons in the form of likelihood functions. We tested this hypothesis by simultaneously recording population activity from primate visual cortex during a visual categorization task in which trial-to-trial uncertainty about stimulus orientation was relevant for the decision. We decoded the likelihood function from the trial-to-trial population activity and found that it predicted decisions better than a point estimate of orientation. This remained true when we conditioned on the true orientation, suggesting that internal fluctuations in neural activity drive behaviorally meaningful variations in the likelihood function. Our results establish the role of population-encoded likelihood functions in mediating behavior and provide a neural underpinning for Bayesian models of perception. Although Bayesian models provide good accounts of perceptual decisions, it is unclear how their components are represented in the brain. This paper addresses this question by showing that uncertainty decoded from visual cortex helps predict behavior.

[1]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[2]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[3]  F. Campbell,et al.  The visual evoked potential as a function of contrast of a grating pattern , 1972, The Journal of physiology.

[4]  Daeyeol Lee,et al.  Effects of noise correlations on information encoding and decoding. , 2006, Journal of neurophysiology.

[5]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[6]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[7]  H Sompolinsky,et al.  Simple models for reading neuronal population codes. , 1993, Proceedings of the National Academy of Sciences of the United States of America.

[8]  Janneke F. M. Jehee,et al.  Sensory uncertainty decoded from visual cortex predicts behavior , 2015, Nature Neuroscience.

[9]  Alexander S. Ecker,et al.  Macaque Monkeys Perceive the Flash Lag Illusion , 2013, PloS one.

[10]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[11]  R. Quian Quiroga,et al.  Unsupervised Spike Detection and Sorting with Wavelets and Superparamagnetic Clustering , 2004, Neural Computation.

[12]  Douglas Kline,et al.  Revisiting squared-error and cross-entropy functions for training neural network classifiers , 2005, Neural Computing & Applications.

[13]  Anna Shcherbina,et al.  Not Just a Black Box: Learning Important Features Through Propagating Activation Differences , 2016, ArXiv.

[14]  Luigi Acerbi,et al.  On the Origins of Suboptimality in Human Probabilistic Inference , 2014, PLoS Comput. Biol..

[15]  W. Ma,et al.  Towards a neural implementation of causal inference in cue combination. , 2013, Multisensory research.

[16]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[17]  W. Geisler,et al.  Contributions of ideal observer theory to vision research , 2011, Vision Research.

[18]  Bruce G Cumming,et al.  Feedforward and Feedback Sources of Choice Probability in Neural Population Responses This Review Comes from a Themed Issue on Neurobiology of Cognitive Behavior Evidence for Feed-forward Models and Optimal Linear Readout? , 2022 .

[19]  Alexander S. Ecker,et al.  Attentional fluctuations induce shared variability in macaque primary visual cortex , 2017, Nature Communications.

[20]  P. Laplace Théorie analytique des probabilités , 1995 .

[21]  Alexander S. Ecker,et al.  State Dependence of Noise Correlations in Macaque Primary Visual Cortex , 2014, Neuron.

[22]  Christopher R Fetsch,et al.  Neural correlates of reliability-based cue weighting during multisensory integration , 2011, Nature Neuroscience.

[23]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[24]  Janneke F. M. Jehee,et al.  Modeling correlated noise is necessary to decode uncertainty , 2017, NeuroImage.

[25]  Wei Ji Ma,et al.  Signal detection theory, uncertainty, and Poisson-like population codes , 2010, Vision Research.

[26]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[27]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[28]  Markus H. Gross,et al.  A unified view of gradient-based attribution methods for Deep Neural Networks , 2017, NIPS 2017.

[29]  A. Tolias,et al.  Trial-to-trial, uncertainty-based adjustment of decision boundaries in visual categorization , 2013, Proceedings of the National Academy of Sciences.

[30]  J. Movshon,et al.  The statistical reliability of signals in single neurons in cat and monkey visual cortex , 1983, Vision Research.

[31]  Arnulf B. A. Graf,et al.  Decoding the activity of neuronal populations in macaque primary visual cortex , 2011, Nature Neuroscience.

[32]  Wei Ji Ma,et al.  Spiking networks for Bayesian inference and choice , 2008, Current Opinion in Neurobiology.

[33]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[34]  D. Burr,et al.  The Ventriloquist Effect Results from Near-Optimal Bimodal Integration , 2004, Current Biology.

[35]  Konrad P. Kording,et al.  Decision Theory: What "Should" the Nervous System Do? , 2007 .

[36]  Pascal Mamassian,et al.  Observer biases in the 3D interpretation of line drawings , 1998, Vision Research.

[37]  Wei Ji Ma,et al.  Efficient Probabilistic Inference in Generic Neural Networks Trained with Non-Probabilistic Feedback , 2018 .

[38]  A. Pouget,et al.  Behavior and neural basis of near-optimal visual search , 2011, Nature Neuroscience.

[39]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[40]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[41]  W. Ma Organizing probabilistic models of perception , 2012, Trends in Cognitive Sciences.

[42]  Adrian G Bondy,et al.  Feedback Determines the Structure of Correlated Variability in Primary Visual Cortex , 2016, Nature Neuroscience.

[43]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[44]  T. Sanger,et al.  Probability density estimation for the interpretation of neural population codes. , 1996, Journal of neurophysiology.

[45]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[46]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[47]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[48]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[49]  J. Movshon,et al.  Adaptation changes the direction tuning of macaque MT neurons , 2004, Nature Neuroscience.

[50]  A. Pouget,et al.  Marginalization in Neural Circuits with Divisive Normalization , 2011, The Journal of Neuroscience.

[51]  Alexander S. Ecker,et al.  Recording chronically from the same neurons in awake, behaving primates. , 2007, Journal of neurophysiology.

[52]  Richard Lippmann,et al.  Neural Network Classifiers Estimate Bayesian a posteriori Probabilities , 1991, Neural Computation.

[53]  L. Maloney,et al.  Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer , 2009, Visual Neuroscience.

[54]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[55]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[56]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[57]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[58]  G. DeAngelis,et al.  Multisensory integration: psychophysics, neurophysiology, and computation , 2009, Current Opinion in Neurobiology.

[59]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.