On the Origins of Suboptimality in Human Probabilistic Inference

Humans have been shown to combine noisy sensory information with previous experience (priors), in qualitative and sometimes quantitative agreement with the statistically-optimal predictions of Bayesian integration. However, when the prior distribution becomes more complex than a simple Gaussian, such as skewed or bimodal, training takes much longer and performance appears suboptimal. It is unclear whether such suboptimality arises from an imprecise internal representation of the complex prior, or from additional constraints in performing probabilistic computations on complex distributions, even when accurately represented. Here we probe the sources of suboptimality in probabilistic inference using a novel estimation task in which subjects are exposed to an explicitly provided distribution, thereby removing the need to remember the prior. Subjects had to estimate the location of a target given a noisy cue and a visual representation of the prior probability density over locations, which changed on each trial. Different classes of priors were examined (Gaussian, unimodal, bimodal). Subjects' performance was in qualitative agreement with the predictions of Bayesian Decision Theory although generally suboptimal. The degree of suboptimality was modulated by statistical features of the priors but was largely independent of the class of the prior and level of noise in the cue, suggesting that suboptimality in dealing with complex statistical features, such as bimodality, may be due to a problem of acquiring the priors rather than computing with them. We performed a factorial model comparison across a large set of Bayesian observer models to identify additional sources of noise and suboptimality. Our analysis rejects several models of stochastic behavior, including probability matching and sample-averaging strategies. Instead we show that subjects' response variability was mainly driven by a combination of a noisy estimation of the parameters of the priors, and by variability in the decision process, which we represent as a noisy or stochastic posterior.

[1]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[2]  L. Campbell,et al.  Exponential entropy as a measure of extent of a distribution , 1966 .

[3]  L. Pinneo On noise in the nervous system. , 1966, Psychological review.

[4]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[5]  M. Stone,et al.  Marginalization Paradoxes in Bayesian and Structural Inference , 1973 .

[6]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[7]  A. Tversky,et al.  Advances in prospect theory: Cumulative representation of uncertainty , 1992 .

[8]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[9]  F. Teuscher,et al.  Sharp inequalities between skewness and kurtosis for unimodal distributions , 1995 .

[10]  Miguel Á. Carreira-Perpiñán,et al.  Mode-Finding for Mixtures of Gaussian Distributions , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David J. Fleet,et al.  Probabilistic Models of the Brain : Perception and Neural Function , 2001 .

[12]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[13]  M. Landy,et al.  Bayesian Modelling of Visual Perception , 2002 .

[14]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[15]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[16]  J. Ross Visual Discrimination of Number without Counting , 2003, Perception.

[17]  Radford M. Neal Slice Sampling , 2003, The Annals of Statistics.

[18]  S. Walker Invited comment on the paper "Slice Sampling" by Radford Neal , 2003 .

[19]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[20]  M. Ernst,et al.  Experience can change the 'light-from-above' prior , 2004, Nature Neuroscience.

[21]  W. Härdle Nonparametric and Semiparametric Models , 2004 .

[22]  Konrad Paul Körding,et al.  The loss function of sensorimotor learning. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[23]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[24]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[25]  M. Landy,et al.  Optimal Compensation for Changes in Task-Relevant Movement Variability , 2005, The Journal of Neuroscience.

[26]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[27]  Frank Jäkel,et al.  Bayesian inference for psychometric functions. , 2005, Journal of vision.

[28]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[29]  M. Miyazaki,et al.  Testing Bayesian models of human coincidence timing. , 2005, Journal of neurophysiology.

[30]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[31]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[32]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[33]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[34]  Tony O’Hagan Bayes factors , 2006 .

[35]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[36]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[37]  M. Landy,et al.  Movement planning with probabilistic target information. , 2007, Journal of neurophysiology.

[38]  S. Gepshtein,et al.  Optimality of human movement under natural variations of visual-motor uncertainty. , 2007, Journal of vision.

[39]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[40]  W. Gaissmaier,et al.  The smart potential behind probability matching , 2008, Cognition.

[41]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[42]  M. Landy,et al.  Decision making, movement planning and statistical decision theory , 2008, Trends in Cognitive Sciences.

[43]  H. Pashler,et al.  Measuring the Crowd Within , 2008, Psychological science.

[44]  P. Mamassian Overconfidence in an Objective Anticipatory Motor Task , 2008, Psychological science.

[45]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[46]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[47]  Daniel M. Wolpert,et al.  A modular planar robotic manipulandum with end-point torque control , 2009, Journal of Neuroscience Methods.

[48]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[49]  Konrad Paul Kording,et al.  Learning Priors for Bayesian Computations in the Nervous System , 2010, PloS one.

[50]  Masaaki Kawahashi,et al.  Renovation of Journal of Visualization , 2010, J. Vis..

[51]  Ulrik R. Beierholm,et al.  Probability Matching as a Computational Strategy Used in Perception , 2010, PLoS Comput. Biol..

[52]  Aaron R. Seitz,et al.  Rapidly learned stimulus expectations alter perception of motion. , 2010, Journal of vision.

[53]  C S Green,et al.  Alterations in choice behavior by manipulations of world model , 2010, Proceedings of the National Academy of Sciences.

[54]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[55]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[56]  Hang Zhang,et al.  Gambling in the Visual Periphery: A Conjoint-Measurement Analysis of Human Ability to Judge Visual Uncertainty , 2010, PLoS Comput. Biol..

[57]  Aaron R. Seitz,et al.  Changing expectations about speed alters perceived motion direction , 2011, Current Biology.

[58]  F. Kingdom,et al.  A common visual metric for approximate number and density , 2011, Proceedings of the National Academy of Sciences.

[59]  Ingo Fründ,et al.  Inference for psychometric functions in the presence of nonstationary behavior. , 2011, Journal of vision.

[60]  Philip N. Sabes,et al.  How Each Movement Changes the Next: An Experimental and Theoretical Study of Fast Adaptive Priors in Reaching , 2011, The Journal of Neuroscience.

[61]  M. Sahani,et al.  Observers Exploit Stochastic Models of Sensory Change to Help Judge the Passage of Time , 2011, Current Biology.

[62]  Paul R. Schrater,et al.  How Haptic Size Sensations Improve Distance Perception , 2011, PLoS Comput. Biol..

[63]  Eero P. Simoncelli,et al.  Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics , 2011, Nature Neuroscience.

[64]  F. Petzschner,et al.  Iterative Bayesian Estimation as an Explanation for Range and Regression Effects: A Study on Human Path Integration , 2011, The Journal of Neuroscience.

[65]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[66]  Luigi Acerbi,et al.  Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing , 2012, PLoS Comput. Biol..

[67]  Hang Zhang,et al.  Ubiquitous Log Odds: A Common Representation of Probability and Frequency Distortion in Perception, Action, and Cognition , 2012, Front. Neurosci..

[68]  Merav Ahissar,et al.  How Recent History Affects Perception: The Normative Approach and Its Heuristic Approximation , 2012, PLoS Comput. Biol..

[69]  Hang Zhang,et al.  Testing Whether Humans Have an Accurate Model of Their Own Motor Uncertainty in a Speeded Reaching Task , 2011, PLoS Comput. Biol..

[70]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[71]  Jacob Feldman,et al.  Tuning Your Priors to the World , 2013, Top. Cogn. Sci..

[72]  Aaron R. Seitz,et al.  Complexity and specificity of experimentally induced expectations in motion perception , 2013, BMC Neuroscience.

[73]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[74]  W. Ma,et al.  Factorial comparison of working memory models. , 2014, Psychological review.