Implicit knowledge of visual uncertainty guides decisions with asymmetric outcomes.

Perception is an "inverse problem," in which the state of the world must be inferred from the sensory neural activity that results. However, this inference is both ill-posed (Helmholtz, 1856; Marr, 1982) and corrupted by noise (Green & Swets, 1989), requiring the brain to compute perceptual beliefs under conditions of uncertainty. Here we show that human observers performing a simple visual choice task under an externally imposed loss function approach the optimal strategy, as defined by Bayesian probability and decision theory (Berger, 1985; Cox, 1961). In concert with earlier work, this suggests that observers possess a model of their internal uncertainty and can utilize this model in the neural computations that underlie their behavior (Knill & Pouget, 2004). In our experiment, optimal behavior requires that observers integrate the loss function with an estimate of their internal uncertainty rather than simply requiring that they use a modal estimate of the uncertain stimulus. Crucially, they approach optimal behavior even when denied the opportunity to learn adaptive decision strategies based on immediate feedback. Our data thus support the idea that flexible representations of uncertainty are pre-existing, widespread, and can be propagated to decision-making areas of the brain.

[1]  L. Thurstone,et al.  A low of comparative judgement , 1927 .

[2]  L. M. M.-T. Theory of Probability , 1929, Nature.

[3]  R. T. Cox The Algebra of Probable Inference , 1962 .

[4]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[5]  R. T. Cox,et al.  The Algebra of Probable Inference , 1962 .

[6]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[7]  D. Whitteridge Movements of the eyes R. H. S. Carpenter, Pion Ltd, London (1977), 420 pp., $27.00 , 1979, Neuroscience.

[8]  G Westheimer,et al.  The spatial sense of the eye. Proctor lecture. , 1979, Investigative ophthalmology & visual science.

[9]  James O. Berger Statistical Decision Theory , 1980 .

[10]  S. Gull Bayesian Inductive Inference and Maximum Entropy , 1988 .

[11]  J. Berger Statistical Decision Theory and Bayesian Analysis , 1988 .

[12]  L. Thurstone A law of comparative judgment. , 1994 .

[13]  A. Yuille,et al.  Bayesian decision theory and psychophysics , 1996 .

[14]  L. Wasserman,et al.  Computing Bayes Factors by Combining Simulation and Asymptotic Approximations , 1997 .

[15]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[16]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[17]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[18]  M S Landy,et al.  Ideal cue combination for localizing texture-defined edges. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Refractor Vision , 2000, The Lancet.

[20]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[21]  A. Pouget,et al.  Efficient computation and cue integration with noisy population codes , 2001, Nature Neuroscience.

[22]  T. Hodgson,et al.  The location marker effect. Saccadic latency increases with target eccentricity. , 2002, Experimental brain research.

[23]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[24]  Timothy L. Hodgson,et al.  The location marker effect , 2002, Experimental Brain Research.

[25]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[26]  R. Mausfeld,et al.  Perception and the Physical World: Psychological and Philosophical Issues in Perception , 2002 .

[27]  L. Maloney Statistical decision theory and evolution , 2003, Trends in Cognitive Sciences.

[28]  M. Landy,et al.  Statistical decision theory and trade-offs in the control of motor response. , 2003, Spatial vision.

[29]  J. Saunders,et al.  Do humans optimally integrate stereo and texture information for judgments of surface slant? , 2003, Vision Research.

[30]  R. Zemel,et al.  Inference and computation with population codes. , 2003, Annual review of neuroscience.

[31]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[32]  James M. Hillis,et al.  Slant from texture and disparity cues: optimal cue combination. , 2004, Journal of vision.

[33]  David C Knill,et al.  Visual Feedback Control of Hand Movements , 2004, The Journal of Neuroscience.

[34]  David C. Knill,et al.  Humans use continuous visual feedback from the hand to control both the direction and distance of pointing movements , 2005, Experimental Brain Research.

[35]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[36]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[37]  M. Landy,et al.  Optimal Compensation for Changes in Task-Relevant Movement Variability , 2005, The Journal of Neuroscience.

[38]  Laurence T. Maloney,et al.  Statistical Decision Theory and Biological Vision , 2005 .

[39]  Terrence J. Sejnowski,et al.  A Bayesian Framework for Tilt Perception and Confidence , 2005, NIPS.

[40]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[41]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[42]  M. Landy,et al.  Visual estimation under risk. , 2007, Journal of vision.

[43]  W. Richards,et al.  Perception as Bayesian Inference , 2008 .

[44]  N. Bingham,et al.  Generalised Linear Models , 2010 .