Variance misperception explains illusions of confidence in simple perceptual decisions

Confidence in a perceptual decision is a judgment about the quality of the sensory evidence. The quality of the evidence depends not only on its strength ('signal') but critically on its reliability ('noise'), but the separate contribution of these quantities to the formation of confidence judgments has not been investigated before in the context of perceptual decisions. We studied subjective confidence reports in a multi-element perceptual task where evidence strength and reliability could be manipulated independently. Our results reveal a confidence paradox: confidence is higher for stimuli of lower reliability that are associated with a lower accuracy. We show that the subjects' overconfidence in trials with unreliable evidence is caused by a reduced sensitivity to stimulus variability. Our results bridge between the investigation of miss-attributions of confidence in behavioral economics and the domain of simple perceptual decisions amenable to neuroscience research.

[1]  Christopher Summerfield,et al.  Metacognition in human decision-making: confidence and error monitoring , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  D. Kahneman Thinking, Fast and Slow , 2011 .

[3]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[4]  Paul Slovic,et al.  From Shakespeare to Simon: speculations--and some evidence-- about man's ability to process information , 1972 .

[5]  J. Wolfowitz,et al.  Optimum Character of the Sequential Probability Ratio Test , 1948 .

[6]  Paul Slovic,et al.  Importance of variance preferences in gambling decisions , 1968 .

[7]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[8]  D. Hosmer,et al.  Applied Logistic Regression , 1991 .

[9]  Bruce Luber,et al.  Direct injection of noise to the visual cortex decreases accuracy but increases decision confidence. , 2012, Journal of neurophysiology.

[10]  Adam Kepecs,et al.  A computational framework for the study of confidence in humans and animals , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[11]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[12]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[13]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[14]  Daniel Kahneman,et al.  Availability: A heuristic for judging frequency and probability , 1973 .

[15]  R. Hastie,et al.  The moderating influence of variability on belief revision , 1996, Psychonomic bulletin & review.

[16]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[17]  P. Juslin,et al.  Thurstonian and Brunswikian origins of uncertainty in judgment: a sampling model of confidence in sensory discrimination. , 1997, Psychological review.

[18]  L. Maloney,et al.  Economic decision-making compared with an equivalent motor task , 2009, Proceedings of the National Academy of Sciences.

[19]  A Gorea,et al.  Failure to handle more than one internal representation in visual detection tasks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[20]  C. Summerfield,et al.  Robust averaging during perceptual judgment , 2011, Proceedings of the National Academy of Sciences.

[21]  Baruch Fischhoff,et al.  Calibration of Probabilities: The State of the Art , 1977 .

[22]  H. Lau,et al.  Attention induces conservative subjective biases in visual perception , 2011, Nature Neuroscience.

[23]  R. Dolan,et al.  Knowing how much you don't know: a neural organization of uncertainty estimates , 2012, Nature Reviews Neuroscience.

[24]  A. Tversky,et al.  The framing of decisions and the psychology of choice. , 1981, Science.

[25]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[26]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[27]  U. Hahn,et al.  Perceptuo-motor, cognitive, and description-based decision-making seem equally good , 2013, Proceedings of the National Academy of Sciences.

[28]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.