Confidence reports in decision-making with multiple alternatives violate the Bayesian confidence hypothesis

Decision confidence reflects our ability to evaluate the quality of decisions and guides subsequent behaviors. Experiments on confidence reports have almost exclusively focused on two-alternative decision-making. In this realm, the leading theory is that confidence reflects the probability that a decision is correct (the posterior probability of the chosen option). There is, however, another possibility, namely that people are less confident if the best two options are closer to each other in posterior probability, regardless of how probable they are in absolute terms. This possibility has not previously been considered because in two-alternative decisions, it reduces to the leading theory. Here, we test this alternative theory in a three alternative visual categorization task. We found that confidence reports are best explained by the difference between the posterior probabilities of the best and the next-best options, rather than by the posterior probability of the chosen (best) option alone, or by the overall uncertainty (entropy) of the posterior distribution. Our results upend the leading notion of decision confidence and instead suggest that confidence reflects the observer’s subjective probability that they made the best possible decision.

[1]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[2]  Alexandre Pouget,et al.  Confidence and certainty: distinct probabilistic quantities for different goals , 2016, Nature Neuroscience.

[3]  Aspen H. Yoo,et al.  Fechner’s Law in Metacognition: A Quantitative Model of Visual Working Memory Confidence , 2017, Psychological review.

[4]  Jochen Ditterich,et al.  A Comparison between Mechanisms of Multi-Alternative Perceptual Decision Making: Ability to Explain Human Behavior, Predictions for Neurophysiology, and Relationship with Decision Theory , 2010, Front. Neurosci..

[5]  Susan J. Galvin,et al.  Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions , 2003, Psychonomic bulletin & review.

[6]  H. Lau,et al.  How to measure metacognition , 2014, Front. Hum. Neurosci..

[7]  M. Shadlen,et al.  Choice Certainty Is Informed by Both Evidence and Decision Time , 2014, Neuron.

[8]  T. Birdsall,et al.  Two Types of ROC Curves and Definitions of Parameters , 1959 .

[9]  Timothy J. Pleskac,et al.  Dynamics of postdecisional processing of confidence. , 2015, Journal of experimental psychology. General.

[10]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[11]  W. Ma,et al.  Factorial comparison of working memory models. , 2014, Psychological review.

[12]  Simon Barthelmé,et al.  Flexible mechanisms underlie the evaluation of visual confidence , 2010, Proceedings of the National Academy of Sciences.

[13]  A. Cowey,et al.  Post-decision wagering objectively measures awareness , 2007, Nature Neuroscience.

[14]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[15]  Wei Ji Ma,et al.  Variable Precision in Visual Perception , 2019, Psychological review.

[16]  P. Glimcher,et al.  Reward Value-Based Gain Control: Divisive Normalization in Parietal Cortex , 2011, The Journal of Neuroscience.

[17]  Scott D. Brown,et al.  Observing evidence accumulation during multi-alternative decisions , 2009 .

[18]  S. Morad,et al.  Ceramide-orchestrated signalling in cancer cells , 2012, Nature Reviews Cancer.

[19]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[20]  Florent Meyniel,et al.  The Sense of Confidence during Probabilistic Learning: A Normative Account , 2015, PLoS Comput. Biol..

[21]  J. Daunizeau,et al.  Automatic integration of confidence in the brain valuation signal , 2015, Nature Neuroscience.

[22]  Jochen Ditterich,et al.  New advances in understanding decisions among multiple alternatives , 2012, Current Opinion in Neurobiology.

[23]  Joshua I. Sanders,et al.  Signatures of a Statistical Computation in the Human Sense of Confidence , 2016, Neuron.

[24]  Timothy J. Pleskac,et al.  Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. , 2010, Psychological review.

[25]  J. Crystal,et al.  Metacognition in the Rat , 2007, Current Biology.

[26]  Gilles Faÿ,et al.  Características inmunológicas claves en la fisiopatología de la sepsis. Infectio , 2009 .

[27]  T. Robbins,et al.  Compulsivity Reveals a Novel Dissociation between Action and Confidence , 2017, Neuron.

[28]  Wei Ji Ma,et al.  Comparing Bayesian and non-Bayesian accounts of human confidence reports , 2018, PLoS Comput. Biol..

[29]  Ariel Zylberberg,et al.  The construction of confidence in a perceptual decision , 2012, Front. Integr. Neurosci..

[30]  Alexander Strashny Asymmetric loss utility: an analysis of decision under risk , 2004 .

[31]  P. Latham,et al.  The idiosyncratic nature of confidence , 2017, Nature Human Behaviour.

[32]  Jan Drugowitsch,et al.  Computational Precision of Mental Inference as Critical Source of Human Choice Suboptimality , 2016, Neuron.

[33]  M. Usher,et al.  Post choice information integration as a causal determinant of confidence: Novel data and a computational account , 2015, Cognitive Psychology.

[34]  Burr Settles,et al.  Self-Directed Learning Favors Local, Rather Than Global, Uncertainty , 2016, Cogn. Sci..

[35]  Wei Ji Ma,et al.  Probabilistic Computation in Human Perception under Variability in Encoding Precision , 2012, PloS one.

[36]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[37]  R. Hampton Rhesus monkeys know when they remember , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Pascal Mamassian,et al.  Visual Confidence. , 2016, Annual review of vision science.

[39]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[40]  W. Ziemba,et al.  Growth-optimal investments and numeraire portfolios under transactions costs , 2013 .

[41]  Christopher Summerfield,et al.  Metacognition in human decision-making: confidence and error monitoring , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[42]  H. Lau,et al.  A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings , 2012, Consciousness and Cognition.

[43]  Luigi Acerbi,et al.  Internal Representations of Temporal Statistics and Feedback Calibrate Motor-Sensory Interval Timing , 2012, PLoS Comput. Biol..

[44]  Hakwan Lau,et al.  Does perceptual confidence facilitate cognitive control? , 2015, Attention, Perception, & Psychophysics.

[45]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[46]  M. Shadlen,et al.  Decision-making with multiple alternatives , 2008, Nature Neuroscience.

[47]  J. Jastrow,et al.  On small differences in sensation , 1884 .

[48]  Megan A. K. Peters,et al.  Perceptual confidence neglects decision-incongruent evidence in the brain , 2017, Nature Human Behaviour.

[49]  Yutaka Komura,et al.  Responses of pulvinar neurons reflect a subject's confidence in visual categorization , 2013, Nature Neuroscience.

[50]  Peter E. Latham,et al.  Doubly Bayesian Analysis of Confidence in Perceptual Decision-Making , 2015, PLoS Comput. Biol..

[51]  Bahador Bahrami,et al.  Post-decisional accounts of biases in confidence , 2016, Current Opinion in Behavioral Sciences.

[52]  Wei Ji Ma,et al.  Comparing Bayesian and non-Bayesian accounts of human confidence reports , 2018 .

[53]  Nick Yeung,et al.  Subjective Confidence Predicts Information Seeking in Decision Making , 2018, Psychological science.

[54]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[55]  Kerstin Preuschoff,et al.  Optimizing Experimental Design for Comparing Models of Brain Function , 2011, PLoS Comput. Biol..

[56]  Adam Kepecs,et al.  A computational framework for the study of confidence in humans and animals , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[57]  Michael Woodford,et al.  Efficient coding of subjective value , 2018, Nature Neuroscience.

[58]  Alexandre Pouget,et al.  Relation between Belief and Performance in Perceptual Decision Making , 2014, PloS one.

[59]  Daniel M. Wolpert,et al.  Confidence Is the Bridge between Multi-stage Decisions , 2016, Current Biology.

[60]  Brian Odegaard,et al.  Superior colliculus neuronal ensemble activity signals optimal rather than subjective confidence , 2017, Proceedings of the National Academy of Sciences.