Discrete confidence levels revealed by sequential decisions

Whether humans are optimal decision makers is still a debated issue in the realm of perceptual decisions. Taking advantage of the direct link between an optimal decision-making and the confidence in that decision, we offer a new dual-decisions method of inferring such confidence without asking for its explicit valuation. Our method circumvents the well-known miscalibration issue with explicit confidence reports as well as the specification of the cost-function required by ’opt-out’ or post-decision wagering methods. We show that observers’ inferred confidence in their first decision and its use in a subsequent decision (conditioned upon the correctness of the first) fall short of both an optimal and an under-sampling behavior and are significantly better fitted by a model positing that observers use no more than four confidence levels, at odds with the continuous confidence function of stimulus level prescribed by a normative behavior. Significance statement A normative decision behavior requires that one’s confidence be a continuous function of the difficulty of decision to be made (the posterior probability that the decision was correct given the evidence). People however concede that they could not discriminate between two indefinitely close confidence states. Using a new experimental paradigm that does not require participants’ explicit confidence evaluation nor knowledge of their utility function, we show that people can discriminate only two and at most four confidence states, the implication of which is that they are not optimal decision-makers. This finding counters a plethora of studies suggesting the contrary and also rejects an alternative stand according to which people’s decisions are based on a sample of an available posterior function.

[1]  Michael N. Shadlen,et al.  Temporal context calibrates interval timing , 2010, Nature Neuroscience.

[2]  J. Schreiber Foundations Of Statistics , 2016 .

[3]  R. Herrnstein,et al.  Melioration: A Theory of Distributed Choice , 1991 .

[4]  L. Maloney,et al.  Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer , 2009, Visual Neuroscience.

[5]  Aaron R. Seitz,et al.  Rapidly learned stimulus expectations alter perception of motion. , 2010, Journal of vision.

[6]  L. J. Savage Elicitation of Personal Probabilities and Expectations , 1971 .

[7]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[8]  Hang Zhang,et al.  Ubiquitous Log Odds: A Common Representation of Probability and Frequency Distortion in Perception, Action, and Cognition , 2012, Front. Neurosci..

[9]  Nathaniel D. Daw,et al.  Human Representation of Visuo-Motor Uncertainty as Mixtures of Orthogonal Basis Distributions , 2015, Nature Neuroscience.

[10]  C Kaernbach,et al.  Simple adaptive testing with the weighted up-down method , 1991, Perception & psychophysics.

[11]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[12]  Jeffrey S. Bowers,et al.  Is that what Bayesians believe? reply to Griffiths, Chater, Norris, and Pouget (2012). , 2012, Psychological bulletin.

[13]  Pascal Mamassian,et al.  Confidence as a Common Currency between Vision and Audition , 2016, PloS one.

[14]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[15]  Justin L. Gardner,et al.  A Switching Observer for Human Perceptual Estimation , 2017, Neuron.

[16]  Ken Binmore,et al.  On the Foundations of Decision Theory , 2017 .

[17]  John C. Nash,et al.  On Best Practice Optimization Methods in R , 2014 .

[18]  A. Kolmogorov,et al.  Grundbegriffe der Wahrscheinlichkeits-Rechnung , 1933 .

[19]  Adam Kepecs,et al.  A computational framework for the study of confidence in humans and animals , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[20]  Aaron R. Seitz,et al.  Complexity and specificity of experimentally induced expectations in motion perception , 2013, BMC Neuroscience.

[21]  Adam N. Sanborn,et al.  Bayesian Brains without Probabilities , 2016, Trends in Cognitive Sciences.

[22]  H. Lau,et al.  How to measure metacognition , 2014, Front. Hum. Neurosci..

[23]  M. Frank,et al.  Computational psychiatry as a bridge from neuroscience to clinical applications , 2016, Nature Neuroscience.

[24]  Johan Kwisthout,et al.  Bayesian Intractability Is Not an Ailment That Approximation Can Cure , 2011, Cogn. Sci..

[25]  Rachel N. Denison,et al.  Supra-optimality may emanate from suboptimality, and hence optimality is no benchmark in multisensory integration , 2018, Behavioral and Brain Sciences.

[26]  D. Norris,et al.  How the Bayesians got their beliefs (and what those beliefs actually are): comment on Bowers and Davis (2012). , 2012, Psychological bulletin.

[27]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[28]  D. Bates,et al.  Linear Mixed-Effects Models using 'Eigen' and S4 , 2015 .

[29]  M. Powell The BOBYQA algorithm for bound constrained optimization without derivatives , 2009 .

[30]  H. Akaike A new look at the statistical model identification , 1974 .

[31]  J. Bowers,et al.  Bayesian just-so stories in psychology and neuroscience. , 2012, Psychological bulletin.

[32]  Tony Ro,et al.  Transcranial magnetic stimulation to visual cortex induces suboptimal introspection , 2017, Cortex.

[33]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[34]  L. M. M.-T. Theory of Probability , 1929, Nature.

[35]  E. Davis,et al.  How Robust Are Probabilistic Models of Higher-Level Cognition? , 2013, Psychological science.

[36]  Aaron R. Seitz,et al.  Learning what to expect (in visual perception) , 2013, Front. Hum. Neurosci..

[37]  Thomas L. Griffiths,et al.  One and Done? Optimal Decisions From Very Few Samples , 2014, Cogn. Sci..

[38]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[39]  Aaron R. Seitz,et al.  Expectations developed over multiple timescales facilitate visual search performance. , 2015, Journal of vision.

[40]  Nick Chater,et al.  Mind, rationality, and cognition: An interdisciplinary debate , 2017, Psychonomic bulletin & review.

[41]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[42]  Pascal Mamassian,et al.  Visual Confidence. , 2016, Annual review of vision science.

[43]  Pascal Mamassian,et al.  Does Confidence Use a Common Currency Across Two Visual Tasks? , 2014, Psychological science.

[44]  John C. Nash,et al.  Unifying Optimization Algorithms to Aid Software System Users: optimx for R , 2011 .

[45]  S. Dehaene,et al.  Brain networks for confidence weighting and hierarchical inference during probabilistic learning , 2017, Proceedings of the National Academy of Sciences.

[46]  Alexandre Pouget,et al.  Relation between Belief and Performance in Perceptual Decision Making , 2014, PloS one.

[47]  Yonatan Loewenstein,et al.  The Effect of Sample Size and Cognitive Strategy on Probability Estimation Bias , 2015 .

[48]  B. D. Finetti La prévision : ses lois logiques, ses sources subjectives , 1937 .

[49]  Aaron R. Seitz,et al.  Learning what to expect , 2013 .

[50]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .