Human confidence judgments reflect reliability-based hierarchical integration of contextual information

Because of uncertainty inherent in perception, our immediate observations must be supplemented with contextual information to resolve ambiguities. However, often context too is ambiguous, and thus it should be inferred itself to guide behavior. We developed a novel hierarchical task where participants should infer a higher-level, contextual variable to inform probabilistic inference about a hidden dependent variable at a lower level. By controlling the reliability of the past sensory evidence through sample size, we found that humans estimate the reliability of the context and combine it with current sensory uncertainty to inform their confidence reports. Indeed, behavior closely follows inference by probabilistic message passing between latent variables across hierarchical state representations. Despite the sophistication of our task, commonly reported inferential fallacies, such as sample size insensitivity, are not present, and neither do participants appear to rely on simple heuristics. Our results reveal ubiquitous probabilistic representations of uncertainty at different hierarchical levels and temporal scales of the environment.

[1]  Gerd Gigerenzer,et al.  Heuristic decision making. , 2011, Annual review of psychology.

[2]  Rachel N. Denison,et al.  Supra-optimality may emanate from suboptimality, and hence optimality is no benchmark in multisensory integration , 2018, Behavioral and Brain Sciences.

[3]  Peter Bossaerts,et al.  Risk, Unexpected Uncertainty, and Estimation Uncertainty: Bayesian Learning in Unstable Settings , 2011, PLoS Comput. Biol..

[4]  Robert C. Wilson,et al.  An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment , 2010, The Journal of Neuroscience.

[5]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[6]  Philipp Schustek,et al.  Instance-based generalization for human judgments about uncertainty , 2018, PLoS Comput. Biol..

[7]  Ayman Habib,et al.  OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement , 2018, PLoS Comput. Biol..

[8]  Richard Gonzalez,et al.  On the Shape of the Probability Weighting Function , 1999, Cognitive Psychology.

[9]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[10]  Joshua I. Sanders,et al.  Signatures of a Statistical Computation in the Human Sense of Confidence , 2016, Neuron.

[11]  Xaq Pitkow,et al.  Inference in the Brain: Statistics Flowing in Redundant Population Codes , 2017, Neuron.

[12]  D. Prelec The Probability Weighting Function , 1998 .

[13]  A. Pouget,et al.  The Cost of Accumulating Evidence in Perceptual Decision Making , 2012, The Journal of Neuroscience.

[14]  Zeb Kurth-Nelson,et al.  What is a cognitive map? Organising knowledge for flexible behaviour , 2018, bioRxiv.

[15]  N. McGlynn Thinking fast and slow. , 2014, Australian veterinary journal.

[16]  Braden A. Purcell,et al.  Hierarchical decision processes that operate over distinct timescales underlie choice and changes in strategy , 2016, Proceedings of the National Academy of Sciences.

[17]  Chris L. Baker,et al.  Rational quantitative attribution of beliefs, desires and percepts in human mentalizing , 2017, Nature Human Behaviour.

[18]  Samuel J. Gershman,et al.  Computational rationality: A converging paradigm for intelligence in brains, minds, and machines , 2015, Science.

[19]  C S Green,et al.  Alterations in choice behavior by manipulations of world model , 2010, Proceedings of the National Academy of Sciences.

[20]  M. Shadlen,et al.  Choice Certainty Is Informed by Both Evidence and Decision Time , 2014, Neuron.

[21]  W. Ma Organizing probabilistic models of perception , 2012, Trends in Cognitive Sciences.

[22]  Karl J. Friston The free-energy principle: a rough guide to the brain? , 2009, Trends in Cognitive Sciences.

[23]  D. Knill,et al.  Bayesian sampling in visual perception , 2011, Proceedings of the National Academy of Sciences.

[24]  Charles Kemp,et al.  How to Grow a Mind: Statistics, Structure, and Abstraction , 2011, Science.

[25]  S. Dehaene,et al.  Brain networks for confidence weighting and hierarchical inference during probabilistic learning , 2017, Proceedings of the National Academy of Sciences.

[26]  Rubén Moreno-Bote,et al.  Decision Confidence and Uncertainty in Diffusion Models with Partially Correlated Neuronal Integrators , 2010, Neural Computation.

[27]  A. Clark Whatever next? Predictive brains, situated agents, and the future of cognitive science. , 2013, The Behavioral and brain sciences.

[28]  A. Tversky,et al.  Subjective Probability: A Judgment of Representativeness , 1972 .

[29]  A. Tversky,et al.  Judgment under Uncertainty: Heuristics and Biases , 1974, Science.

[30]  N. Chater,et al.  Précis of Bayesian Rationality: The Probabilistic Approach to Human Reasoning , 2009, Behavioral and Brain Sciences.

[31]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[32]  Daniel M. Wolpert,et al.  Counterfactual Reasoning Underlies the Learning of Priors in Decision Making , 2017, Neuron.

[33]  A. Borst Seeing smells: imaging olfactory learning in bees , 1999, Nature Neuroscience.

[34]  Alexandre Pouget,et al.  Relation between Belief and Performance in Perceptual Decision Making , 2014, PloS one.

[35]  U. Hahn,et al.  Perceptuo-motor, cognitive, and description-based decision-making seem equally good , 2013, Proceedings of the National Academy of Sciences.

[36]  Charles Kemp,et al.  The discovery of structural form , 2008, Proceedings of the National Academy of Sciences.

[37]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[38]  Rajesh P. N. Rao,et al.  Bayesian brain : probabilistic approaches to neural coding , 2006 .

[39]  Florent Meyniel,et al.  The Sense of Confidence during Probabilistic Learning: A Normative Account , 2015, PLoS Comput. Biol..

[40]  A. Pouget,et al.  Marginalization in Neural Circuits with Divisive Normalization , 2011, The Journal of Neuroscience.

[41]  Karl J. Friston,et al.  Bayesian model selection for group studies , 2009, NeuroImage.

[42]  A. Tversky,et al.  The weighing of evidence and the determinants of confidence , 1992, Cognitive Psychology.

[43]  Robert A Jacobs,et al.  Bayesian learning theory applied to human cognition. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[44]  A. Pouget,et al.  Probabilistic brains: knowns and unknowns , 2013, Nature Neuroscience.

[45]  Karl J. Friston,et al.  Optimal inference with suboptimal models: Addiction and active Bayesian inference , 2015, Medical hypotheses.

[46]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[47]  Richard N Aslin,et al.  Bayesian learning of visual chunks by human observers , 2008, Proceedings of the National Academy of Sciences.

[48]  Y. Kareev,et al.  On the misperception of variability. , 2002, Journal of experimental psychology. General.

[49]  A. Tversky,et al.  BELIEF IN THE LAW OF SMALL NUMBERS , 1971, Pediatrics.

[50]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[51]  H. Lau,et al.  How to measure metacognition , 2014, Front. Hum. Neurosci..

[52]  A. Pouget,et al.  Not Noisy, Just Wrong: The Role of Suboptimal Inference in Behavioral Variability , 2012, Neuron.

[53]  Alexandre Pouget,et al.  Confidence and certainty: distinct probabilistic quantities for different goals , 2016, Nature Neuroscience.