Quantifying metacognitive thresholds using signal-detection theory

How sure are we about what we know? Confidence, measured via self-report, is often interpreted as a subjective probabilistic estimate on having made a correct judgement. The neurocognitive mechanisms underlying the construction of confidence and the information incorporated into these judgements are of increasing interest. Investigating these mechanisms requires principled and practically applicable measures of confidence and metacognition. Unfortunately, current measures of confidence are subject to distortions from decision biases and task performance. Motivated by a recent signal-detection theoretic behavioural measure of metacognitive sensitivity, known as meta-ď, here we present a quantitative behavioural measure of confidence that is invariant to decision bias and task performance. This measure, which we call m-distance, captures in a principled way the propensity to report decisions with high (or low) confidence. Computational simulations demonstrate the robustness of m-distance to decision bias and task performance, as well as its behaviour under conditions of high and low metacognitive sensitivity and under dual-channel and hierarchical models of metacognition. The introduction of the m-distance measure will enhance systematic quantitative studies of the behavioural expression and neurocognitive basis of subjective confidence.

[1]  Hakwan Lau,et al.  The signal processing architecture underlying subjective reports of sensory awareness , 2016, Neuroscience of consciousness.

[2]  Sniezek,et al.  The Social Influence of Confidence in Group Decision Making , 1997, Journal of experimental social psychology.

[3]  Ryota Kanai,et al.  Predictions Shape Confidence in Right Inferior Frontal Gyrus , 2016, The Journal of Neuroscience.

[4]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[5]  P. Sterzer,et al.  Mesolimbic confidence signals guide perceptual learning in the absence of external feedback , 2016, eLife.

[6]  V. Walsh,et al.  Subjective discriminability of invisibility: A framework for distinguishing perceptual and attentional failures of awareness , 2010, Consciousness and Cognition.

[7]  Pieter R. Roelfsema,et al.  Variance misperception explains illusions of confidence in simple perceptual decisions , 2014, Consciousness and Cognition.

[8]  Zoltan Dienes,et al.  Measures of metacognition on signal-detection theoretic models. , 2013, Psychological methods.

[9]  Hakwan Lau,et al.  Signal Detection Theory Analysis of Type 1 and Type 2 Data: Meta-d′, Response-Specific Meta-d′, and the Unequal Variance SDT Model , 2014 .

[10]  P. Azzopardi,et al.  Evaluation of a 'bias-free' measure of awareness. , 2007, Spatial vision.

[11]  Hakwan Lau,et al.  There are things that we know that we know, and there are things that we do not know we do not know: Confidence in decision-making , 2015, Neuroscience & Biobehavioral Reviews.

[12]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[13]  J. Flavell Metacognition and Cognitive Monitoring: A New Area of Cognitive-Developmental Inquiry. , 1979 .

[14]  P. Latham,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S11 References Movie S1 Optimally Interacting Minds R�ports , 2022 .

[15]  Stephen M Fleming,et al.  HMeta-d: hierarchical Bayesian estimation of metacognitive efficiency from confidence ratings , 2016, bioRxiv.

[16]  Maxine T. Sherman,et al.  Prior expectations facilitate metacognition for perceptual decision , 2015, Consciousness and Cognition.

[17]  Hakwan Lau,et al.  Heuristic use of perceptual evidence leads to dissociation between performance and metacognitive sensitivity , 2016, Attention, Perception, & Psychophysics.

[18]  Tony Ro,et al.  Action-Specific Disruption of Perceptual Confidence , 2015, Psychological science.

[19]  Caspar M. Schwiedrzik,et al.  Expectations Change the Signatures and Timing of Electrophysiological Correlates of Perceptual Awareness , 2011, The Journal of Neuroscience.

[20]  Derek H. Arnold,et al.  Computations underlying confidence in visual perception. , 2016, Journal of experimental psychology. Human perception and performance.

[21]  Michael N. Shadlen,et al.  Effects of Cortical Microstimulation on Confidence in a Perceptual Decision , 2014, Neuron.

[22]  Susan J. Galvin,et al.  Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions , 2003, Psychonomic bulletin & review.

[23]  S. Dehaene,et al.  Causal role of prefrontal cortex in the threshold for access to consciousness. , 2009, Brain : a journal of neurology.

[24]  H. Pashler,et al.  Confidence and Accuracy of Near-Threshold Discrimination Responses , 2001, Consciousness and Cognition.

[25]  J V Baranski,et al.  Probing the locus of confidence judgments: experiments on the time to determine confidence. , 1998, Journal of experimental psychology. Human perception and performance.

[26]  P. Dayan,et al.  A mathematical model explains saturating axon guidance responses to molecular gradients , 2016, eLife.

[27]  Anil K. Seth,et al.  Blind Insight: Metacognitive Discrimination Despite Chance Task Performance , 2014, Psychological science.

[28]  John T Wixted,et al.  A direct test of the unequal-variance signal detection model of recognition memory , 2007, Psychonomic bulletin & review.

[29]  J. Jastrow,et al.  On small differences in sensation , 1884 .

[30]  Kevin J. Grimm,et al.  Changes in ventromedial prefrontal and insular cortex support the development of metamemory from childhood into adolescence , 2017, Proceedings of the National Academy of Sciences.

[31]  Axel Cleeremans,et al.  Higher order thoughts in action: consciousness as an unconscious re-description process , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[32]  Christopher Summerfield,et al.  Metacognition in human decision-making: confidence and error monitoring , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[33]  Athena Demertzi,et al.  New directions in hypnosis research: strategies for advancing the cognitive and clinical neuroscience of hypnosis , 2017, Neuroscience of consciousness.

[34]  H. Lau,et al.  A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings , 2012, Consciousness and Cognition.

[35]  Peter D. Kvam,et al.  Strength and weight: The determinants of choice and confidence , 2016, Cognition.

[36]  Mark D'Esposito,et al.  Confidence Leak in Perceptual Decision Making , 2015, Psychological science.

[37]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[38]  D. Schwarzkopf,et al.  Unexpected arousal modulates the influence of sensory noise on confidence , 2016, eLife.

[39]  Rachel N. Denison,et al.  Suboptimality in perception , 2016 .