Consensus Goals in the Field of Visual Metacognition

Despite the tangible progress in psychological and cognitive sciences over the last several years, these disciplines still trail other more mature sciences in identifying the most important questions that need to be solved. Reaching such consensus could lead to greater synergy across different laboratories, faster progress, and increased focus on solving important problems rather than pursuing isolated, niche efforts. Here, 26 researchers from the field of visual metacognition reached consensus on four long-term and two medium-term common goals. We describe the process that we followed, the goals themselves, and our plans for accomplishing these goals. If this effort proves successful within the next few years, such consensus building around common goals could be adopted more widely in psychological science.

[1]  Daniel M. Wolpert,et al.  Counterfactual Reasoning Underlies the Learning of Priors in Decision Making , 2017, Neuron.

[2]  D. Rahnev,et al.  Sources of Metacognitive Inefficiency , 2020, Trends in Cognitive Sciences.

[3]  Thomas Haarmeier,et al.  Selective Attention Increases Choice Certainty in Human Decision Making , 2012, PloS one.

[4]  R. Dolan,et al.  Metacognition: computation, biology and function , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  H. Lau,et al.  Attention induces conservative subjective biases in visual perception , 2011, Nature Neuroscience.

[6]  D. Vickers.  Decision processes in visual perception , 1979 .

[7]  Bradley R. Postle,et al.  Dissociating Perceptual Confidence from Discrimination Accuracy Reveals No Influence of Metacognitive Awareness on Working Memory , 2016, Front. Psychol..

[8]  Gianluigi Mongillo,et al.  Discrete confidence levels revealed by sequential decisions , 2017, bioRxiv.

[9]  H. Lau,et al.  Prestimulus hemodynamic activity in dorsal attention network is negatively associated with decision confidence in visual perception. , 2012, Journal of neurophysiology.

[10]  Álvaro I. Langer,et al.  Meditation focused on self-observation of the body impairs metacognitive efficiency , 2019, Consciousness and Cognition.

[11]  Maxine T. Sherman,et al.  Prior expectations facilitate metacognition for perceptual decision , 2015, Consciousness and Cognition.

[12]  Hakwan Lau,et al.  Heuristic use of perceptual evidence leads to dissociation between performance and metacognitive sensitivity , 2016, Attention, Perception, & Psychophysics.

[13]  Nick Yeung,et al.  The role of decision confidence in advice-taking and trust formation. , 2018, Journal of experimental psychology. General.

[14]  Roozbeh Kiani,et al.  Neural Mechanisms of Post-error Adjustments of Decision Policy in Parietal Cortex , 2016, Neuron.

[15]  Megan A. K. Peters,et al.  Perceptual confidence neglects decision-incongruent evidence in the brain , 2017, Nature Human Behaviour.

[16]  Victor A. F. Lamme,et al.  Neural Mechanisms of Visual Awareness: A Linking Proposition , 2000 .

[17]  V. Walsh,et al.  Subjective discriminability of invisibility: A framework for distinguishing perceptual and attentional failures of awareness , 2010, Consciousness and Cognition.

[18]  Jérôme Sackur,et al.  Self-Knowledge Dim-Out: Stress Impairs Metacognitive Accuracy , 2015, PloS one.

[19]  V. de Gardelle,et al.  The Impact of Evidence Reliability on Sensitivity and Bias in Decision Confidence , 2017, Journal of experimental psychology. Human perception and performance.

[20]  R. Passingham,et al.  Theta-burst transcranial magnetic stimulation to the prefrontal cortex impairs metacognitive visual awareness , 2010, Cognitive neuroscience.

[21]  Axel Cleeremans,et al.  Measuring consciousness: relating behavioural and neurophysiological approaches , 2008, Trends in Cognitive Sciences.

[22]  J. Pearson,et al.  Training Visual Imagery: Improvements of Metacognition, but not Imagery Strength , 2012, Front. Psychology.

[23]  Peter E. Latham,et al.  Doubly Bayesian Analysis of Confidence in Perceptual Decision-Making , 2015, PLoS Comput. Biol..

[24]  Jochen Kaiser,et al.  The Influence of Endogenous and Exogenous Spatial Attention on Decision Confidence , 2017, Scientific Reports.

[25]  David J. Schwartzman,et al.  Theta-burst transcranial magnetic stimulation to the prefrontal or parietal cortex does not impair metacognitive visual awareness , 2016, bioRxiv.

[26]  D. Rahnev.  Visual metacognition: Measures, models, and neural correlates. , 2021, The American psychologist.

[27]  M. Shadlen,et al.  Choice Certainty Is Informed by Both Evidence and Decision Time , 2014, Neuron.

[28]  O. Blanke,et al.  Evidence accumulation relates to perceptual consciousness and monitoring , 2021, Nature Communications.

[29]  M. Sigman,et al.  Confidence as Bayesian Probability: From Neural Origins to Behavior , 2015, Neuron.

[30]  V. de Gardelle,et al.  Confidence as a Priority Signal , 2018, bioRxiv.

[31]  Konrad Paul Kording,et al.  Sensory Cue Integration , 2011 .

[32]  Pascal Mamassian,et al.  Does Confidence Use a Common Currency Across Two Visual Tasks? , 2014, Psychological science.

[33]  Ning Mei,et al.  Similar history biases for distinct prospective decisions of self-performance , 2019, Scientific Reports.

[34]  Nikolaus Weiskopf,et al.  Causal evidence for frontal involvement in memory target maintenance by posterior brain areas during distracter interference of visual working memory , 2011, Proceedings of the National Academy of Sciences.

[35]  L. Maloney,et al.  Explicit estimation of visual uncertainty in human motion processing , 2005, Vision Research.

[36]  Axel Cleeremans,et al.  How can we measure awareness? An overview of current methods , 2015 .

[37]  Reginald B. Adams,et al.  Many Labs 2: Investigating Variation in Replicability Across Sample and Setting , 2018 .

[38]  P. Mamassian,et al.  Temporal attention causes systematic biases in visual confidence , 2019, Scientific Reports.

[39]  G. Fechner.  Elemente der Psychophysik , 1998 .

[40]  Hakwan Lau,et al.  Manipulation of working memory contents selectively impairs metacognitive sensitivity in a concurrent visual discrimination task , 2015, Neuroscience of consciousness.

[41]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[42]  Mehrdad Jazayeri,et al.  Hierarchical reasoning by neural circuits in the frontal cortex , 2019, Science.

[43]  Stephen M. Fleming,et al.  Relating Pupil Dilation and Metacognitive Confidence during Auditory Decision-Making , 2015, PloS one.

[44]  Alexandre Pouget,et al.  Confidence and certainty: distinct probabilistic quantities for different goals , 2016, Nature Neuroscience.

[45]  E. Filevich,et al.  Role of feedback on metacognitive training , 2020 .

[46]  Brian Maniscalco,et al.  The Neural Substrates of Conscious Perception without Performance Confounds , 2019, Neuroscience and Philosophy.

[47]  Rachel N. Denison,et al.  Supra-optimality may emanate from suboptimality, and hence optimality is no benchmark in multisensory integration , 2018, Behavioral and Brain Sciences.

[48]  Ophelia Deroy,et al.  Metacognition in Multisensory Perception , 2016, Trends in Cognitive Sciences.

[49]  Wei Ji Ma,et al.  Strategic allocation of working memory resource , 2018, bioRxiv.

[50]  E. Koechlin,et al.  Reasoning, Learning, and Creativity: Frontal Lobe Function and Human Decision-Making , 2012, PLoS biology.

[51]  D. Rahnev,et al.  The nature of metacognitive inefficiency in perceptual decision making. , 2020, Psychological review.

[52]  Alan L. F. Lee,et al.  Global visual confidence , 2020, Psychonomic Bulletin & Review.

[53]  V. de Gardelle,et al.  Metacognitive ability predicts learning cue-stimulus associations in the absence of external feedback , 2018, Scientific Reports.

[54]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[55]  Hang Zhang,et al.  Ubiquitous Log Odds: A Common Representation of Probability and Frequency Distortion in Perception, Action, and Cognition , 2012, Front. Neurosci..

[56]  D. Rahnev,et al.  Distinguishing the Roles of Dorsolateral and Anterior PFC in Visual Metacognition , 2018, The Journal of Neuroscience.

[57]  N. Block.  What Is Wrong with the No-Report Paradigm and How to Fix It , 2019, Trends in Cognitive Sciences.

[58]  Manuel Rausch,et al.  Confidence in masked orientation judgments is informed by both evidence and visibility , 2017, Attention, Perception, & Psychophysics.

[59]  T. Gajdos,et al.  Revealing subthreshold motor contributions to perceptual confidence , 2018, bioRxiv.

[60]  H. Lau,et al.  An investigation of detection biases in the unattended periphery during simulated driving , 2018, Attention, Perception, & Psychophysics.

[61]  N. Block.  Consciousness, accessibility, and the mesh between psychology and neuroscience , 2007, Behavioral and Brain Sciences.

[62]  Daniel M. Wolpert,et al.  Confidence Is the Bridge between Multi-stage Decisions , 2016, Current Biology.

[63]  Johannes J. Fahrenfort,et al.  The subjective experience of object recognition: comparing metacognition for object detection and object categorization , 2014, Attention, perception & psychophysics.

[64]  Adam Kepecs,et al.  A computational framework for the study of confidence in humans and animals , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[65]  D. Pressnitzer,et al.  Bifurcation in brain dynamics reveals a signature of conscious processing independent of report , 2021, Nature Communications.

[66]  J. Mattingley,et al.  Uncertainty Information That Is Irrelevant for Report Impacts Confidence Judgments , 2018, Journal of experimental psychology. Human perception and performance.

[67]  D. Rahnev,et al.  The Impact of Feedback on Perceptual Decision-Making and Metacognition: Reduction in Bias but No Change in Sensitivity , 2020, Psychological science.

[68]  David Soto,et al.  On the independence of visual awareness and metacognition: a signal detection theoretic analysis. , 2015, Journal of experimental psychology. Human perception and performance.

[69]  Hakwan Lau,et al.  The signal processing architecture underlying subjective reports of sensory awareness , 2016, Neuroscience of consciousness.

[70]  Adam Kepecs,et al.  Behavior- and Modality-General Representation of Confidence in Orbitofrontal Cortex , 2020, Cell.

[71]  Derek H. Arnold,et al.  Computations underlying confidence in visual perception. , 2016, Journal of experimental psychology. Human perception and performance.

[72]  Simon Ludwig,et al.  Centro-parietal EEG potentials index subjective evidence and confidence during perceptual decision making , 2019, NeuroImage.

[73]  P. Dayan,et al.  Forming global estimates of self-performance from local confidence , 2019, Nature Communications.

[74]  Olaf Blanke,et al.  Behavioral, Modeling, and Electrophysiological Evidence for Supramodality in Human Metacognition , 2018, The Journal of Neuroscience.

[75]  Anne E. Urai,et al.  Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias , 2017, Nature Communications.

[76]  Michael A. Pitts,et al.  Making the hard problem of consciousness easier , 2021, Science.

[77]  Andrea E. Martin,et al.  How Computational Modeling Can Force Theory Building in Psychological Science , 2020, Perspectives on psychological science : a journal of the Association for Psychological Science.

[78]  Pascal Mamassian,et al.  Visual Confidence. , 2016, Annual review of vision science.

[79]  B. Postle,et al.  Confidence boosts serial dependence in orientation estimation , 2018, bioRxiv.

[80]  Wei Ji Ma,et al.  Confidence reports in decision-making with multiple alternatives violate the Bayesian confidence hypothesis , 2019, bioRxiv.

[81]  J SWETS,et al.  Decision processes in perception. , 1961, Psychological review.

[82]  T. Yarkoni,et al.  Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning , 2017, Perspectives on psychological science : a journal of the Association for Psychological Science.

[83]  Karl J. Friston,et al.  Distinct neural contributions to metacognition for detecting, but not discriminating visual stimuli , 2019, bioRxiv.

[84]  D. Jacquette.  Cracking the Hard Problem of Consciousness , 2018 .

[85]  Chris Huxham,et al.  The Tangled Web: Unraveling the Principle of Common Goals in Collaborations , 2012 .

[86]  K. Kording,et al.  Appreciating diversity of goals in computational neuroscience , 2018 .

[87]  Anil K. Seth,et al.  Blind Insight: Metacognitive Discrimination Despite Chance Task Performance , 2014, Psychological science.

[88]  J. Jastrow,et al.  On small differences in sensation , 1884 .

[89]  Matthew G. Wisniewski,et al.  Confidence tracks sensory- and decision-related ERP dynamics during auditory detection , 2019, Brain and Cognition.

[90]  Wei Ji Ma,et al.  Comparing Bayesian and non-Bayesian accounts of human confidence reports , 2018, PLoS Comput. Biol..

[91]  Dawa T. Phillips,et al.  Domain-specific enhancement of metacognitive ability following meditation training. , 2014, Journal of experimental psychology. General.

[92]  Wei Ji Ma,et al.  Humans incorporate attention-dependent uncertainty into perceptual decisions and confidence , 2018, Proceedings of the National Academy of Sciences.

[93]  Paul C. Stern,et al.  A strategy for assessing science : behavioral and social research on aging , 2007 .

[94]  P A Kolers,et al.  A problem for theory. , 1972, Vision research.

[95]  Dobromir Rahnev,et al.  Sensory noise increases metacognitive efficiency , 2017, bioRxiv.

[96]  Susan J. Galvin,et al.  Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions , 2003, Psychonomic bulletin & review.

[97]  D. Rahnev.  Confidence in the Real World , 2020, Trends in Cognitive Sciences.

[98]  D. Schwarzkopf,et al.  Unexpected arousal modulates the influence of sensory noise on confidence , 2016, eLife.

[99]  T. Woodward,et al.  Metacognitive training in schizophrenia: from basic research to knowledge translation and intervention , 2007, Current opinion in psychiatry.

[100]  Rachel N. Denison,et al.  What do models of visual perception tell us about visual phenomenology? , 2020, Neuroscience and Philosophy.

[101]  V. Lamme,et al.  No-Report Paradigms: Extracting the True Neural Correlates of Consciousness , 2015, Trends in Cognitive Sciences.

[102]  I. V. van Rooij,et al.  Theory Before the Test: How to Build High-Verisimilitude Explanatory Theories in Psychological Science , 2020, Perspectives on psychological science : a journal of the Association for Psychological Science.

[103]  Peter D. Kvam,et al.  The Confidence Database , 2019, Nature Human Behaviour.

[104]  Michael A. Pitts,et al.  The Consciousness Theories Studies (ConTraSt) database: analyzing and comparing empirical studies of consciousness theories , 2021, bioRxiv.

[105]  Joseph E LeDoux,et al.  Understanding the Higher-Order Approach to Consciousness , 2019, Trends in Cognitive Sciences.

[106]  Johannes J. Fahrenfort,et al.  Seeing without Knowing: Neural Signatures of Perceptual Inference in the Absence of Report , 2014, Journal of Cognitive Neuroscience.

[107]  R. Dolan,et al.  Confidence drives a neural confirmation bias , 2020, Nature Communications.

[108]  Simon Farrell,et al.  Benchmarks for models of short-term and working memory. , 2018, Psychological bulletin.

[109]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[110]  Ariel Zylberberg,et al.  The construction of confidence in a perceptual decision , 2012, Front. Integr. Neurosci..

[111]  S. Dehaene.  Consciousness and the brain : deciphering how the brain codes our thoughts , 2014 .

[112]  Janina Decker,et al.  Scientific Knowledge And Its Social Problems , 2016 .

[113]  Maxine T. Sherman,et al.  Domain-General Enhancements of Metacognitive Ability Through Adaptive Training , 2018, bioRxiv.

[114]  P. Mamassian.  Confidence Forced-Choice and Other Metaperceptual Tasks* , 2020, Perception.

[115]  Roger Ratcliff,et al.  Modeling confidence judgments, response times, and multiple choices in decision making: recognition memory and motion discrimination. , 2013, Psychological review.

[116]  Jan Drugowitsch,et al.  Specific cognitive signatures of information seeking in controllable environments , 2021 .

[117]  Nick Yeung,et al.  Confidence Predictions Affect Performance Confidence and Neural Preparation in Perceptual Decision Making , 2019, Scientific Reports.

[118]  Mark D'Esposito,et al.  Confidence Leak in Perceptual Decision Making , 2015, Psychological science.

[119]  F. Balcı,et al.  Metric error monitoring: Another generalized mechanism for magnitude representations? , 2021, Cognition.

[120]  C. Koch,et al.  Spatial attention increases performance but not subjective confidence in a discrimination task. , 2008, Journal of vision.

[121]  Nicholas Shea,et al.  The Global Workspace Needs Metacognition , 2019, Trends in Cognitive Sciences.

[122]  M. D’Esposito,et al.  Causal evidence for frontal cortex organization for perceptual decision making , 2016, Proceedings of the National Academy of Sciences.

[123]  Michael Zehetleitner,et al.  Being confident without seeing: What subjective measures of visual consciousness are about , 2013, Attention, Perception, & Psychophysics.

[124]  Christopher Kennard,et al.  Learning and Recognition of a Non-conscious Sequence of Events in Human Primary Visual Cortex , 2016, Current Biology.

[125]  Elisabeth Norman,et al.  Measuring consciousness with confidence ratings , 2015 .

[126]  Hakwan Lau,et al.  Does perceptual confidence facilitate cognitive control? , 2015, Attention, Perception, & Psychophysics.

[127]  M. Kawato,et al.  Multivoxel neurofeedback selectively modulates confidence without changing perceptual performance , 2016, Nature Communications.

[128]  V. de Gardelle,et al.  Confidence can be automatically integrated across two visual decisions. , 2020, Journal of experimental psychology. Human perception and performance.

[129]  P. Mamassian,et al.  Confidence controls perceptual evidence accumulation , 2020, Nature Communications.

[130]  Hakwan Lau,et al.  A decisional account of subjective inflation of visual perception at the periphery , 2014, Attention, Perception, & Psychophysics.

[131]  Tony Ro,et al.  Action-Specific Disruption of Perceptual Confidence , 2015, Psychological science.

[132]  Kathryn Bonnen,et al.  Beyond Trial-Based Paradigms: Continuous Behavior, Ongoing Neural Activity, and Natural Stimuli , 2018, The Journal of Neuroscience.

[133]  Timothy J. Pleskac,et al.  Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. , 2010, Psychological review.

[134]  H. Lau,et al.  A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings , 2012, Consciousness and Cognition.

[135]  Kiyofumi Miyoshi,et al.  A decision-congruent heuristic gives superior metacognitive sensitivity under realistic variance assumptions. , 2020, Psychological review.

[136]  V. de Gardelle,et al.  Hydrocortisone decreases metacognitive efficiency independent of perceived stress , 2020, Scientific Reports.

[137]  B. Baars.  A Thoroughly Empirical Approach To Consciousness , 1994 .

[138]  T. Birdsall,et al.  Two Types of ROC Curves and Definitions of Parameters , 1959 .

[139]  Axel Cleeremans,et al.  Measuring consciousness: Task accuracy and awareness as sigmoid functions of stimulus duration , 2011, Consciousness and Cognition.

[140]  Joel L. Voss,et al.  Associative Recognition Memory Awareness Improved by Theta-Burst Stimulation of Frontopolar Cortex. , 2016, Cerebral cortex.

[141]  P. Sterzer,et al.  Mesolimbic confidence signals guide perceptual learning in the absence of external feedback , 2016, eLife.

[142]  Johannes Burge,et al.  Continuous psychophysics: Target-tracking to measure visual sensitivity. , 2015, Journal of vision.

[143]  S. Fleming,et al.  Metacognitive asymmetries in visual perception , 2021, Neuroscience of consciousness.

[144]  Megan A. K. Peters,et al.  An investigation of how relative precision of target encoding influences metacognitive performance , 2020, Attention, Perception, & Psychophysics.

[145]  Marta Siedlecka,et al.  But I Was So Sure! Metacognitive Judgments Are Less Accurate Given Prospectively than Retrospectively , 2016, Frontiers in Psychology.

[146]  V. de Gardelle,et al.  Resilience of perceptual metacognition in a dual-task paradigm , 2020, Psychonomic Bulletin & Review.

[147]  V. de Gardelle,et al.  Does social context impact metacognition? Evidence from stereotype threat in a visual search task , 2019, PloS one.

[148]  M. Landy,et al.  Priors and payoffs in confidence judgments , 2019, Attention, Perception, & Psychophysics.

[149]  Florent Meyniel,et al.  On-line confidence monitoring during decision making , 2018, Cognition.

[150]  Christopher R Fetsch,et al.  The influence of evidence volatility on choice, reaction time and confidence in a perceptual decision , 2016, eLife.

[151]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[152]  Nick Yeung,et al.  Subjective Confidence Predicts Information Seeking in Decision Making , 2018, Psychological science.

[153]  Pieter R. Roelfsema,et al.  Variance misperception explains illusions of confidence in simple perceptual decisions , 2014, Consciousness and Cognition.

[154]  Janneke F. M. Jehee,et al.  Dual strategies in human confidence judgments , 2020, bioRxiv.

[155]  Pascal Mamassian,et al.  Weighting Mean and Variability during Confidence Judgments , 2015, PloS one.

[156]  H. Lau,et al.  Empirical support for higher-order theories of conscious awareness , 2011, Trends in Cognitive Sciences.

[157]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .