Introspective inference counteracts perceptual distortion

Introspective agents can recognize the extent to which their internal perceptual experiences deviate from the actual states of the external world. This ability, also known as insight, is critically required for reality testing and is impaired in psychosis, yet very little is known about its cognitive underpinnings. We developed a Bayesian modeling framework and a novel psychophysics paradigm to quantitatively characterize this type of insight while participants experienced a motion after-effect illusion. Participants could incorporate knowledge about the illusion into their decisions when judging the actual direction of a motion stimulus, compensating for the illusion (and often overcompensating). Furthermore, confidence, reaction-time, and pupil-dilation data all showed signatures consistent with inferential adjustments in the Bayesian insight model. Our results suggest that people can question the veracity of what they see by making insightful inferences that incorporate introspective knowledge about internal distortions.

[1]  S. Gershman,et al.  Pupil Size Encodes Uncertainty during Exploration , 2023, Journal of Cognitive Neuroscience.

[2]  S. Fleming,et al.  Subjective signal strength distinguishes reality from imagination , 2023, Nature Communications.

[3]  Robbe L. T. Goris,et al.  Confidence reflects a noisy decision reliability estimate , 2022, Nature Human Behaviour.

[4]  M. Landy,et al.  Suprathreshold perceptual decisions constrain models of confidence , 2022, PLoS Comput. Biol..

[5]  P. Corlett,et al.  Targeted effects of ketamine on perceptual expectation during mediated learning in rats , 2022, Psychopharmacology.

[6]  D. Rahnev Visual metacognition: Measures, models, and neural correlates. , 2021, The American psychologist.

[7]  D. Pressnitzer,et al.  An implicit representation of stimulus ambiguity in pupil size , 2021, Proceedings of the National Academy of Sciences.

[8]  P. Mamassian,et al.  Perceptual confidence judgments reflect self-consistency , 2021, Journal of vision.

[9]  S. Fleming,et al.  Imagery adds stimulus-specific sensory evidence to perceptual detection , 2021, Journal of Vision.

[10]  Ralf M. Haefner,et al.  Aberrant causal inference and presence of a compensatory mechanism in autism spectrum disorder , 2021, eLife.

[11]  S. Fleming,et al.  Perceptual reality monitoring: Neural mechanisms dissociating imagination from reality , 2021, Neuroscience & Biobehavioral Reviews.

[12]  Jorge Morales,et al.  Introspection Is Signal Detection , 2021, The British Journal for the Philosophy of Science.

[13]  S. Fleming,et al.  Mistaking imagination for reality: Congruent mental imagery leads to more liberal perceptual detection , 2021, Cognition.

[14]  Pascal Mamassian,et al.  Consensus Goals in the Field of Visual Metacognition , 2021, Perspectives on psychological science : a journal of the Association for Psychological Science.

[15]  Guillermo Horga,et al.  Rethinking delusions: A selective review of delusion research through a computational lens , 2021, Schizophrenia Research.

[16]  Katharine N. Thakkar,et al.  Stronger tilt aftereffects in persons with schizophrenia. , 2020, Journal of abnormal psychology.

[17]  D. Burr,et al.  Pupillary Responses Obey Emmert’s Law and Co-vary with Autistic Traits , 2020, Journal of Autism and Developmental Disorders.

[18]  A. David Insight and psychosis: the next 30 years. , 2020, The British journal of psychiatry : the journal of mental science.

[19]  Wei Ji Ma,et al.  The psychophysics of visual search with heterogeneous distractors , 2020, bioRxiv.

[20]  Rafal Bogacz,et al.  Bayesian confidence in optimal decisions , 2020 .

[21]  David C. Burr,et al.  Adaptation to hand-tapping affects sensory processing of numerosity directly: evidence from reaction times and confidence , 2020, Proceedings of the Royal Society B.

[22]  D. Henderson,et al.  Working With Patients With Impaired Insight. , 2020, JAMA psychiatry.

[23]  Erlend S. Dørum,et al.  Dissecting the cognitive phenotype of post‐stroke fatigue using computerized assessment and computational modeling of sustained attention , 2020, The European journal of neuroscience.

[24]  D. Rahnev,et al.  The nature of metacognitive inefficiency in perceptual decision making. , 2020, Psychological review.

[25]  D. Rahnev,et al.  The Impact of Feedback on Perceptual Decision-Making and Metacognition: Reduction in Bias but No Change in Sensitivity , 2020, Psychological science.

[26]  John D. Murray,et al.  A flexible framework for simulating and fitting generalized drift-diffusion models , 2020, bioRxiv.

[27]  J. Gold,et al.  Pupil Size as a Window on Neural Substrates of Cognition , 2019, Trends in Cognitive Sciences.

[28]  Anna C. Nobre,et al.  Modulation of the pupillary response by the content of visual working memory , 2019, Proceedings of the National Academy of Sciences.

[29]  Gouki Okazawa,et al.  Designing and Interpreting Psychophysical Investigations of Cognition , 2019, Neuron.

[30]  Wei Ji Ma,et al.  Bayesian Decision Models: A Primer , 2019, Neuron.

[31]  J. Brunelin,et al.  Reality-monitoring deficits and visual hallucinations in schizophrenia , 2019, European Psychiatry.

[32]  Samuel J. Gershman,et al.  The Generative Adversarial Brain , 2019, Front. Artif. Intell..

[33]  M. Landy,et al.  Priors and payoffs in confidence judgments , 2019, Attention, Perception, & Psychophysics.

[34]  Alexandre Zénon,et al.  Eye pupil signals information gain , 2019, bioRxiv.

[35]  H. Lau Consciousness, Metacognition, & Perceptual Reality Monitoring , 2019 .

[36]  Katharine N. Thakkar,et al.  A review of visual aftereffects in schizophrenia , 2019, Neuroscience & Biobehavioral Reviews.

[37]  Katharine N. Thakkar,et al.  Altered short-term neural plasticity related to schizotypal traits: Evidence from visual adaptation , 2019, Schizophrenia Research.

[38]  Wei Ji Ma,et al.  Confidence reports in decision-making with multiple alternatives violate the Bayesian confidence hypothesis , 2019, bioRxiv.

[39]  Albert R. Powers,et al.  Hallucinations and Strong Priors , 2019, Trends in Cognitive Sciences.

[40]  Alexandre Pouget,et al.  The impact of learning on perceptual decisions and its implication for speed-accuracy tradeoffs , 2018, bioRxiv.

[41]  Derek H. Arnold,et al.  The implied motion aftereffect changes decisions, but not confidence , 2018, Attention, Perception, & Psychophysics.

[42]  J. Winawer,et al.  Sensory and decision-making processes underlying perceptual adaptation , 2018, Journal of vision.

[43]  Danique Jeurissen,et al.  Focal optogenetic suppression in macaque area MT biases direction discrimination and decision confidence, but only transiently , 2018, eLife.

[44]  M. Kret,et al.  Preprocessing pupil size data: Guidelines and code , 2018, Behavior research methods.

[45]  Constant D. Beugré,et al.  The neural basis of decision making , 2018 .

[46]  Olympia Colizoli,et al.  Task-evoked pupil responses reflect internal belief states , 2018, Scientific Reports.

[47]  Derek H. Arnold,et al.  Confidence as a diagnostic tool for perceptual aftereffects , 2018, Scientific Reports.

[48]  Wei Ji Ma,et al.  Comparing Bayesian and non-Bayesian accounts of human confidence reports , 2018, PLoS Comput. Biol..

[49]  Anne E. Urai,et al.  Choice history biases subsequent evidence accumulation , 2018, bioRxiv.

[50]  Sebastiaan Mathôt,et al.  Safe and sensible preprocessing and baseline correction of pupil-size data , 2018, Behavior Research Methods.

[51]  Wei Ji Ma,et al.  Limitations of proposed signatures of Bayesian confidence , 2017, bioRxiv.

[52]  Michael M. Halassa,et al.  A Low-Level Perceptual Correlate of Behavioral and Clinical Deficits in ADHD , 2017, bioRxiv.

[53]  P. Ljungdalh Non-adherence to pharmacological treatment in schizophrenia and schizophrenia spectrum disorders – An updated systematic literature review , 2017 .

[54]  Albert R. Powers,et al.  Pavlovian conditioning–induced hallucinations result from overweighting of perceptual priors , 2017, Science.

[55]  Marcia K. Johnson,et al.  Brain Mechanisms of Reality Monitoring , 2017, Trends in Cognitive Sciences.

[56]  Luigi Acerbi,et al.  Practical Bayesian Optimization for Model Fitting with Bayesian Adaptive Direct Search , 2017, NIPS.

[57]  Anne E. Urai,et al.  Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias , 2017, Nature Communications.

[58]  Aspen H. Yoo,et al.  Fechner’s Law in Metacognition: A Quantitative Model of Visual Working Memory Confidence , 2017, Psychological review.

[59]  Nathaniel D. Daw,et al.  Self-Evaluation of Decision-Making: A General Bayesian Framework for Metacognitive Computation , 2017, Psychological review.

[60]  D. Schwarzkopf,et al.  Unexpected arousal modulates the influence of sensory noise on confidence , 2016, eLife.

[61]  Alexandre Pouget,et al.  Confidence and certainty: distinct probabilistic quantities for different goals , 2016, Nature Neuroscience.

[62]  M. Sigman,et al.  Confidence as Bayesian Probability: From Neural Origins to Behavior , 2015, Neuron.

[63]  Hakwan Lau,et al.  Human observers have optimal introspective access to perceptual processes even for visually masked stimuli , 2015, eLife.

[64]  Stephen M. Fleming,et al.  Relating Pupil Dilation and Metacognitive Confidence during Auditory Decision-Making , 2015, PloS one.

[65]  A. Bompas,et al.  The effect of eye movements and blinks on afterimage appearance and duration. , 2015, Journal of vision.

[66]  Bingni W. Brunton,et al.  Distinct relationships of parietal and prefrontal cortices to evidence accumulation , 2014, Nature.

[67]  Wei Ji Ma,et al.  Neural coding of uncertainty and probability. , 2014, Annual review of neuroscience.

[68]  P. Corlett,et al.  Dreams, reality and memory: confabulations in lucid dreamers implicate reality-monitoring dysfunction in dream consciousness , 2014, Cognitive neuropsychiatry.

[69]  H. Lau,et al.  How to measure metacognition , 2014, Front. Hum. Neurosci..

[70]  C. White,et al.  Decomposing bias in different types of simple decisions. , 2014, Journal of experimental psychology. Learning, memory, and cognition.

[71]  Jeremy Freeman,et al.  Coarse-Scale Biases for Spirals and Orientation in Human Visual Cortex , 2013, The Journal of Neuroscience.

[72]  N. Prins The psi-marginal adaptive method: How to give nuisance parameters the attention they deserve (no more, no less). , 2013, Journal of vision.

[73]  Paola Binda,et al.  Pupil constrictions to photographs of the sun. , 2013, Journal of vision.

[74]  R. Dolan,et al.  Confidence in value-based choice , 2012, Nature Neuroscience.

[75]  J. Hernández,et al.  Medication adherence in schizophrenia. , 2012, World journal of psychiatry.

[76]  D. Shohamy,et al.  Preference by Association: How Memory Mechanisms in the Hippocampus Bias Decisions , 2012, Science.

[77]  Stefan Glasauer,et al.  Combining Symbolic Cues with Sensory Input and Prior Experience in an Iterative Bayesian Framework , 2012, Front. Integr. Neurosci..

[78]  Nicolaas Prins,et al.  The Adaptive Psi Method and the Lapse Rate , 2012 .

[79]  R. Dolan,et al.  The neural basis of metacognitive ability , 2012, Philosophical Transactions of the Royal Society B: Biological Sciences.

[80]  S. Martinez-Conde,et al.  Microsaccades and Blinks Trigger Illusory Rotation in the “Rotating Snakes” Illusion , 2012, The Journal of Neuroscience.

[81]  Alessio Fracasso,et al.  Unseen complex motion is modulated by attention and generates a visible aftereffect. , 2011, Journal of vision.

[82]  M. Morgan,et al.  Observers can voluntarily shift their psychometric functions without losing sensitivity , 2011, Attention, perception & psychophysics.

[83]  Zara M. Bergström,et al.  A Specific Brain Structural Basis for Individual Differences in Reality Monitoring , 2011, The Journal of Neuroscience.

[84]  Geraint Rees,et al.  Relating Introspective Accuracy to Individual Differences in Brain Structure , 2010, Science.

[85]  Jonathan Winawer,et al.  A motion aftereffect from visual imagery of motion , 2010, Cognition.

[86]  M. Coltheart,et al.  Confabulation and delusion: A common monitoring framework , 2010, Cognitive neuropsychiatry.

[87]  Alan A. Stocker,et al.  Is the Homunculus Aware of Sensory Adaptation? , 2009, Neural Computation.

[88]  Sjoerd Stuit,et al.  Motion processing, adaptation and aftereffects: A review , 2009 .

[89]  Eero P. Simoncelli,et al.  Visual motion aftereffects arise from a cascade of two isomorphic adaptation mechanisms. , 2009, Journal of vision.

[90]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[91]  Timothy D. Hanks,et al.  Probabilistic Population Codes for Bayesian Decision Making , 2008, Neuron.

[92]  P. Dayan,et al.  Decision theory, reinforcement learning, and the brain , 2008, Cognitive, affective & behavioral neuroscience.

[93]  Sophia Vinogradov,et al.  Deficit in a neural correlate of reality monitoring in schizophrenia patients. , 2008, Cerebral cortex.

[94]  Shane T. Mueller,et al.  Decision noise: An explanation for observed violations of signal detection theory , 2008, Psychonomic bulletin & review.

[95]  Konrad Paul Kording,et al.  Causal Inference in Multisensory Perception , 2007, PloS one.

[96]  Theodore D. Satterthwaite,et al.  Dissociable but inter-related systems of cognitive control and reward during decision making: Evidence from pupillometry and event-related fMRI , 2007, NeuroImage.

[97]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[98]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[99]  A. Kohn Visual adaptation: physiology, mechanisms, and functional benefits. , 2007, Journal of neurophysiology.

[100]  J. Movshon,et al.  A new perceptual illusion reveals mechanisms of sensory decoding , 2007, Nature.

[101]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[102]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[103]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[104]  Alan A. Stocker,et al.  Sensory Adaptation within a Bayesian Framework for Perception , 2005, NIPS.

[105]  Denis Cousineau,et al.  Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson's method , 2005 .

[106]  G. Rhodes,et al.  Fitting the Mind to the World: Adaptation and after-effects in high-level vision , 2005 .

[107]  S. Aghdaee,et al.  Adaptation to Spiral Motion in Crowding Condition , 2005, Perception.

[108]  C. Faravelli Assessment of Psychopathology , 2004, Psychotherapy and Psychosomatics.

[109]  S. Blakemore,et al.  Delusions of alien control in the normal brain , 2003, Neuropsychologia.

[110]  J. Movshon,et al.  Neuronal Adaptation to Visual Motion in Area MT of the Macaque , 2003, Neuron.

[111]  Ralf Engbert,et al.  Microsaccades uncover the orientation of covert attention , 2003, Vision Research.

[112]  Frans W Cornelissen,et al.  The Eyelink Toolbox: Eye tracking with MATLAB and the Psychophysics Toolbox , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[113]  K. H. Britten,et al.  Multiple uses of visual motion. The case for stability in sensory cortex , 2002, Neuroscience.

[114]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[115]  F A Wichmann,et al.  Ning for Helpful Comments and Suggestions. This Paper Benefited Con- Siderably from Conscientious Peer Review, and We Thank Our Reviewers the Psychometric Function: I. Fitting, Sampling, and Goodness of Fit , 2001 .

[116]  D. Heeger,et al.  Neuronal Basis of the Motion Aftereffect Reconsidered , 2001, Neuron.

[117]  R. Jacobs,et al.  Optimal integration of texture and motion cues to depth , 1999, Vision Research.

[118]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[119]  A. Metha,et al.  Enhanced motion aftereffect for complex motions , 1999, Vision Research.

[120]  J. Movshon,et al.  Pattern adaptation and cross-orientation interactions in the primary visual cortex , 1998, Neuropharmacology.

[121]  S. Nishida,et al.  Contrast Dependencies of Two Types of Motion Aftereffect , 1997, Vision Research.

[122]  C. Cahill Psychotic experiences induced in deluded patients using distorted auditory feedback. , 1996, Cognitive neuropsychiatry.

[123]  Naoyuki Osaka,et al.  Motion aftereffect with flickering test stimuli depends on adapting velocity , 1995, Vision Research.

[124]  R. Blake,et al.  Interocular Transfer of Expansion, Rotation, and Translation Motion Aftereffects , 1994, Perception.

[125]  J. Baird A theory of perception. , 1994, Science.

[126]  M. Graziano,et al.  Tuning of MST neurons to spiral motions , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[127]  R. Blake,et al.  Another means for measuring the motion aftereffect , 1993, Vision Research.

[128]  R. Bentall,et al.  Reality testing and auditory hallucinations: a signal detection analysis. , 1985, The British journal of clinical psychology.

[129]  P Cavanagh,et al.  Motion Aftereffect: A Global Mechanism for the Perception of Rotation , 1980, Perception.

[130]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[131]  A. Pantle,et al.  Motion aftereffect as a function of the contrast of sinusoidal gratings , 1976, Vision Research.

[132]  H. Akaike A new look at the statistical model identification , 1974 .

[133]  B. Maher,et al.  Delusional thinking and perceptual disorder. , 1974, Journal of individual psychology.

[134]  Albert R. Powers,et al.  Varieties of Voice-Hearing: Psychics and the Psychosis Continuum , 2017, Schizophrenia bulletin.

[135]  Michael N. Shadlen,et al.  Effects of Cortical Microstimulation on Confidence in a Perceptual Decision , 2014, Neuron.

[136]  Thomas S Wallsten,et al.  A stochastic detection and retrieval model for the study of metacognition. , 2012, Psychological review.

[137]  ChrisD . Frith,et al.  Perceiving is believing: a Bayesian approach to explaining the positive symptoms of schizophrenia , 2009, Nature Reviews Neuroscience.

[138]  J. Harris,et al.  Evidence for spatio-temporal selectivity in attentional modulation of the motion aftereffect. , 2002, Spatial vision.

[139]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[140]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[141]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .