The signal processing architecture underlying subjective reports of sensory awareness

Abstract What is the relationship between perceptual information processing and subjective perceptual experience? Empirical dissociations between stimulus identification performance and subjective reports of stimulus visibility are crucial for shedding light on this question. We replicated a finding that metacontrast masking can produce such a dissociation (Lau and Passingham, 2006), and report a novel finding that this paradigm can also dissociate stimulus identification performance from the efficacy with which visibility ratings predict task performance. We explored various hypotheses about the relationship between perceptual task performance and visibility rating by implementing them in computational models and using formal model comparison techniques to assess which ones best captured the unusual patterns in the data. The models fell into three broad categories: Single Channel models, which hold that task performance and visibility ratings are based on the same underlying source of information; Dual Channel models, which hold that there are two independent processing streams that differentially contribute to task performance and visibility rating; and Hierarchical models, which hold that a late processing stage generates visibility ratings by evaluating the quality of early perceptual processing. Taking into account the quality of data fitting and model complexity, we found that Hierarchical models perform best at capturing the observed behavioral dissociations. Because current theories of visual awareness map well onto these different model structures, a formal comparison between them is a powerful approach for arbitrating between the different theories.

[1]  Shane T. Mueller,et al.  Decision noise: An explanation for observed violations of signal detection theory , 2008, Psychonomic bulletin & review.

[2]  Stanislas Dehaene,et al.  Distinct Brain Mechanisms for Conscious versus Subliminal Error Detection , 2022 .

[3]  K. R. Ridderinkhof,et al.  Dissociating consciousness from inhibitory control: evidence for unconsciously triggered response inhibition in the stop-signal task. , 2009, Journal of experimental psychology. Human perception and performance.

[4]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[5]  Geraint Rees,et al.  Relating Introspective Accuracy to Individual Differences in Brain Structure , 2010, Science.

[6]  Jeffrey N Rouder,et al.  An assessment of fixed-capacity models of visual working memory , 2008, Proceedings of the National Academy of Sciences.

[7]  S. Dehaene,et al.  Causal role of prefrontal cortex in the threshold for access to consciousness. , 2009, Brain : a journal of neurology.

[8]  Hakwan Lau,et al.  Manipulation of working memory contents selectively impairs metacognitive sensitivity in a concurrent visual discrimination task , 2015, Neuroscience of consciousness.

[9]  A Gorea,et al.  Failure to handle more than one internal representation in visual detection tasks. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[10]  R. Ratcliff,et al.  Modeling confidence and response time in recognition memory. , 2009, Psychological review.

[11]  Hakwan Lau,et al.  Signal Detection Theory Analysis of Type 1 and Type 2 Data: Meta-d′, Response-Specific Meta-d′, and the Unequal Variance SDT Model , 2014 .

[12]  Irwin Pollack,et al.  Sampling variability of the area under the ROC-curve and of d'e. , 1969 .

[13]  R. Passingham,et al.  Relative blindsight in normal observers and the neural correlate of visual consciousness , 2006, Proceedings of the National Academy of Sciences.

[14]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[15]  H. Lau Volition and the functions of consciousness , 2009, Neuroscience Research.

[16]  Susan J. Galvin,et al.  Type 2 tasks in the theory of signal detectability: Discrimination between correct and incorrect decisions , 2003, Psychonomic bulletin & review.

[17]  Joel Pearson,et al.  Unconscious information changes decision accuracy but not confidence , 2014, Proceedings of the National Academy of Sciences.

[18]  K. R. Ridderinkhof,et al.  Frontal Cortex Mediates Unconsciously Triggered Inhibitory Control , 2008, The Journal of Neuroscience.

[19]  H. Lau,et al.  Empirical support for higher-order theories of conscious awareness , 2011, Trends in Cognitive Sciences.

[20]  Stanislas Dehaene,et al.  Decoding the Dynamics of Action, Intention, and Error Detection for Conscious and Subliminal Stimuli , 2014, The Journal of Neuroscience.

[21]  Hatim A. Zariwala,et al.  Neural correlates, computation and behavioural impact of decision confidence , 2008, Nature.

[22]  David R. Shanks,et al.  A unitary signal-detection model of implicit and explicit memory , 2008, Trends in Cognitive Sciences.

[23]  D. Dorfman,et al.  Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data , 1969 .

[24]  J. Metcalfe,et al.  Metacognition : knowing about knowing , 1994 .

[25]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[26]  Tim Curran,et al.  Retrieval dynamics of recognition and frequency judgments: Evidence for separate processes of familiarity and recall. , 1994 .

[27]  N. Block Consciousness, accessibility, and the mesh between psychology and neuroscience , 2007, Behavioral and Brain Sciences.

[28]  Carey K. Morewedge,et al.  Associative processes in intuitive judgment , 2010, Trends in Cognitive Sciences.

[29]  Matthew J. Davidson,et al.  Awareness-related activity in prefrontal and parietal cortices reflects more than superior performance capacity: A blindsight case study , 2010 .

[30]  M. Steyvers,et al.  The dynamics of experimentally induced criterion shifts. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[31]  Paul Azzopardi,et al.  Blindsight and Visual Awareness , 1998, Consciousness and Cognition.

[32]  Bruce Luber,et al.  Direct injection of noise to the visual cortex decreases accuracy but increases decision confidence. , 2012, Journal of neurophysiology.

[33]  T. Birdsall,et al.  Two Types of ROC Curves and Definitions of Parameters , 1959 .

[34]  S. Fleming,et al.  Domain-specific impairment in metacognitive accuracy following anterior prefrontal lesions , 2014, Brain : a journal of neurology.

[35]  Yutaka Komura,et al.  Responses of pulvinar neurons reflect a subject's confidence in visual categorization , 2013, Nature Neuroscience.

[36]  C. Koch,et al.  Spatial attention increases performance but not subjective confidence in a discrimination task. , 2008, Journal of vision.

[37]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[38]  Timothy J. Pleskac,et al.  Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. , 2010, Psychological review.

[39]  J. D. Smith The study of animal metacognition , 2009, Trends in Cognitive Sciences.

[40]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[41]  H. Lau,et al.  Attention induces conservative subjective biases in visual perception , 2011, Nature Neuroscience.

[42]  A. Koulakov,et al.  Orbitofrontal Cortex Is Required for Optimal Waiting Based on Decision Confidence , 2014, Neuron.

[43]  J. Changeux,et al.  A neuronal network model linking subjective reports and objective physiological data during conscious perception , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Anil K. Seth,et al.  Blind Insight: Metacognitive Discrimination Despite Chance Task Performance , 2014, Psychological science.

[45]  J. Wixted Dual-process theory and signal-detection theory of recognition memory. , 2007, Psychological review.

[46]  R. Clark,et al.  Recognition memory and the medial temporal lobe: a new perspective , 2007, Nature Reviews Neuroscience.

[47]  R. Nosofsky,et al.  Identifying strategy use in category learning tasks: a case for more diagnostic data and models. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[48]  L. Weiskrantz Blindsight : a case study and implications , 1986 .

[49]  J. Changeux,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.5 May 2006 Conscious, preconscious, and subliminal processing: a testable taxonomy , 2022 .

[50]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[51]  Axel Cleeremans,et al.  Consciousness and metarepresentation: A computational sketch , 2007, Neural Networks.

[52]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[53]  Michael N. Shadlen,et al.  Effects of Cortical Microstimulation on Confidence in a Perceptual Decision , 2014, Neuron.

[54]  T. Papathomas,et al.  Audiovisual short-term influences and aftereffects in motion: examination across three sets of directional pairings. , 2008, Journal of vision.

[55]  Simon van Gaal,et al.  Unconscious Activation of the Prefrontal No-Go Network , 2010, The Journal of Neuroscience.

[56]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[57]  V. Lamme,et al.  Repression of unconscious information by conscious processing: evidence from affective blindsight induced by transcranial magnetic stimulation. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[58]  V. Lamme Towards a true neural stance on consciousness , 2006, Trends in Cognitive Sciences.

[59]  H. Lau,et al.  A signal detection theoretic approach for estimating metacognitive sensitivity from confidence ratings , 2012, Consciousness and Cognition.

[60]  H. Lau Theoretical motivations for investigating the neural correlates of consciousness. , 2011, Wiley interdisciplinary reviews. Cognitive science.

[61]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[62]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[63]  R. Passingham,et al.  Theta-burst transcranial magnetic stimulation to the prefrontal cortex impairs metacognitive visual awareness , 2010, Cognitive neuroscience.

[64]  M. Goodale,et al.  The visual brain in action , 1995 .