A dual role of prestimulus spontaneous neural activity in visual object recognition

Vision relies on both specific knowledge of visual attributes, such as object categories, and general brain states, such as those reflecting arousal. We hypothesized that these phenomena independently influence recognition of forthcoming stimuli through distinct processes reflected in spontaneous neural activity. Here, we recorded magnetoencephalographic (MEG) activity in participants (N = 24) who viewed images of objects presented at recognition threshold. Using multivariate analysis applied to sensor-level activity patterns recorded before stimulus presentation, we identified two neural processes influencing subsequent subjective recognition: a general process, which disregards stimulus category and correlates with pupil size, and a specific process, which facilitates category-specific recognition. The two processes are doubly-dissociable: the general process correlates with changes in criterion but not in sensitivity, whereas the specific process correlates with changes in sensitivity but not in criterion. Our findings reveal distinct mechanisms of how spontaneous neural activity influences perception and provide a framework to integrate previous findings. The effect of spontaneous variations in prestimulus neural activity on subsequent perception is incompletely understood. Here, using MEG, the authors identify two distinct neural processes that can influence object recognition in different ways.

[1]  R. O’Connell,et al.  Pupil diameter covaries with BOLD activity in human locus coeruleus , 2014, Human brain mapping.

[2]  Dario L Ringach,et al.  Spontaneous and driven cortical activity: implications for computation , 2009, Current Opinion in Neurobiology.

[3]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[4]  Leonie Welberg,et al.  Epigenetics: A lingering smell? , 2013, Nature Reviews Neuroscience.

[5]  J. Cohen,et al.  Catecholamine-Mediated Increases in Gain Enhance the Precision of Cortical Representations , 2016, The Journal of Neuroscience.

[6]  Biyu J He,et al.  Spatiotemporal Dissociation of Brain Activity Underlying Subjective Awareness, Objective Performance and Confidence , 2014, The Journal of Neuroscience.

[7]  David A. Tovar,et al.  Representational dynamics of object vision: the first 1000 ms. , 2013, Journal of vision.

[8]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[9]  Timothy J. Andrews,et al.  Category-selective patterns of neural response in the ventral visual pathway in the absence of categorical information , 2016, NeuroImage.

[10]  R. VanRullen,et al.  The Phase of Ongoing EEG Oscillations Predicts Visual Perception , 2009, The Journal of Neuroscience.

[11]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[12]  R. Desimone,et al.  Neural Mechanisms of Object-Based Attention , 2014, Science.

[13]  P. Roelfsema,et al.  The threshold for conscious report: Signal loss and response bias in visual and frontal cortex , 2018, Science.

[14]  J. Schoffelen,et al.  Prestimulus Oscillatory Activity in the Alpha Band Predicts Visual Discrimination Ability , 2008, The Journal of Neuroscience.

[15]  Radoslaw Martin Cichy,et al.  The representational dynamics of task and object processing in humans , 2018, eLife.

[16]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[17]  Meytal Wilf,et al.  Spontaneously Emerging Patterns in Human Visual Cortex Reflect Responses to Naturalistic Sensory Stimuli , 2015, Cerebral cortex.

[18]  J B Poline,et al.  Cerebral mechanisms of word masking and unconscious repetition priming , 2001, Nature Neuroscience.

[19]  Martin Luessi,et al.  MNE software for processing MEG and EEG data , 2014, NeuroImage.

[20]  Stefan M. Wierda,et al.  Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution , 2012, Proceedings of the National Academy of Sciences.

[21]  Michael J. Goard,et al.  Basal Forebrain Activation Enhances Cortical Coding of Natural Scenes , 2009, Nature Neuroscience.

[22]  S. Kouider,et al.  Spontaneous Activity Patterns in Primary Visual Cortex Predispose to Visual Hallucinations , 2015, The Journal of Neuroscience.

[23]  Jessica A. Cardin,et al.  Waking State: Rapid Variations Modulate Neural and Behavioral Responses , 2015, Neuron.

[24]  N A Macmillan,et al.  Detection theory analysis of group data: estimating sensitivity from average hit and false-alarm rates. , 1985, Psychological bulletin.

[25]  M. Bar,et al.  Cortical Mechanisms Specific to Explicit Visual Object Recognition , 2001, Neuron.

[26]  C. Tallon-Baudry,et al.  Neural Dissociation between Visual Awareness and Spatial Attention , 2008, The Journal of Neuroscience.

[27]  Laura Leuchs,et al.  Spontaneous pupil dilations during the resting state are associated with activation of the salience network , 2016, NeuroImage.

[28]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[29]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[30]  K. Harris,et al.  Cortical state and attention , 2011, Nature Reviews Neuroscience.

[31]  Vaidehi S. Natu,et al.  Development differentially sculpts receptive fields across early and high-level human visual cortex , 2018, Nature Communications.

[32]  Andreas Kleinschmidt,et al.  Spontaneous local variations in ongoing neural activity bias perceptual decisions , 2008, Proceedings of the National Academy of Sciences.

[33]  A. Grinvald,et al.  Linking spontaneous activity of single cortical neurons and the underlying functional architecture. , 1999, Science.

[34]  C. Tallon-Baudry,et al.  How Ongoing Fluctuations in Human Visual Cortex Predict Perceptual Awareness: Baseline Shift versus Decision Bias , 2009, The Journal of Neuroscience.

[35]  T. Ergenoğlu,et al.  Alpha rhythm of the EEG modulates visual detection performance in humans. , 2004, Brain research. Cognitive brain research.

[36]  James J. DiCarlo,et al.  Unsupervised Natural Experience Rapidly Alters Invariant Object Representation in Visual Cortex , 2008, Science.

[37]  David L. Sheinberg,et al.  Visual object recognition. , 1996, Annual review of neuroscience.

[38]  Carlos González-García,et al.  Neural dynamics of visual ambiguity resolution by perceptual prior , 2019, eLife.

[39]  D. Plaut,et al.  Spatiotemporal dynamics of similarity-based neural representations of facial identity , 2016, Proceedings of the National Academy of Sciences.

[40]  T. Hendler,et al.  Noradrenaline Modulates Visual Perception and Late Visually Evoked Activity , 2018, Current Biology.

[41]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[42]  C. Gilbert,et al.  Brain States: Top-Down Influences in Sensory Processing , 2007, Neuron.

[43]  J. Gold,et al.  Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex , 2016, Neuron.

[44]  Brian Maniscalco,et al.  Initial-state-dependent, robust, transient neural dynamics encode conscious visual perception , 2017, bioRxiv.

[45]  A. Kleinschmidt,et al.  Distributed and Antagonistic Contributions of Ongoing Activity Fluctuations to Auditory Stimulus Detection , 2009, The Journal of Neuroscience.

[46]  Feng Qi Han,et al.  Reverberation of Recent Visual Experience in Spontaneous Cortical Waves , 2008, Neuron.

[47]  P. Corballis,et al.  Prestimulus alpha power influences response criterion in a detection task. , 2016, Psychophysiology.

[48]  Michael A. Barnett,et al.  Microstructural proliferation in human cortex is coupled with the development of face processing , 2017, Science.

[49]  Thomas A. Carlson,et al.  Emerging Object Representations in the Visual System Predict Reaction Times for Categorization , 2015, PLoS Comput. Biol..

[50]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[51]  J. Palva,et al.  Very Slow EEG Fluctuations Predict the Dynamics of Stimulus Detection and Oscillation Amplitudes in Humans , 2008, The Journal of Neuroscience.

[52]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[53]  Sébastien M. Crouzet,et al.  Spontaneous Neural Oscillations Bias Perception by Modulating Baseline Excitability. , 2017, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  M. Boly,et al.  Baseline brain activity fluctuations predict somatosensory perception in humans , 2007, Proceedings of the National Academy of Sciences.

[55]  R. Malach,et al.  Differential BOLD Activity Associated with Subjective and Objective Reports during “Blindsight” in Normal Observers , 2011, The Journal of Neuroscience.

[56]  M. Schölvinck,et al.  Tracking brain arousal fluctuations with fMRI , 2016, Proceedings of the National Academy of Sciences.

[57]  Biyu J. He,et al.  Electrophysiological correlates of the brain's intrinsic large-scale functional architecture , 2008, Proceedings of the National Academy of Sciences.

[58]  Anne E. Urai,et al.  Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias , 2017, Nature Communications.

[59]  Christopher. Simons,et al.  Machine learning with Python , 2017 .

[60]  E Scheerer,et al.  Integration, interruption and processing rate in visual backward masking , 1973, Psychologische Forschung.

[61]  T. Knapen,et al.  Decision-related pupil dilation reflects upcoming choice and individual bias , 2014, Proceedings of the National Academy of Sciences.

[62]  Robert Oostenveld,et al.  Online and offline tools for head movement compensation in MEG , 2013, NeuroImage.

[63]  M. Schölvinck,et al.  Subcortical evidence for a contribution of arousal to fMRI studies of brain activity , 2018, Nature Communications.

[64]  K. Grill-Spector,et al.  The dynamics of object-selective activation correlate with recognition performance in humans , 2000, Nature Neuroscience.

[65]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[66]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[67]  Sébastien M. Crouzet,et al.  Spontaneous Neural Oscillations Bias Perception by Modulating Baseline Excitability , 2017, The Journal of Neuroscience.

[68]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[69]  Nancy Kanwisher,et al.  fMRI evidence for objects as the units of attentional selection , 1999, Nature.

[70]  Nick C Fox,et al.  Analysis of shared heritability in common disorders of the brain , 2018, Science.

[71]  Rafael Malach,et al.  Coupling between pupil fluctuations and resting-state fMRI uncovers a slow build-up of antagonistic responses in the human cortex , 2015, NeuroImage.

[72]  Karim Jerbi,et al.  Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy , 2015, Journal of Neuroscience Methods.

[73]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[74]  John A. Nevin,et al.  SIGNAL DETECTION THEORY AND OPERANT BEHAVIOR: A Review of David M. Green and John A. Swets' Signal Detection Theory and Psychophysics.1 , 1969 .

[75]  Dimitrios Pantazis,et al.  Similarity-Based Fusion of MEG and fMRI Reveals Spatio-Temporal Dynamics in Human Cortex During Visual Object Recognition , 2015, bioRxiv.

[76]  Jonathan D. Cohen,et al.  An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance. , 2005, Annual review of neuroscience.

[77]  A. Yuille,et al.  Object perception as Bayesian inference. , 2004, Annual review of psychology.

[78]  David L. Sheinberg,et al.  Effects of Long-Term Visual Experience on Responses of Distinct Classes of Single Units in Inferior Temporal Cortex , 2012, Neuron.

[79]  George H. Denfield,et al.  Pupil Fluctuations Track Fast Switching of Cortical States during Quiet Wakefulness , 2014, Neuron.

[80]  R. Passingham,et al.  Relative blindsight in normal observers and the neural correlate of visual consciousness , 2006, Proceedings of the National Academy of Sciences.

[81]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[82]  Rafael Malach,et al.  Quenching of spontaneous fluctuations by attention in human visual cortex , 2018, NeuroImage.

[83]  Valentin Dragoi,et al.  Image sequence reactivation in awake V4 networks , 2012, Proceedings of the National Academy of Sciences.

[84]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.