Working memory load-dependent spatio-temporal activity of single-trial P3 response detected with an adaptive wavelet denoiser

Working memory (WM) refers to the holding and manipulation of information during cognitive tasks. Its underlying neural mechanisms have been explored through both functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). Trial-by-trial coupling of simultaneously collected EEG and fMRI signals has become an important and promising approach to study the spatio-temporal dynamics of such cognitive processes. Previous studies have demonstrated a modulation effect of the WM load on both the BOLD response in certain brain areas and the amplitude of P3. However, much remains to be explored regarding the WM load-dependent relationship between the amplitude of ERP components and cortical activities, and the low signal-to-noise ratio (SNR) of the EEG signal still poses a challenge to performing single-trial analyses. In this paper, we investigated the spatio-temporal activities of P3 during an n-back verbal WM task by introducing an adaptive wavelet denoiser into the extraction of single-trial P3 features and using general linear model (GLM) to integrate simultaneously collected EEG and fMRI data. Our results replicated the modulation effect of the WM load on the P3 amplitude. Additionally, the activation of single-trial P3 amplitudes was detected in multiple brain regions, including the insula, the cuneus, the lingual gyrus (LG), and the middle occipital gyrus (MOG). Moreover, we found significant correlations between P3 features and behavioral performance. These findings suggest that the single-trial integration of simultaneous EEG and fMRI signals may provide new insights into classical cognitive functions.

[1]  C. Frith,et al.  The Role of Working Memory in Visual Selective Attention , 2001, Science.

[2]  Christian Bénar,et al.  Single-trial EEG-informed fMRI reveals spatial dependency of BOLD signal on early and late IC-ERP amplitudes during face recognition , 2014, NeuroImage.

[3]  A. Engel,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.12 Single-trial EEG–fMRI reveals the dynamics of cognitive function , 2022 .

[4]  Robert Oostenveld,et al.  Trial-by-trial coupling between EEG and BOLD identifies networks related to alpha and theta EEG power increases during working memory maintenance , 2009, NeuroImage.

[5]  A. Kok On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[6]  Marcel Adam Just,et al.  Functional connectivity in an fMRI working memory task in high-functioning autism , 2005, NeuroImage.

[7]  M. Scherg,et al.  Mental Chronometry of Working Memory Retrieval: A Combined Functional Magnetic Resonance Imaging and Event-Related Potentials Approach , 2006, The Journal of Neuroscience.

[8]  Thomas J. Ross,et al.  Neuroanatomical dissociation between bottom–up and top–down processes of visuospatial selective attention , 2006, NeuroImage.

[9]  Noureddine Ellouze,et al.  T-Wave Detection Based on an Adjusted Wavelet Transform Modulus Maxima , 2007 .

[10]  Andrew P. Bagshaw,et al.  Single trial variability of EEG and fMRI responses to visual stimuli , 2007, NeuroImage.

[11]  J. Desmond,et al.  Prefrontal regions involved in keeping information in and out of mind. , 2001, Brain : a journal of neurology.

[12]  I. Johnstone,et al.  Wavelet Threshold Estimators for Data with Correlated Noise , 1997 .

[13]  I. Melle,et al.  The validity of d prime as a working memory index: Results from the “Bergen n-back task” , 2010, Journal of clinical and experimental neuropsychology.

[14]  J. Hohnsbein,et al.  Effects of crossmodal divided attention on late ERP components. II. Error processing in choice reaction tasks. , 1991, Electroencephalography and clinical neurophysiology.

[15]  Yong He,et al.  Topologically Reorganized Connectivity Architecture of Default-Mode, Executive-Control, and Salience Networks across Working Memory Task Loads. , 2016, Cerebral cortex.

[16]  K. Hasan,et al.  Working memory load modulation of parieto‐frontal connections: Evidence from dynamic causal modeling , 2012, Human brain mapping.

[17]  Nadim Joni Shah,et al.  Single-trial P3 amplitude and latency informed event-related fMRI models yield different BOLD response patterns to a target detection task , 2009, NeuroImage.

[18]  Hellmuth Obrig,et al.  Neural correlates of dream lucidity obtained from contrasting lucid versus non-lucid REM sleep: a combined EEG/fMRI case study. , 2012, Sleep.

[19]  Louis Lemieux,et al.  Identification of EEG Events in the MR Scanner: The Problem of Pulse Artifact and a Method for Its Subtraction , 1998, NeuroImage.

[20]  David E. J. Linden,et al.  Working Memory Load for Faces Modulates P300, N170, and N250r , 2008, Journal of Cognitive Neuroscience.

[21]  Maryam Ahmadi,et al.  Automatic denoising of single-trial evoked potentials , 2013, NeuroImage.

[22]  J. Lisman,et al.  Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. , 2002, Cerebral cortex.

[23]  J. Polich,et al.  Cognitive and biological determinants of P300: an integrative review , 1995, Biological Psychology.

[24]  T. Handy,et al.  Altered visual–spatial attention to task-irrelevant information is associated with falls risk in older adults , 2013, Neuropsychologia.

[25]  Maximilian Reiser,et al.  Single-trial coupling of the gamma-band response and the corresponding BOLD signal , 2010, NeuroImage.

[26]  Mark W. Greenlee,et al.  Neural correlates of spatial working memory load in a delayed match-to-sample saccade task , 2013, NeuroImage.

[27]  D. Linden The P300: Where in the Brain Is It Produced and What Does It Tell Us? , 2005, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[28]  A Gevins,et al.  Dynamic cortical networks of verbal and spatial working memory: effects of memory load and task practice. , 1998, Cerebral cortex.

[29]  Evian Gordon,et al.  Event-related potential dysfunction in posttraumatic stress disorder: the role of numbing , 2002, Psychiatry Research.

[30]  E. Martin,et al.  Simultaneous EEG-fMRI during a Working Memory Task: Modulations in Low and High Frequency Bands , 2010, PloS one.

[31]  René J. Huster,et al.  Methods for Simultaneous EEG-fMRI: An Introductory Review , 2012, The Journal of Neuroscience.

[32]  Adrian R. Willoughby,et al.  Effects of Working Memory Load on Visual Selective Attention: Behavioral and Electrophysiological Evidence , 2011, Front. Hum. Neurosci..

[33]  M. D’Esposito,et al.  Activity in fusiform face area modulated as a function of working memory load. , 2001, Brain research. Cognitive brain research.

[34]  M. Roth,et al.  Single‐trial analysis of oddball event‐related potentials in simultaneous EEG‐fMRI , 2007, Human brain mapping.

[35]  Hoi-Chung Leung,et al.  The effect of memory load on cortical activity in the spatial working memory circuit , 2004, Cognitive, affective & behavioral neuroscience.

[36]  A. Bakker,et al.  A multifaceted investigation of the link between mental fatigue and task disengagement. , 2015, Psychophysiology.

[37]  E. Donchin Presidential address, 1980. Surprise!...Surprise? , 1981, Psychophysiology.

[38]  Yvonne Höller,et al.  Brain activation disturbance for target detection in patients with mild cognitive impairment: an fMRI study , 2012, Neurobiology of Aging.

[39]  R.Quian Quiroga,et al.  Obtaining single stimulus evoked potentials with wavelet denoising , 2000, nlin/0006027.

[40]  Kenneth Hugdahl,et al.  Assessing the spatiotemporal evolution of neuronal activation with single-trial event-related potentials and functional MRI. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[41]  Maarten Jansen,et al.  Noise Reduction by Wavelet Thresholding , 2001 .

[42]  R. Quian Quiroga,et al.  Single-trial event-related potentials with wavelet denoising , 2003, Clinical Neurophysiology.

[43]  M. Lewandowska,et al.  A modified oddball paradigm for investigation of neural correlates of attention: a simultaneous ERP–fMRI study , 2013, Magnetic Resonance Materials in Physics, Biology and Medicine.

[44]  N. Busch,et al.  Object-load and feature-load modulate EEG in a short-term memory task , 2003, Neuroreport.

[45]  W. Sommer,et al.  Postperceptual effects and P300 latency. , 1998, Psychophysiology.

[46]  J. Pillai Functional Connectivity. , 2017, Neuroimaging clinics of North America.

[47]  M. Corbetta,et al.  The Reorienting System of the Human Brain: From Environment to Theory of Mind , 2008, Neuron.

[48]  V Menon,et al.  Modality effects in verbal working memory: differential prefrontal and parietal responses to auditory and visual stimuli , 2004, NeuroImage.

[49]  Arnaud Delorme,et al.  Frontal midline EEG dynamics during working memory , 2005, NeuroImage.

[50]  A. Villringer,et al.  Simultaneous EEG–fMRI , 2006, Neuroscience & Biobehavioral Reviews.

[51]  Tara A. Cairo,et al.  Functional connectivity reveals load dependent neural systems underlying encoding and maintenance in verbal working memory , 2006, Neuroscience.

[52]  P. Skudlarski,et al.  Correlations and dissociations between BOLD signal and P300 amplitude in an auditory oddball task: a parametric approach to combining fMRI and ERP. , 2002, Magnetic resonance imaging.

[53]  Edward E. Smith,et al.  A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory , 1996, NeuroImage.

[54]  Robert Turner,et al.  A Method for Removing Imaging Artifact from Continuous EEG Recorded during Functional MRI , 2000, NeuroImage.

[55]  David Friedman,et al.  Single-trial discrimination for integrating simultaneous EEG and fMRI: Identifying cortical areas contributing to trial-to-trial variability in the auditory oddball task , 2009, NeuroImage.

[56]  E. Donchin,et al.  Is the P300 component a manifestation of context updating? , 1988, Behavioral and Brain Sciences.

[57]  Kiti Müller,et al.  Relationship of P300 single-trial responses with reaction time and preceding stimulus sequence. , 2006, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  A. Engel,et al.  Trial-by-Trial Coupling of Concurrent Electroencephalogram and Functional Magnetic Resonance Imaging Identifies the Dynamics of Performance Monitoring , 2005, The Journal of Neuroscience.

[59]  Patric Meyer,et al.  Simultaneous EEG–fMRI reveals brain networks underlying recognition memory ERP old/new effects , 2015, NeuroImage.