A continuous time-resolved measure decoded from EEG oscillatory activity predicts working memory task performance

OBJECTIVE Working memory (WM), crucial for successful behavioral performance in most of our everyday activities, holds a central role in goal-directed behavior. As task demands increase, inducing higher WM load, maintaining successful behavioral performance requires the brain to work at the higher end of its capacity. Because it is depending on both external and internal factors, individual WM load likely varies in a continuous fashion. The feasibility to extract such a continuous measure in time that correlates to behavioral performance during a working memory task remains unsolved. APPROACH Multivariate pattern decoding was used to test whether a decoder constructed from two discrete levels of WM load can generalize to produce a continuous measure that predicts task performance. Specifically, a linear regression with L2-regularization was chosen with input features from EEG oscillatory activity recorded from healthy participants while performing the n-back task, [Formula: see text]. MAIN RESULTS The feasibility to extract a continuous time-resolved measure that correlates positively to trial-by-trial working memory task performance is demonstrated (r  =  0.47, p  <  0.05). It is furthermore shown that this measure allows to predict task performance before action (r  =  0.49, p  <  0.05). We show that the extracted continuous measure enables to study the temporal dynamics of the complex activation pattern of WM encoding during the n-back task. Specifically, temporally precise contributions of different spectral features are observed which extends previous findings of traditional univariate approaches. SIGNIFICANCE These results constitute an important contribution towards a wide range of applications in the field of cognitive brain-machine interfaces. Monitoring mental processes related to attention and WM load to reduce the risk of committing errors in high-risk environments could potentially prevent many devastating consequences or using the continuous measure as neurofeedback opens up new possibilities to develop novel rehabilitation techniques for individuals with degraded WM capacity.

[1]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[2]  G. Pfurtscheller,et al.  Event-related desynchronisation of central beta-rhythms during brisk and slow self-paced finger movements of dominant and nondominant hand. , 1996, Brain research. Cognitive brain research.

[3]  Daphne N. Yu,et al.  High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. , 1997, Cerebral cortex.

[4]  Susan E. Gathercole,et al.  Working memory assessments at school entry as longitudinal predictors of National Curriculum attainment levels , 2003, Educational and Child Psychology.

[5]  O. Jensen,et al.  Frontal theta activity in humans increases with memory load in a working memory task , 2002, The European journal of neuroscience.

[6]  Yuan-Pin Lin,et al.  Co-modulatory spectral changes in independent brain processes are correlated with task performance , 2012, NeuroImage.

[7]  Jon Touryan,et al.  Estimating endogenous changes in task performance from EEG , 2014, Front. Neurosci..

[8]  Simon Hanslmayr,et al.  Prestimulus oscillations predict visual perception performance between and within subjects , 2007, NeuroImage.

[9]  P. Silvia,et al.  For Whom the Mind Wanders, and When , 2007, Psychological science.

[10]  O. Jensen,et al.  Shaping Functional Architecture by Oscillatory Alpha Activity: Gating by Inhibition , 2010, Front. Hum. Neurosci..

[11]  Stefan Haufe,et al.  Now You'll Feel It, Now You Won't: EEG Rhythms Predict the Effectiveness of Perceptual Masking , 2009, Journal of Cognitive Neuroscience.

[12]  Takeo Watanabe,et al.  Perceptual Learning Incepted by Decoded fMRI Neurofeedback Without Stimulus Presentation , 2011, Science.

[13]  Anthony J. Ries,et al.  Common EEG features for behavioral estimation in disparate, real-world tasks , 2016, Biological Psychology.

[14]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[15]  Jonathan D. Cohen,et al.  Closed-loop training of attention with real-time brain imaging , 2015, Nature Neuroscience.

[16]  Geert Wets,et al.  Investigating the influence of working memory capacity when driving behavior is combined with cognitive load: An LCT study of young novice drivers. , 2014, Accident; analysis and prevention.

[17]  Meike Jipp,et al.  Assessing the Driver’s Current Level of Working Memory Load with High Density Functional Near-infrared Spectroscopy: A Realistic Driving Simulator Study , 2017, Front. Hum. Neurosci..

[18]  L. Reder,et al.  Individual differences in working memory capacity are reflected in different ERP and EEG patterns to task difficulty , 2015, Brain Research.

[19]  P. Sauseng,et al.  Interacting Memory Systems—Does EEG Alpha Activity Respond to Semantic Long-Term Memory Access in a Working Memory Task? , 2014, Biology.

[20]  Arnaud Delorme,et al.  Frontal midline EEG dynamics during working memory , 2005, NeuroImage.

[21]  Carryl L. Baldwin,et al.  Adaptive training using an artificial neural network and EEG metrics for within- and cross-task workload classification , 2012, NeuroImage.

[22]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[23]  John J. Foxe,et al.  Attention-dependent suppression of distracter visual input can be cross-modally cued as indexed by anticipatory parieto-occipital alpha-band oscillations. , 2001, Brain research. Cognitive brain research.

[24]  Daniel Brandeis,et al.  Frontal Midline Theta Reflects Individual Task Performance in a Working Memory Task , 2014, Brain Topography.

[25]  Markus Kivikangas,et al.  Brain oscillatory 4–35Hz EEG responses during an n-back task with complex visual stimuli , 2012, Neuroscience Letters.

[26]  Patrick C. Kyllonen,et al.  Reasoning ability is (little more than) working-memory capacity?! , 1990 .

[27]  R. Engle Role of Working‐Memory Capacity in Cognitive Control , 2010, Current Anthropology.

[28]  Martin Ekström,et al.  Extraction of working memory load and the importance of understanding the temporal dynamics , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[29]  J. Schoffelen,et al.  Prestimulus Oscillatory Activity in the Alpha Band Predicts Visual Discrimination Ability , 2008, The Journal of Neuroscience.

[30]  Elaine Astrand,et al.  Selective visual attention to drive cognitive brain–machine interfaces: from concepts to neurofeedback and rehabilitation applications , 2014, Front. Syst. Neurosci..

[31]  Pierre Baraduc,et al.  Direct Two-Dimensional Access to the Spatial Location of Covert Attention in Macaque Prefrontal Cortex , 2016, Current Biology.

[32]  A. Nobre,et al.  Oscillatory Brain State Predicts Variability in Working Memory , 2014, The Journal of Neuroscience.

[33]  Peter Ford Dominey,et al.  Comparison of Classifiers for Decoding Sensory and Cognitive Information from Prefrontal Neuronal Populations , 2014, PloS one.

[34]  W. Klimesch,et al.  Control mechanisms in working memory: A possible function of EEG theta oscillations , 2010, Neuroscience & Biobehavioral Reviews.

[35]  O. Jensen,et al.  Modulation of Gamma and Alpha Activity during a Working Memory Task Engaging the Dorsal or Ventral Stream , 2007, The Journal of Neuroscience.

[36]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[37]  V. Ibáñez,et al.  EEG alpha activity reflects motor preparation rather than the mode of action selection , 2012, Front. Integr. Neurosci..