Efficient mental workload estimation using task-independent EEG features

OBJECTIVE Mental workload is frequently estimated by EEG-based mental state monitoring systems. Usually, these systems use spectral markers and event-related potentials (ERPs). To our knowledge, no study has directly compared their performance for mental workload assessment, nor evaluated the stability in time of these markers and of the performance of the associated mental workload estimators.  This study proposes a comparison of two processing chains, one based on the power in five frequency bands, and one based on ERPs, both including a spatial filtering step (respectively CSP and CCA), an FLDA classification and a 10-fold cross-validation. APPROACH To get closer to a real life implementation, spectral markers were extracted from a short window (i.e. towards reactive systems) that did not include any motor activity and the analyzed ERPs were elicited by a task-independent probe that required a reflex-like answer (i.e. close to the ones required by dead man's vigilance devices). The data were acquired from 20 participants who performed a Sternberg memory task for 90 min (i.e. 2/6 digits to memorize) inside which a simple detection task was inserted. The results were compared both when the testing was performed at the beginning and end of the session. MAIN RESULTS Both chains performed significantly better than random; however the one based on the spectral markers had a low performance (60%) and was not stable in time. Conversely, the ERP-based chain gave very high results (91%) and was stable in time. SIGNIFICANCE This study demonstrates that an efficient and stable in time workload estimation can be achieved using task-independent spatially filtered ERPs elicited in a minimally intrusive manner.

[1]  S. Bonnet,et al.  Channel selection procedure using riemannian distance for BCI applications , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[2]  A. Kok On the utility of P3 amplitude as a measure of processing capacity. , 2001, Psychophysiology.

[3]  A. Gevins,et al.  Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. , 2000, Cerebral cortex.

[4]  Fabien Lotte,et al.  Brain-Computer Interfaces: Beyond Medical Applications , 2012, Computer.

[5]  Kristian Lukander,et al.  Estimating Brain Load from the EEG , 2009, TheScientificWorldJournal.

[6]  R Schellenberg,et al.  Reflection of mental exercise in the dynamic quantitative topographical EEG. , 1995, Neuropsychobiology.

[7]  T. Åkerstedt,et al.  Validation of the Karolinska sleepiness scale against performance and EEG variables , 2006, Clinical Neurophysiology.

[8]  James C. Christensen,et al.  Neuroergonomics: The brain in action and at work , 2012, NeuroImage.

[9]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[10]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[11]  Dick de Waard,et al.  Classifying visuomotor workload in a driving simulator using subject specific spatial brain patterns , 2013, Front. Neurosci..

[12]  U. Erdmann,et al.  Auditory probe sensitivity to mental workload changes - an event-related potential study. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[13]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[14]  Guillaume Gibert,et al.  xDAWN Algorithm to Enhance Evoked Potentials: Application to Brain–Computer Interface , 2009, IEEE Transactions on Biomedical Engineering.

[15]  Michael Breakspear,et al.  Effects of mnemonic load on cortical activity during visual working memory: linking ongoing brain activity with evoked responses. , 2013, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[16]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[17]  C. Guézennec,et al.  EEG and ECG changes during simulator operation reflect mental workload and vigilance. , 2005, Aviation, space, and environmental medicine.

[18]  Raja Parasuraman,et al.  Event-Related Potentials (ERPs) in Neuroergonomics , 2006, Neuroergonomics.

[19]  A Gale,et al.  EEG correlates of signal rate, time in task and individual differences in reaction time during a five-stage sustained attention task. , 1977, Ergonomics.

[20]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[21]  Zoly J. Koles,et al.  Mental activity and the e.e.g.: Task and workload related effects , 2006, Medical and Biological Engineering and Computing.

[22]  Anatole Lécuyer,et al.  An overview of research on "passive" brain-computer interfaces for implicit human-computer interaction , 2010 .

[23]  Stéphane Bonnet,et al.  Mental fatigue and working memory load estimation: Interaction and implications for EEG-based passive BCI , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[24]  Stephane Bonnet,et al.  Enhancing single-trial mental workload estimation through xDAWN spatial filtering , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[25]  V. Ibáñez,et al.  Frontal theta event-related synchronization: comparison of directed attention and working memory load effects , 2006, Journal of Neural Transmission.

[26]  Jaime Gómez Gil,et al.  Brain Computer Interfaces, a Review , 2012, Sensors.

[27]  Matthew W. Miller,et al.  A novel approach to the physiological measurement of mental workload. , 2011, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[28]  Touradj Ebrahimi,et al.  Spatial filters for the classification of event-related potentials , 2006, ESANN.

[29]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[30]  M. Manosevitz High-Speed Scanning in Human Memory , .

[31]  Peter A Hancock,et al.  State of science: mental workload in ergonomics , 2015, Ergonomics.

[32]  Alan Gevins,et al.  Electroencephalography (EEG) in Neuroergonomics , 2006, Neuroergonomics.

[33]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[34]  Monika Althaus,et al.  The effects of memory load and stimulus relevance on the EEG during a visual selective memory search task: An ERP and ERD/ERS study , 2006, Clinical Neurophysiology.

[35]  Tanja Schultz,et al.  Online Workload Recognition from EEG Data during Cognitive Tests and Human-Machine Interaction , 2010, KI.

[36]  Frank E. Gomer,et al.  Electrocortical Activity and Operator Workload: A Comparison of Changes in the Electroencephalogram and in Event-Related Potentials , 1981 .

[37]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[38]  C. Neuper,et al.  Sensitivity of human EEG alpha band desynchronization to different working memory components and increasing levels of memory load , 2003, Neuroscience Letters.

[39]  Brendan Z. Allison,et al.  Workload assessment of computer gaming using a single-stimulus event-related potential paradigm , 2008, Biological Psychology.

[40]  Juan R. Vidal,et al.  Transient Suppression of Broadband Gamma Power in the Default-Mode Network Is Correlated with Task Complexity and Subject Performance , 2011, The Journal of Neuroscience.

[41]  Anthony Jameson,et al.  Assessing Cognitive Load in Adaptive Hypermedia Systems: Physiological and Behavioral Methods , 2004, AH.

[42]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[43]  Maud Marchal,et al.  Combining Brain-Computer Interfaces and Haptics: Detecting Mental Workload to Adapt Haptic Assistance , 2012, EuroHaptics.

[44]  Pierre Jallon,et al.  A comparison of ERP spatial filtering methods for optimal mental workload estimation , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[45]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[46]  S. Sternberg High-Speed Scanning in Human Memory , 1966, Science.

[47]  Desney S. Tan,et al.  Feasibility and pragmatics of classifying working memory load with an electroencephalograph , 2008, CHI.

[48]  Christian Mühl,et al.  EEG-based workload estimation across affective contexts , 2014, Front. Neurosci..

[49]  Wolfgang Rosenstiel,et al.  Spatial Filtering Based on Canonical Correlation Analysis for Classification of Evoked or Event-Related Potentials in EEG Data , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.