Context Sensitivity of EEG-Based Workload Classification Under Different Affective Valence

State of the art brain-computer interfaces (BCIs) largely focus on detecting single, specific, often experimentally induced or manipulated aspects of the user state. In a less controlled, more naturalistic environment, a larger variety of mental processes may be active and possibly interacting. When moving BCI applications from the lab to real-life applications, these additional unaccounted mental processes could interfere with user state decoding, thus decreasing system efficacy and decreasing real-world applicability. Here, we assess the impact of affective valence on classification of working memory load, by re-analyzing a dataset that used an affective N-back task with picture stimuli. Our analyses showed that classification of working memory load under affective valence can lead to good classification accuracies (> 70 percent), which can be further improved via data integration over time. However, positive as well as negative affective valence resulted in decreased classification accuracies, when compared to the neutral affective context. Furthermore, classifiers failed to generalize across affective contexts, highlighting the need for user state models that can account for different contexts or new, context-independent, EEG features.

[1]  Christian Mühl,et al.  Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction , 2013, PhyCS.

[2]  Egon L. van den Broek,et al.  Modality-specific Affective Responses and their Implications for Affective BCI , 2011 .

[3]  Robert Du,et al.  Towards measurement of brain function in operational environments , 1995, Biological Psychology.

[4]  Tom De Smedt,et al.  VALENCE: affective visualisation using EEG , 2012, Digit. Creativity.

[5]  Annmarie MacNamara,et al.  Working memory load reduces the late positive potential and this effect is attenuated with increasing anxiety , 2011, Cognitive, affective & behavioral neuroscience.

[6]  Arnaud Delorme,et al.  EEGLAB, SIFT, NFT, BCILAB, and ERICA: New Tools for Advanced EEG Processing , 2011, Comput. Intell. Neurosci..

[7]  Dennis J. McFarland,et al.  Electroencephalographic(EEG)-based communication: EEG control versus system performance in humans , 2003, Neuroscience Letters.

[8]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[9]  Scott Makeig,et al.  First Demonstration of a Musical Emotion BCI , 2011, ACII.

[10]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[11]  Jonas K. Olofsson,et al.  Affective picture processing: An integrative review of ERP findings , 2008, Biological Psychology.

[12]  Stéphane Bonnet,et al.  Mental fatigue and working memory load estimation: Interaction and implications for EEG-based passive BCI , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Christian Mühl,et al.  EEG-based workload estimation across affective contexts , 2014, Front. Neurosci..

[14]  F. Hesse,et al.  Experimental inductions of emotional states and their effectiveness: A review , 1994 .

[15]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[16]  J. Russell A circumplex model of affect. , 1980 .

[17]  Wolfgang Rosenstiel,et al.  EEG-based prediction of cognitive workload induced by arithmetic: a step towards online adaptation in numerical learning , 2016 .

[18]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[19]  E. Tapia,et al.  Investigating the dynamics of affect: Psychological mechanisms of affective habituation to pleasurable stimuli , 2007 .

[20]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[21]  Thorsten O. Zander,et al.  Automated detection of bluffing in a game: revealing a complex covert user state with a passive BCI , 2010 .

[22]  Stéphane Bonnet,et al.  Efficient Workload Classification based on Ignored Auditory Probes: A Proof of Concept , 2016, Front. Hum. Neurosci..

[23]  W. Kirchner Age differences in short-term retention of rapidly changing information. , 1958, Journal of experimental psychology.

[24]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[25]  P. Lang International Affective Picture System (IAPS) : Technical Manual and Affective Ratings , 1995 .

[26]  Scott Makeig,et al.  Estimation of task workload from EEG data: New and current tools and perspectives , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  T. Chau,et al.  Effects of user mental state on EEG-BCI performance , 2015, Front. Hum. Neurosci..

[28]  Michael E. Smith,et al.  Neurophysiologic monitoring of mental workload and fatigue during operation of a flight simulator , 2005, SPIE Defense + Commercial Sensing.

[29]  Thomas Dresler,et al.  The Effect of Emotional Content on Brain Activation and the Late Positive Potential in a Word n-back Task , 2013, PloS one.

[30]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[31]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[32]  Mariano Sigman,et al.  CUDAICA: GPU Optimization of Infomax-ICA EEG Analysis , 2012, Comput. Intell. Neurosci..

[33]  M. Ruz,et al.  Cognitive and affective control in a flanker word task: Common and dissociable brain mechanisms , 2013, Neuropsychologia.

[34]  M. Bradley,et al.  Looking at pictures: affective, facial, visceral, and behavioral reactions. , 1993, Psychophysiology.

[35]  S. Bonnet,et al.  Single-trial ERP classification of emotional processing , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[36]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[37]  Karim Jerbi,et al.  Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy , 2015, Journal of Neuroscience Methods.

[38]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[39]  Wolfgang Rosenstiel,et al.  Cognitive state monitoring and the design of adaptive instruction in digital environments: lessons learned from cognitive workload assessment using a passive brain-computer interface approach , 2014, Front. Neurosci..

[40]  Tzyy-Ping Jung,et al.  Imaging brain dynamics using independent component analysis , 2001, Proc. IEEE.

[41]  Sebastian Grissmann,et al.  Electroencephalography Based Analysis of Working Memory Load and Affective Valence in an N-back Task with Emotional Stimuli , 2017, Front. Hum. Neurosci..

[42]  C. Kirschbaum,et al.  The 'Trier Social Stress Test'--a tool for investigating psychobiological stress responses in a laboratory setting. , 1993, Neuropsychobiology.

[43]  S. Bunce,et al.  Detecting cognitive activity related hemodynamic signal for brain computer interface using functional near infrared spectroscopy , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[44]  M. Bradley,et al.  Affective picture processing: the late positive potential is modulated by motivational relevance. , 2000, Psychophysiology.

[45]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[46]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[47]  G. Schwartz,et al.  Differential lateralization for positive and negative emotion in the human brain: EEG spectral analysis , 1985, Neuropsychologia.

[48]  T. Schubert,et al.  When flanker meets the n-back: What EEG and pupil dilation data reveal about the interplay between the two central-executive working memory functions inhibition and updating. , 2015, Psychophysiology.

[49]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[50]  A. Baddeley Working memory: looking back and looking forward , 2003, Nature Reviews Neuroscience.

[51]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[52]  T O Zander,et al.  Context-aware brain–computer interfaces: exploring the information space of user, technical system and environment , 2012, Journal of neural engineering.

[53]  T. Klingberg The Overflowing Brain: Information Overload and the Limits of Working Memory , 2008 .

[54]  A. Baddeley Working memory: theories, models, and controversies. , 2012, Annual review of psychology.