Electrode replacement does not affect classification accuracy in dual-session use of a passive brain-computer interface for assessing cognitive workload

The passive brain-computer interface (pBCI) framework has been shown to be a very promising construct for assessing cognitive and affective state in both individuals and teams. There is a growing body of work that focuses on solving the challenges of transitioning pBCI systems from the research laboratory environment to practical, everyday use. An interesting issue is what impact methodological variability may have on the ability to reliably identify (neuro)physiological patterns that are useful for state assessment. This work aimed at quantifying the effects of methodological variability in a pBCI design for detecting changes in cognitive workload. Specific focus was directed toward the effects of replacing electrodes over dual sessions (thus inducing changes in placement, electromechanical properties, and/or impedance between the electrode and skin surface) on the accuracy of several machine learning approaches in a binary classification problem. In investigating these methodological variables, it was determined that the removal and replacement of the electrode suite between sessions does not impact the accuracy of a number of learning approaches when trained on one session and tested on a second. This finding was confirmed by comparing to a control group for which the electrode suite was not replaced between sessions. This result suggests that sensors (both neurological and peripheral) may be removed and replaced over the course of many interactions with a pBCI system without affecting its performance. Future work on multi-session and multi-day pBCI system use should seek to replicate this (lack of) effect between sessions in other tasks, temporal time courses, and data analytic approaches while also focusing on non-stationarity and variable classification performance due to intrinsic factors.

[1]  Glenn F. Wilson,et al.  Removal of ocular artifacts from the EEG: a comparison between time-domain regression method and adaptive filtering method using simulated data , 2007, Medical & Biological Engineering & Computing.

[2]  Misha Pavel,et al.  A framework for rapid visual image search using single-trial brain evoked responses , 2011, Neurocomputing.

[3]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[4]  Daphne N. Yu,et al.  High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. , 1997, Cerebral cortex.

[5]  M. Thulasidas,et al.  Robust classification of EEG signal for brain-computer interface , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[7]  James C. Christensen,et al.  Evaluation of a Dry Electrode System for Electroencephalography: Applications for Psychophysiological Cognitive Workload Assessment , 2010 .

[8]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[9]  Thorsten O. Zander,et al.  Enhancing Human-Computer Interaction with Input from Active and Passive Brain-Computer Interfaces , 2010, Brain-Computer Interfaces.

[10]  L. E. Baker,et al.  Optimum electrolytic chloriding of silver electrodes , 2006, Medical and biological engineering.

[11]  Mark W. Scerbo,et al.  Effects of a Psychophysiological System for Adaptive Automation on Performance, Workload, and the Event-Related Potential P300 Component , 2003, Hum. Factors.

[12]  F. Freeman,et al.  A Closed-Loop System for Examining Psychophysiological Measures for Adaptive Task Allocation , 2000, The International journal of aviation psychology.

[13]  W. D. Miller,et al.  The U.S. Air Force-Developed Adaptation of the Multi-Attribute Task Battery for the Assessment of Human Operator Workload and Strategic Behavior , 2010 .

[14]  Glenn F. Wilson,et al.  A new EOG-based eyeblink detection algorithm , 1998 .

[15]  Willis J. Tompkins,et al.  A Real-Time QRS Detection Algorithm , 1985, IEEE Transactions on Biomedical Engineering.

[16]  Richard J. Davidson,et al.  Electromyogenic artifacts and electroencephalographic inferences revisited , 2011, NeuroImage.

[17]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[18]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[19]  Richard J. Davidson,et al.  Validation of ICA-based myogenic artifact correction for scalp and source-localized EEG , 2010, NeuroImage.

[20]  Johan A. K. Suykens,et al.  LS-SVMlab Toolbox User's Guide version 1.7 , 2003 .

[21]  F. Freeman,et al.  Evaluation of an adaptive automation system using three EEG indices with a visual tracking task , 1999, Biological Psychology.

[22]  Bernhard Schölkopf,et al.  Support vector channel selection in BCI , 2004, IEEE Transactions on Biomedical Engineering.

[23]  Jukka Heikkonen,et al.  A local neural classifier for the recognition of EEG patterns associated to mental tasks , 2002, IEEE Trans. Neural Networks.

[24]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[25]  Gert Cauwenberghs,et al.  SVM incremental learning, adaptation and optimization , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[26]  J. R. Comstock.  MAT - MULTI-ATTRIBUTE TASK BATTERY FOR HUMAN OPERATOR WORKLOAD AND STRATEGIC BEHAVIOR RESEARCH , 1994 .

[27]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[28]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[29]  Zhilin Zhang,et al.  Evolving Signal Processing for Brain–Computer Interfaces , 2012, Proceedings of the IEEE.

[30]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[31]  G Pfurtscheller,et al.  Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[32]  James C. Christensen,et al.  Coadaptive Aiding and Automation Enhance Operator Performance , 2013, Hum. Factors.

[33]  James C. Christensen,et al.  The effects of day-to-day variability of physiological data on operator functional state classification , 2012, NeuroImage.

[34]  Wright-Patterson Afb,et al.  Feature Selection Using a Multilayer Perceptron , 1990 .

[35]  Brendan Z. Allison,et al.  How Many People Could Use an SSVEP BCI? , 2012, Front. Neurosci..

[36]  Cuntai Guan,et al.  Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain–computer interface , 2007, NeuroImage.

[37]  Chris A. Russel,et al.  Selecting Salient Features of Psychophysiological Measures , 2001 .

[38]  T. Jung,et al.  Dry and Noncontact EEG Sensors for Mobile Brain–Computer Interfaces , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Yufei Huang,et al.  Characterization and Robust Classification of EEG Signal from Image RSVP Events with Independent Time-Frequency Features , 2012, PloS one.

[40]  C. Grozea,et al.  Bristle-sensors—low-cost flexible passive dry EEG electrodes for neurofeedback and BCI applications , 2011, Journal of neural engineering.

[41]  John J. B. Allen,et al.  Anger and frontal brain activity: EEG asymmetry consistent with approach motivation despite negative affective valence. , 1998, Journal of personality and social psychology.

[42]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[43]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[44]  G. Wilson,et al.  Cognitive task classification based upon topographic EEG data , 1995, Biological Psychology.

[45]  Yuan-Pin Lin,et al.  EEG-Based Emotion Recognition in Music Listening , 2010, IEEE Transactions on Biomedical Engineering.

[46]  H. Jasper,et al.  The ten-twenty electrode system of the International Federation. The International Federation of Clinical Neurophysiology. , 1999, Electroencephalography and clinical neurophysiology. Supplement.

[47]  R. Davidson.  What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research , 2004, Biological Psychology.

[48]  Chris Berka,et al.  Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG Headset , 2004, Int. J. Hum. Comput. Interact..

[49]  F. Piccione,et al.  P300-based brain computer interface: Reliability and performance in healthy and paralysed participants , 2006, Clinical Neurophysiology.

[50]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[51]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[53]  Ettore Lettich,et al.  Ten Percent Electrode System for Topographic Studies of Spontaneous and Evoked EEG Activities , 1985 .

[54]  T. Gasser,et al.  Transformations towards the normal distribution of broad band spectral parameters of the EEG. , 1982, Electroencephalography and clinical neurophysiology.

[55]  Kenneth J. Pope,et al.  Thinking activates EMG in scalp electrical recordings , 2008, Clinical Neurophysiology.

[56]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[57]  James C. Christensen,et al.  Validation of a Dry Electrode System for EEG , 2009 .

[58]  D. Koshland.  Frontiers in neuroscience. , 1988, Science.

[59]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[60]  G. Wilson,et al.  Removal of ocular artifacts from electro-encephalogram by adaptive filtering , 2004, Medical and Biological Engineering and Computing.

[61]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[62]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[63]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[64]  G. Pfurtscheller,et al.  On-line EEG classification during externally-paced hand movements using a neural network-based classifier. , 1996, Electroencephalography and clinical neurophysiology.

[65]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[66]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[67]  H. Huynh,et al.  Estimation of the Box Correction for Degrees of Freedom from Sample Data in Randomized Block and Split-Plot Designs , 1976 .

[68]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[69]  Tzyy-Ping Jung,et al.  Real-World Neuroimaging Technologies , 2013, IEEE Access.

[70]  G. Pfurtscheller,et al.  Rapid prototyping of an EEG-based brain-computer interface (BCI) , 2001, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[71]  R. Thatcher,et al.  EEG and intelligence: Relations between EEG coherence, EEG phase delay and power , 2005, Clinical Neurophysiology.

[72]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[73]  E. Whitham,et al.  Scalp electrical recording during paralysis: Quantitative evidence that EEG frequencies above 20Hz are contaminated by EMG , 2007, Clinical Neurophysiology.

[74]  Radford M. Neal.  Pattern Recognition and Machine Learning , 2007, Technometrics.

[75]  Willis J. Tompkins,et al.  Quantitative Investigation of QRS Detection Rules Using the MIT/BIH Arrhythmia Database , 1986, IEEE Transactions on Biomedical Engineering.

[76]  L. Geddes,et al.  Temporal changes in electrode impedance while recording the electrocardiogram with “Dry” electrodes , 1973, Annals of Biomedical Engineering.

[77]  D. Tucker,et al.  Scalp electrode impedance, infection risk, and EEG data quality , 2001, Clinical Neurophysiology.

[78]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[79]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[80]  Mohammad Soleymani,et al.  Short-term emotion assessment in a recall paradigm , 2009, Int. J. Hum. Comput. Stud..

[81]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[82]  Tom Chen,et al.  Design and implementation , 2006, IEEE Commun. Mag..

[83]  Helge J. Ritter,et al.  BCI competition 2003-data set IIb: support vector machines for the P300 speller paradigm , 2004, IEEE Transactions on Biomedical Engineering.

[84]  Santosh Mathan,et al.  EEG indices of reward motivation and target detectability in a rapid visual detection task , 2013, NeuroImage.

[85]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[86]  Gert Cauwenberghs,et al.  Incremental and Decremental Support Vector Machine Learning , 2000, NIPS.