Online and Offline Domain Adaptation for Reducing BCI Calibration Effort

Many real-world brain–computer interface (BCI) applications rely on single-trial classification of event-related potentials (ERPs) in EEG signals. However, because different subjects have different neural responses to even the same stimulus, it is very difficult to build a generic ERP classifier whose parameters fit all subjects. The classifier needs to be calibrated for each individual subject, using some labeled subject-specific data. This paper proposes both online and offline weighted adaptation regularization (wAR) algorithms to reduce this calibration effort, i.e., to minimize the amount of labeled subject-specific EEG data required in BCI calibration, and hence to increase the utility of the BCI system. We demonstrate using a visually evoked potential oddball task and three different EEG headsets that both online and offline wAR algorithms significantly outperform several other algorithms. Moreover, through source domain selection, we can reduce their computational cost by about $\text{50}\%$, making them more suitable for real-time applications.

[1]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[2]  Bernhard Schölkopf,et al.  Transfer Learning in Brain-Computer Interfaces , 2015, IEEE Computational Intelligence Magazine.

[3]  Foster Provost,et al.  Machine Learning from Imbalanced Data Sets 101 , 2008 .

[4]  Carla E. Brodley,et al.  Active Class Selection , 2007, ECML.

[5]  Brent Lance,et al.  Reducing Offline BCI Calibration Effort Using Weighted Adaptation Regularization with Source Domain Selection , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[6]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[8]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[9]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[10]  Brent Lance,et al.  Switching EEG Headsets Made Easy: Reducing Offline Calibration Effort Using Active Weighted Adaptation Regularization , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[12]  Vinod Menon,et al.  Where and When the Anterior Cingulate Cortex Modulates Attentional Response: Combined fMRI and ERP Evidence , 2006, Journal of Cognitive Neuroscience.

[13]  Brent Lance,et al.  Efficient Labeling of EEG Signal Artifacts Using Active Learning , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[14]  Jon Touryan,et al.  A Comparison of Electroencephalography Signals Acquired from Conventional and Mobile Systems , 2014 .

[15]  Dongrui Wu,et al.  Collaborative Filtering for Brain-Computer Interaction Using Transfer Learning and Active Class Selection , 2013, PloS one.

[16]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[17]  K. Bulayeva,et al.  Visual evoked potentials: Phenotypic and genotypic variability , 1993, Behavior genetics.

[18]  Benjamin Schrauwen,et al.  A P300 BCI for the Masses: Prior Information Enables Instant Unsupervised Spelling , 2012, NIPS.

[19]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[20]  Jun Lu,et al.  A review on transfer learning for brain-computer interface classification , 2015, 2015 5th International Conference on Information Science and Technology (ICIST).

[21]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[22]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[23]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[24]  Philip S. Yu,et al.  Adaptation Regularization: A General Framework for Transfer Learning , 2014, IEEE Transactions on Knowledge and Data Engineering.

[25]  Scott A. Huettel,et al.  What is odd in the oddball task? Prefrontal cortex is activated by dynamic changes in response strategy , 2004, Neuropsychologia.

[26]  Fabien Lotte,et al.  Signal Processing Approaches to Minimize or Suppress Calibration Time in Oscillatory Activity-Based Brain–Computer Interfaces , 2015, Proceedings of the IEEE.

[27]  Moritz Grosse-Wentrup,et al.  Beamforming in Noninvasive Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[28]  P. Sajda,et al.  Spatiotemporal Linear Decoding of Brain State , 2008, IEEE Signal Processing Magazine.

[29]  Dongrui Wu,et al.  Online driver's drowsiness estimation using domain adaptation with model fusion , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[30]  JapkowiczNathalie,et al.  The class imbalance problem: A systematic study , 2002 .

[31]  Moritz Grosse-Wentrup,et al.  Multitask Learning for Brain-Computer Interfaces , 2010, AISTATS.

[32]  Jan Kremláček,et al.  Aging effect in pattern, motion and cognitive visual evoked potentials , 2012, Vision Research.

[33]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[34]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[35]  Claus Bahlmann,et al.  In a Blink of an Eye and a Switch of a Transistor: Cortically Coupled Computer Vision , 2010, Proceedings of the IEEE.

[36]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[37]  Brent Lance,et al.  Offline EEG-based driver drowsiness estimation using enhanced batch-mode active learning (EBMAL) for regression , 2018, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[38]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[39]  Brent Lance,et al.  Transfer learning and active transfer learning for reducing calibration data in single-trial classification of visually-evoked potentials , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[40]  Brent Lance,et al.  Reducing BCI calibration effort in RSVP tasks using online weighted adaptation regularization with source domain selection , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[41]  Rushi Longadge,et al.  Class Imbalance Problem in Data Mining Review , 2013, ArXiv.

[42]  O. J. Dunn Multiple Comparisons Using Rank Sums , 1964 .

[43]  Dongrui Wu,et al.  Improved Neural Signal Classification in a Rapid Serial Visual Presentation Task Using Active Learning , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[45]  Zhilin Zhang,et al.  Evolving Signal Processing for Brain–Computer Interfaces , 2012, Proceedings of the IEEE.

[46]  Shih-Fu Chang,et al.  Closing the loop in cortically-coupled computer vision: a brain–computer interface for searching image databases , 2011, Journal of neural engineering.

[47]  D Yves von Cramon,et al.  Amplitude differences of evoked alpha and gamma oscillations in two different age groups. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[48]  Christian Jutten,et al.  Multiclass Brain–Computer Interface Classification by Riemannian Geometry , 2012, IEEE Transactions on Biomedical Engineering.

[49]  Rosalind W. Picard Affective Computing , 1997 .

[50]  N. Bigdely-Shamlo,et al.  Brain Activity-Based Image Classification From Rapid Serial Visual Presentation , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[51]  Alexander Zien,et al.  Semi-Supervised Learning , 2006 .

[52]  Anthony Widjaja,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2003, IEEE Transactions on Neural Networks.

[53]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.