Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface

A common assumption in traditional supervised learning is the similar probability distribution of data between the training phase and the testing/operating phase. When transitioning from the training to testing phase, a shift in the probability distribution of input data is known as a covariate shift. Covariate shifts commonly arise in a wide range of real-world systems such as electroencephalogram-based brain–computer interfaces (BCIs). In such systems, there is a necessity for continuous monitoring of the process behavior, and tracking the state of the covariate shifts to decide about initiating adaptation in a timely manner. This paper presents a covariate shift-detection and -adaptation methodology, and its application to motor imagery-based BCIs. A covariate shift-detection test based on an exponential weighted moving average model is used to detect the covariate shift in the features extracted from motor imagery-based brain responses. Following the covariate shift-detection test, the methodology initiates an adaptation by updating the classifier during the testing/operating phase. The usefulness of the proposed method is evaluated using real-world BCI datasets (i.e. BCI competition IV dataset 2A and 2B). The results show a statistically significant improvement in the classification accuracy of the BCI system over traditional learning and semi-supervised learning methods.

[1]  Gabriel Curio,et al.  MACHINE LEARNING TECHNIQUES FOR BRAIN-COMPUTER INTERFACES , 2004 .

[2]  Niall M. Adams,et al.  The impact of changing populations on classifier performance , 1999, KDD '99.

[3]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[4]  PolikarRobi,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011 .

[5]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[6]  A. Buttfield,et al.  Towards a robust BCI: error potentials and online learning , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) algorithm using online adaptive and semi-supervised learning , 2011, The 2011 International Joint Conference on Neural Networks.

[8]  Vladimir Vapnik,et al.  An overview of statistical learning theory , 1999, IEEE Trans. Neural Networks.

[9]  Girijesh Prasad,et al.  EWMA Based Two-Stage Dataset Shift-Detection in Non-stationary Environments , 2013, AIAI.

[10]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[11]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[12]  J R Wolpaw,et al.  EEG-Based Brain-Computer Interfaces. , 2017, Current opinion in biomedical engineering.

[13]  Ludmila I. Kuncheva,et al.  PCA Feature Extraction for Change Detection in Multidimensional Unlabeled Data , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[15]  H. Hotelling Multivariate Quality Control-illustrated by the air testing of sample bombsights , 1947 .

[16]  Robi Polikar,et al.  Incremental Learning of Concept Drift in Nonstationary Environments , 2011, IEEE Transactions on Neural Networks.

[17]  Zoubin Ghahramani,et al.  Learning from labeled and unlabeled data with label propagation , 2002 .

[18]  Heung-Il Suk,et al.  A Novel Bayesian Framework for Discriminative Feature Extraction in Brain-Computer Interfaces , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  T. Martin McGinnity,et al.  Faster Self-Organizing Fuzzy Neural Network Training and a Hyperparameter Analysis for a Brain–Computer Interface , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[20]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[21]  Wolfgang Rosenstiel,et al.  Principal component based covariate shift adaption to reduce non-stationarity in a MEG-based brain-computer interface , 2012, EURASIP J. Adv. Signal Process..

[22]  Girijesh Prasad,et al.  A Covariate Shift Minimisation Method to Alleviate Non-stationarity Effects for an Adaptive Brain-Computer Interface , 2010, 2010 20th International Conference on Pattern Recognition.

[23]  Kouhyar Tavakolian,et al.  Different classification techniques considering brain computer interface applications. , 2006, Journal of neural engineering.

[24]  Girijesh Prasad,et al.  Dataset Shift Detection in Non-stationary Environments Using EWMA Charts , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[25]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[26]  Girijesh Prasad,et al.  Bispectrum-based feature extraction technique for devising a practical brain–computer interface , 2011, Journal of neural engineering.

[27]  João Gama,et al.  Recurrent concepts in data streams classification , 2013, Knowledge and Information Systems.

[28]  M. Thulasidas,et al.  Robust classification of EEG signal for brain-computer interface , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Cuntai Guan,et al.  A Covariate Shift Minimization Method to Alleviate Non-Stationarity Effects for an Adaptive Brain-Computer Interface , 2010 .

[30]  T. Martin McGinnity,et al.  Designing a robust type-2 fuzzy logic classifier for non-stationary systems with application in brain-computer interfacing , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[31]  M. Arvaneh,et al.  Optimizing Spatial Filters by Minimizing Within-class Dissimilarities in EEG-based BCI , 2012 .

[32]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[33]  Cuntai Guan,et al.  EEG Data Space Adaptation to Reduce Intersession Nonstationarity in Brain-Computer Interface , 2013, Neural Computation.

[34]  R. Leeb,et al.  BCI Competition 2008 { Graz data set B , 2008 .

[35]  Yasuharu Koike,et al.  Application of Covariate Shift Adaptation Techniques in Brain–Computer Interfaces , 2010, IEEE Transactions on Biomedical Engineering.

[36]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[37]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[38]  João Gama,et al.  A survey on concept drift adaptation , 2014, ACM Comput. Surv..

[39]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[40]  Girijesh Prasad,et al.  EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments , 2015, Pattern Recognit..

[41]  Girijesh Prasad,et al.  Adaptive learning with covariate shift-detection for non-stationary environments , 2014, 2014 14th UK Workshop on Computational Intelligence (UKCI).

[42]  H. Shimodaira,et al.  Improving predictive inference under covariate shift by weighting the log-likelihood function , 2000 .

[43]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[44]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[45]  Cesare Alippi,et al.  Just-In-Time Classifiers for Recurrent Concepts , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[46]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[47]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[48]  Masashi Sugiyama,et al.  Learning Under Non-stationarity: Covariate Shift Adaptation by Importance Weighting , 2012 .

[49]  Girijesh Prasad,et al.  Optimising frequency band selection with forward-addition and backward-elimination algorithms in EEG-based brain-computer interfaces , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).