Bagging Adversarial Neural Networks for Domain Adaptation in Non-Stationary EEG

A major issue in bringing real-world applications of machine learning outside the laboratory is the difference in the data distributions between training and testing stages or domains. The diverging statistical properties in different domains can lead to decay the prediction performance. The technical term for a change in the distribution of features is covariate shift, which also happens to be a common challenge in electroencephalogram (EEG) based brain-computer interface (BCI); this is due to the presence of non-stationarities in the EEG signals. It is also the case that collecting and labelling samples is expensive, resulting in small datasets that are not in tune with the "big data" spirit that is the characteristic of the era. In this paper, we introduce a new method that handles domain adaptation in small datasets; the method combines elements of unsupervised domain adaptation with ensemble methods. We evaluate on real-world datasets corresponding to motor-imagery detection (BCI competition 2008 dataset 2A). The method produces state of the art results.

[1]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[3]  P. Bühlmann Bagging, subagging and bragging for improving some prediction algorithms , 2003 .

[4]  G. Pfurtscheller,et al.  Brain–Computer Communication: Motivation, Aim, and Impact of Exploring a Virtual Apartment , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Reinhold Scherer,et al.  A fully on-line adaptive BCI , 2006, IEEE Transactions on Biomedical Engineering.

[6]  Girijesh Prasad,et al.  Learning with covariate shift-detection and adaptation in non-stationary environments: Application to brain-computer interface , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[7]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[8]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[9]  Klaus-Robert Müller,et al.  Covariate Shift Adaptation by Importance Weighted Cross Validation , 2007, J. Mach. Learn. Res..

[10]  Yasuharu Koike,et al.  Application of Covariate Shift Adaptation Techniques in Brain–Computer Interfaces , 2010, IEEE Transactions on Biomedical Engineering.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Girijesh Prasad,et al.  EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments , 2015, Pattern Recognit..

[13]  Girijesh Prasad,et al.  Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface , 2015, Soft Computing.

[14]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[15]  Rajesh P. N. Rao,et al.  Towards adaptive classification for BCI , 2006, Journal of neural engineering.

[16]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[17]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[18]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[19]  Jiaying Liu,et al.  Revisiting Batch Normalization For Practical Domain Adaptation , 2016, ICLR.

[20]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[21]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[22]  Anirban Chowdhury,et al.  An EEG-EMG correlation-based brain-computer interface for hand orthosis supported neuro-rehabilitation , 2019, Journal of Neuroscience Methods.

[23]  Girijesh Prasad,et al.  Optimising frequency band selection with forward-addition and backward-elimination algorithms in EEG-based brain-computer interfaces , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[24]  Anirban Chowdhury,et al.  Online Covariate Shift Detection-Based Adaptive Brain–Computer Interface to Trigger Hand Exoskeleton Feedback for Neuro-Rehabilitation , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[25]  Francisco Herrera,et al.  A unifying view on dataset shift in classification , 2012, Pattern Recognit..

[26]  Girijesh Prasad,et al.  Covariate shift estimation based adaptive ensemble learning for handling non-stationarity in motor imagery related EEG-based brain-computer interface , 2018, Neurocomputing.

[27]  Klaus-Robert Müller,et al.  Classifying Single Trial EEG: Towards Brain Computer Interfacing , 2001, NIPS.

[28]  Girijesh Prasad,et al.  A combination of transductive and inductive learning for handling non-stationarities in motor imagery classification , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[29]  Cuntai Guan,et al.  Optimizing Spatial Filters by Minimizing Within-Class Dissimilarities in Electroencephalogram-Based Brain–Computer Interface , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..