Transferring Common Spatial Filters With Semi-Supervised Learning for Zero-Training Motor Imagery Brain-Computer Interface

Common spatial pattern (CSP) has been proved to be one of the most efficient feature-extracting methods for brain–computer interfaces (BCIs), especially for motor imagery BCI. However, CSP is a supervised method and performs poorly when there are not enough labeled data. This paper aims to construct a minimum-training BCI, which means there are only a few labeled data, even none labeled data for target subjects. Under this condition, conventional CSP cannot work well. Therefore, source data (related labeled data from other subjects) are exploited and common filters across subjects are obtained using a clustering method. After that, features are extracted and a semi-supervised support vector machine which transfers knowledge across subjects is proposed. The experiments illustrate the effectiveness of our algorithm. When there are none labeled data for target subjects, our algorithm outperforms two state-of-the-art algorithms in semi-supervised learning field, and as the amount of unlabeled data for target subjects becomes larger, the performance of our algorithm grows better and better, which is suitable for online use. When the amount of labeled data for target subjects (denoted as <inline-formula> <tex-math notation="LaTeX">$M$ </tex-math></inline-formula> in this paper) is small, our algorithm also shows its strength compared with corresponding outstanding algorithms. For dataset IVa of BCI competition III, our algorithm performs the best for all the subjects excluding “aw” when <inline-formula> <tex-math notation="LaTeX">${M}=20$ </tex-math></inline-formula>. Compared with counterparts, our method outperforms 6.6% for “aa,” 19.3% for “al,” 11.8% for “av,” and 9.7% for “ay” on average, respectively. When <inline-formula> <tex-math notation="LaTeX">${M}=40$ </tex-math></inline-formula>, our method performs the best for “al” and “av”. It averagely outperforms 8.0% for “al” and 15.3% for “av,” respectively. For GigaDataset, averagely our method outperforms 4.4% for “sbj2,” 5.0% for “sbj4,” and 7.1% for “sbj5” when <inline-formula> <tex-math notation="LaTeX">${M}=20$ </tex-math></inline-formula>, respectively. When <inline-formula> <tex-math notation="LaTeX">${M}=40$ </tex-math></inline-formula>, our algorithm performs the best only for “sbj5.” It averagely outperforms 8.6% compared with counterparts. Although the performances of our method are not the best for all the conditions, its performances are very robust and competitive.

[1]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[2]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[3]  Dezhong Yao,et al.  Transductive SVM for reducing the training effort in BCI , 2007, Journal of neural engineering.

[4]  Cuntai Guan,et al.  Optimizing the Channel Selection and Classification Accuracy in EEG-Based BCI , 2011, IEEE Transactions on Biomedical Engineering.

[5]  Jianjun Meng,et al.  Improved Semisupervised Adaptation for a Small Training Dataset in the Brain–Computer Interface , 2014, IEEE Journal of Biomedical and Health Informatics.

[6]  Dean J Krusienski,et al.  Brain-computer interface research at the wadsworth center developments in noninvasive communication and control. , 2009, International review of neurobiology.

[7]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[8]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[9]  David M. W. Powers,et al.  PSO-based dimension reduction of EEG recordings: Implications for subject transfer in BCI , 2013, Neurocomputing.

[10]  Motoaki Kawanabe,et al.  Stationary common spatial patterns for brain–computer interfacing , 2012, Journal of neural engineering.

[11]  Aamir Saeed Malik,et al.  A Review on EEG-Based Automatic Sleepiness Detection Systems for Driver , 2018, IEEE Access.

[12]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[13]  Peter Stone,et al.  Transfer Learning for Reinforcement Learning Domains: A Survey , 2009, J. Mach. Learn. Res..

[14]  Ying Sun,et al.  Adaptation in P300 Brain–Computer Interfaces: A Two-Classifier Cotraining Approach , 2010, IEEE Transactions on Biomedical Engineering.

[15]  Xiaomu Song,et al.  Improving brain-computer interface classification using adaptive common spatial patterns , 2015, Comput. Biol. Medicine.

[16]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[17]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[18]  Bernhard Schölkopf,et al.  Transfer Learning in Brain-Computer Interfaces , 2015, IEEE Computational Intelligence Magazine.

[19]  Cuntai Guan,et al.  Learning from other subjects helps reducing Brain-Computer Interface calibration time , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[21]  Stefan Haufe,et al.  The Berlin Brain–Computer Interface: Non-Medical Uses of BCI Technology , 2010, Front. Neurosci..

[22]  Qin Tang,et al.  L1-Norm-Based Common Spatial Patterns , 2012, IEEE Transactions on Biomedical Engineering.

[23]  Yuanqing Li,et al.  Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm , 2008, Machine Learning.

[24]  Xiaojin Zhu,et al.  Introduction to Semi-Supervised Learning , 2009, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[25]  Shiliang Sun,et al.  A subject transfer framework for EEG classification , 2012, Neurocomputing.

[26]  Thorsten Joachims,et al.  Transductive Inference for Text Classification using Support Vector Machines , 1999, ICML.

[27]  Yuanqing Li,et al.  A self-training semi-supervised SVM algorithm and its application in an EEG-based brain computer interface speller system , 2008, Pattern Recognit. Lett..

[28]  Yuanqing Li,et al.  An Online Semi-supervised Brain–Computer Interface , 2013, IEEE Transactions on Biomedical Engineering.

[29]  Bin He,et al.  Brain-Computer Interface Control in a Virtual Reality Environment and Applications for the Internet of Things , 2018, IEEE Access.

[30]  Sean Hughes,et al.  Clustering by Fast Search and Find of Density Peaks , 2016 .

[31]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[32]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[33]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[34]  Shiliang Sun,et al.  Semi-supervised feature extraction for EEG classification , 2012, Pattern Analysis and Applications.