Transfer of semi-supervised broad learning system in electroencephalography signal classification

Electroencephalography (EEG) signal classification is a crucial part in motor imagery brain–computer interface (BCI) system. Traditional supervised learning methods have performed well pleasing in EEG classification. Unfortunately, the unlabeled samples are easier to collect than labeled samples. In addition, recent studies have shown that it may degenerate performance of semi-supervised learning by exploiting unlabeled samples without selection. To address these issues, a novel semi-supervised broad learning system with transfer learning (TSS-BLS) is proposed in this paper. First, the pseudo-labels of unlabeled samples are obtained using the joint distribution adaptation algorithm. TSS-BLS is then constructed by an improved manifold regularization framework containing both labeled and pseudo-label information. Finally, the effectiveness of the proposed TSS-BLS is evaluated on three BCI competition datasets and four benchmark datasets from UCI repository and compared with seven state-of-the-art algorithms, including ELM, SS-ELM, HELM, SVM, LapSVM, BLS and GSS-BLS. Experimental results show that the performance of TSS-BLS is superior to BLS and GSS-BLS on average. It is thereby shown that TSS-BLS is safe and efficient for EEG classification.

[1]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[2]  Qingshan She,et al.  Multi-task Motor Imagery EEG Classification Using Broad Learning and Common Spatial Pattern , 2018, IFIP TC12 ICIS.

[3]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[4]  Qingshan She,et al.  Safe Semi-Supervised Extreme Learning Machine for EEG Signal Classification , 2018, IEEE Access.

[5]  Bo Hu,et al.  A hierarchical semi-supervised extreme learning machine method for EEG recognition , 2018, Medical & Biological Engineering & Computing.

[6]  Monji Kherallah,et al.  Clothing Classification Using Deep CNN Architecture Based on Transfer Learning , 2019 .

[7]  Bo Du,et al.  Spectral–Spatial Weighted Kernel Manifold Embedded Distribution Alignment for Remote Sensing Image Classification , 2020, IEEE Transactions on Cybernetics.

[8]  Wu Deng,et al.  Semi-Supervised Broad Learning System Based on Manifold Regularization and Broad Network , 2020, IEEE Transactions on Circuits and Systems I: Regular Papers.

[9]  Duoqian Miao,et al.  Best basis-based wavelet packet entropy feature extraction and hierarchical EEG classification for epileptic detection , 2011, Expert Syst. Appl..

[10]  G Pfurtscheller,et al.  Seperability of four-class motor imagery data using independent components analysis , 2006, Journal of neural engineering.

[11]  Qingshan She,et al.  Decoding EEG in Motor Imagery Tasks with Graph Semi-Supervised Broad Learning , 2019, Electronics.

[12]  C. L. Philip Chen,et al.  Broad Learning System: An Effective and Efficient Incremental Learning System Without the Need for Deep Architecture , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Lei Cao,et al.  Short time Fourier transformation and deep neural networks for motor imagery brain computer interface recognition , 2018, Concurr. Comput. Pract. Exp..

[14]  Jiming Chen,et al.  Semi-supervised Laplacian regularized least squares algorithm for localization in wireless sensor networks , 2011, Comput. Networks.

[15]  Cheng Wu,et al.  Semi-Supervised and Unsupervised Extreme Learning Machines , 2014, IEEE Transactions on Cybernetics.

[16]  Carey E. Priebe,et al.  The Effect of Model Misspecification on Semi-Supervised Classification , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Zhi-Hua Zhou,et al.  Towards Making Unlabeled Data Never Hurt , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[19]  C. L. Philip Chen,et al.  Hyperspectral Imagery Classification Based on Semi-Supervised Broad Learning System , 2018, Remote. Sens..

[20]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[21]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[22]  Ivor W. Tsang,et al.  Domain Adaptation via Transfer Component Analysis , 2009, IEEE Transactions on Neural Networks.

[23]  Mikhail Belkin,et al.  Laplacian Support Vector Machines Trained in the Primal , 2009, J. Mach. Learn. Res..

[24]  Shuang Feng,et al.  Fuzzy Broad Learning System: A Novel Neuro-Fuzzy Model for Regression and Classification , 2020, IEEE Transactions on Cybernetics.

[25]  C. L. Philip Chen,et al.  Broad learning system: A new learning paradigm and system without going deep , 2017, 2017 32nd Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[26]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[27]  Tie Qiu,et al.  An Incremental Broad Learning Approach for Semi-Supervised Classification , 2019, 2019 IEEE Intl Conf on Dependable, Autonomic and Secure Computing, Intl Conf on Pervasive Intelligence and Computing, Intl Conf on Cloud and Big Data Computing, Intl Conf on Cyber Science and Technology Congress (DASC/PiCom/CBDCom/CyberSciTech).

[28]  C. L. Philip Chen,et al.  Discriminative graph regularized broad learning system for image recognition , 2018, Science China Information Sciences.

[29]  Zhi-Hua Zhou,et al.  Improving Semi-Supervised Support Vector Machines Through Unlabeled Instances Selection , 2010, AAAI.

[30]  Kai Zhang,et al.  Extreme learning machine and adaptive sparse representation for image classification , 2016, Neural Networks.

[31]  Qingshan She,et al.  A risk degree-based safe semi-supervised learning algorithm , 2016, Int. J. Mach. Learn. Cybern..

[32]  Songcan Chen,et al.  Safety-Aware Semi-Supervised Classification , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Songhua Xu,et al.  An advanced operating environment for mathematics education resources , 2017, Science China Information Sciences.

[34]  Natarajan Sriraam,et al.  EEG based multi-class seizure type classification using convolutional neural network and transfer learning , 2020, Neural Networks.

[35]  Guang-Bin Huang,et al.  Extreme Learning Machine for Multilayer Perceptron , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Tatsuhiko Tsunoda,et al.  A Deep Learning Approach for Motor Imagery EEG Signal Classification , 2016, 2016 3rd Asia-Pacific World Congress on Computer Science and Engineering (APWC on CSE).

[37]  Ram Bilas Pachori,et al.  Classification of Seizure and Nonseizure EEG Signals Using Empirical Mode Decomposition , 2012, IEEE Transactions on Information Technology in Biomedicine.

[38]  Yao Sun,et al.  Towards designing risk-based safe Laplacian Regularized Least Squares , 2016, Expert Syst. Appl..

[39]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[40]  Klaus-Robert Müller,et al.  Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms , 2004, IEEE Transactions on Biomedical Engineering.

[41]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[42]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.