Double-Criteria Active Learning for Multiclass Brain-Computer Interfaces

Recent technological advances have enabled researchers to collect large amounts of electroencephalography (EEG) signals in labeled and unlabeled datasets. It is expensive and time consuming to collect labeled EEG data for use in brain-computer interface (BCI) systems, however. In this paper, a novel active learning method is proposed to minimize the amount of labeled, subject-specific EEG data required for effective classifier training, by combining measures of uncertainty and representativeness within an extreme learning machine (ELM). Following this approach, an ELM classifier was first used to select a relatively large batch of unlabeled examples, whose uncertainty was measured through the best-versus-second-best (BvSB) strategy. The diversity of each sample was then measured between the limited labeled training data and previously selected unlabeled samples, and similarity is measured among the previously selected samples. Finally, a tradeoff parameter is introduced to control the balance between informative and representative samples, and these samples are then used to construct a powerful ELM classifier. Extensive experiments were conducted using benchmark and multiclass motor imagery EEG datasets to evaluate the efficacy of the proposed method. Experimental results show that the performance of the new algorithm exceeds or matches those of several state-of-the-art active learning algorithms. It is thereby shown that the proposed method improves classifier performance and reduces the need for training samples in BCI applications.

[1]  Wei Liu,et al.  Exploring Representativeness and Informativeness for Active Learning , 2019, IEEE Transactions on Cybernetics.

[2]  Brent Lance,et al.  Efficient Labeling of EEG Signal Artifacts Using Active Learning , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[3]  Yong Zhang,et al.  Sequential active learning using meta-cognitive extreme learning machine , 2016, Neurocomputing.

[4]  Rong Jin,et al.  Semisupervised SVM batch mode active learning with applications to image retrieval , 2009, TOIS.

[5]  Nikolaos Papanikolopoulos,et al.  Scalable Active Learning for Multiclass Image Classification , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Ka-Chun Wong,et al.  Active Learning Based on Single-Hidden Layer Feed-Forward Neural Network , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[7]  George Kesidis,et al.  A Maximum Entropy Framework for Semisupervised and Active Learning With Unknown and Label-Scarce Classes , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Shiliang Sun,et al.  Multiple-view multiple-learner active learning , 2010, Pattern Recognit..

[9]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Murat Akçakaya,et al.  Spatio-temporal EEG models for brain interfaces , 2017, Signal Process..

[11]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[12]  Enrique del Castillo,et al.  Query-by-committee improvement with diversity and density in batch active learning , 2018, Inf. Sci..

[13]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[14]  Qingshan She,et al.  Scale-Dependent Signal Identification in Low-Dimensional Subspace: Motor Imagery Task Classification , 2016, Neural plasticity.

[15]  Daphne Koller,et al.  Support Vector Machine Active Learning with Applications to Text Classification , 2000, J. Mach. Learn. Res..

[16]  Yuanqing Li,et al.  Control of a Wheelchair in an Indoor Environment Based on a Brain–Computer Interface and Automated Navigation , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[18]  Changyin Sun,et al.  AL-ELM: One uncertainty-based active learning algorithm using extreme learning machine , 2015, Neurocomputing.

[19]  Seokjin Lee,et al.  Low complexity adaptive forgetting factor for online sequential extreme learning machine (OS-ELM) for application to nonstationary system estimations , 2012, Neural Computing and Applications.

[20]  Saeid Nahavandi,et al.  Multiclass Informative Instance Transfer Learning Framework for Motor Imagery-Based Brain-Computer Interface , 2018, Comput. Intell. Neurosci..

[21]  Zhong Jin,et al.  Active learning combining uncertainty and diversity for multi-class image classification , 2015, IET Comput. Vis..

[22]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[23]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[24]  Liqing Zhang,et al.  Active training paradigm for motor imagery BCI , 2012, Experimental Brain Research.

[25]  Hui Wang,et al.  A multi-class EEG-based BCI classification using multivariate empirical mode decomposition based filtering and Riemannian geometry , 2018, Expert Syst. Appl..

[26]  Cuntai Guan,et al.  EEG-Based Strategies to Detect Motor Imagery for Control and Rehabilitation , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Kai Zhang,et al.  Extreme learning machine and adaptive sparse representation for image classification , 2016, Neural Networks.

[28]  Meng Ming,et al.  Two-level Feature Extraction Method for Multi-class Motor Imagery EEG , 2016 .

[29]  Sethuraman Panchanathan,et al.  Batch mode active sampling based on marginal probability distribution matching , 2012, TKDD.

[30]  Jesús Alcalá-Fdez,et al.  KEEL Data-Mining Software Tool: Data Set Repository, Integration of Algorithms and Experimental Analysis Framework , 2011, J. Multiple Valued Log. Soft Comput..

[31]  Yingchun Zhang,et al.  Enhancing Performance of a Hybrid EEG-fNIRS System Using Channel Selection and Early Temporal Features , 2017, Front. Hum. Neurosci..

[32]  Rong Jin,et al.  Active Learning by Querying Informative and Representative Examples , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Minyou Chen,et al.  A batch-mode active learning method based on the nearest average-class distance (NACD) for multiclass brain-computer interfaces , 2014 .