Diverse Feature Blend Based on Filter-Bank Common Spatial Pattern and Brain Functional Connectivity for Multiple Motor Imagery Detection

Motor imagery (MI) based brain-computer interface (BCI) is a research hotspot and has attracted lots of attention. Within this research topic, multiple MI classification is a challenge due to the difficulties caused by time-varying spatial features across different individuals. To deal with this challenge, we tried to fuse brain functional connectivity (BFC) and one-versus-the-rest filter-bank common spatial pattern (OVR-FBCSP) to improve the robustness of classification. The BFC features were extracted by phase locking value (PLV), representing the brain inter-regional interactions relevant to the MI, whilst the OVR-FBCSP is used to extract the spatial-frequency features related to the MI. These diverse features were then fed into a multi-kernel relevance vector machine (MK-RVM). The dataset with three motor imagery tasks (left hand MI, right hand MI, and feet MI) was used to assess the proposed method. Experimental results not only showed that the cascade structure of diverse feature fusion and MK-RVM achieved satisfactory classification performance (average accuracy: 83.81%, average kappa: 0.76), but also demonstrated that BFC plays a supplementary role in the MI classification. Moreover, the proposed method has a potential to be integrated into multiple MI online detection owing to the advantage of strong time-efficiency of RVM.

[1]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[2]  Bangyan Zhou,et al.  A Fully Automated Trial Selection Method for Optimization of Motor Imagery Based Brain-Computer Interface , 2016, PloS one.

[3]  Xingyu Wang,et al.  Temporally Constrained Sparse Group Spatial Patterns for Motor Imagery BCI , 2019, IEEE Transactions on Cybernetics.

[4]  Hongmei Yan,et al.  F-score feature selection based Bayesian reconstruction of visual image from human brain activity , 2018, Neurocomputing.

[5]  Enzeng Dong,et al.  A novel hybrid kernel function relevance vector machine for multi-task motor imagery EEG classification , 2020, Biomed. Signal Process. Control..

[6]  Razi Iqbal,et al.  Multiclass EEG motor-imagery classification with sub-band common spatial patterns , 2019, EURASIP Journal on Wireless Communications and Networking.

[7]  Li Zhang,et al.  Differential evolution algorithm as a tool for optimal feature subset selection in motor imagery EEG , 2017, Expert Syst. Appl..

[8]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[9]  Kup-Sze Choi,et al.  Discrimination of motor imagery tasks via information flow pattern of brain connectivity. , 2016, Technology and health care : official journal of the European Society for Engineering and Medicine.

[10]  Yu Zhang,et al.  Sparse Group Representation Model for Motor Imagery EEG Classification , 2019, IEEE Journal of Biomedical and Health Informatics.

[11]  Yongcai Guo,et al.  Recognition of human activities using a multiclass relevance vector machine , 2012 .

[12]  Chao Li,et al.  Canonical Polyadic Decomposition With Auxiliary Information for Brain–Computer Interface , 2014, IEEE Journal of Biomedical and Health Informatics.

[13]  Hongtao Wang,et al.  The control of a virtual automatic car based on multiple patterns of motor imagery BCI , 2018, Medical & Biological Engineering & Computing.

[14]  Jasmin Kevric,et al.  Biomedical Signal Processing and Control , 2016 .

[15]  René de Jesús Romero-Troncoso,et al.  Quaternion-Based Signal Analysis for Motor Imagery Classification from Electroencephalographic Signals , 2016, Sensors.

[16]  Liqing Zhang,et al.  Exploring Motor Imagery Eeg Patterns for Stroke Patients with Deep Neural Networks , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Tzyy-Ping Jung,et al.  Decoding EEG in Cognitive Tasks With Time-Frequency and Connectivity Masks , 2016, IEEE Transactions on Cognitive and Developmental Systems.

[18]  Ping Xue,et al.  Sub-band Common Spatial Pattern (SBCSP) for Brain-Computer Interface , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[19]  Jinchang Ren,et al.  EEG-Based Brain-Computer Interfaces Using Motor-Imagery: Techniques and Challenges , 2019, Sensors.

[20]  Wang Hong-tao,et al.  A motor imagery analysis algorithm based on spatio-temporal-frequency joint selection and relevance vector machine , 2017 .

[21]  Pedro J. García-Laencina,et al.  Automatic and Adaptive Classification of Electroencephalographic Signals for Brain Computer Interfaces , 2012, Journal of Medical Systems.

[22]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[23]  Rui Li,et al.  Learning EEG topographical representation for classification via convolutional neural network , 2020, Pattern Recognit..

[24]  Bo Hu,et al.  A hierarchical semi-supervised extreme learning machine method for EEG recognition , 2018, Medical & Biological Engineering & Computing.

[25]  Xingyu Wang,et al.  Sparse Bayesian Learning for Obtaining Sparsity of EEG Frequency Bands Based Feature Vectors in Motor Imagery Classification , 2017, Int. J. Neural Syst..

[26]  Cuntai Guan,et al.  On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Fei Wang,et al.  The Dynamic Brain Networks of Motor Imagery: Time-Varying Causality Analysis of Scalp EEG , 2019, Int. J. Neural Syst..

[28]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[29]  Howida A. Shedeed,et al.  A CSP\AM-BA-SVM Approach for Motor Imagery BCI System , 2018, IEEE Access.

[30]  Yu Zhang,et al.  Multi-kernel extreme learning machine for EEG classification in brain-computer interfaces , 2018, Expert Syst. Appl..

[31]  Theodoros Damoulas,et al.  Multiclass Relevance Vector Machines: Sparsity and Accuracy , 2010, IEEE Transactions on Neural Networks.

[32]  Yinsheng Chen,et al.  A Novel Rolling Bearing Fault Diagnosis and Severity Analysis Method , 2019, Applied Sciences.

[33]  Chao Chen,et al.  Introducing chaos behavior to kernel relevance vector machine (RVM) for four-class EEG classification , 2018, PloS one.

[34]  Brendan Z. Allison,et al.  Brain-Computer Interfaces: A Gentle Introduction , 2009 .

[35]  Alok Sharma,et al.  CSP-TSM: Optimizing the performance of Riemannian tangent space mapping using common spatial pattern for MI-BCI , 2017, Comput. Biol. Medicine.

[36]  Jie Zhou,et al.  Classification of motor imagery eeg using wavelet envelope analysis and LSTM networks , 2018, 2018 Chinese Control And Decision Conference (CCDC).

[37]  H. Hannah Inbarani,et al.  PSO-based feature selection and neighborhood rough set-based classification for BCI multiclass motor imagery task , 2017, Neural Computing and Applications.

[38]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Ting Li,et al.  An Approach of One-vs-Rest Filter Bank Common Spatial Pattern and Spiking Neural Networks for Multiple Motor Imagery Decoding , 2020, IEEE Access.

[40]  Alok Sharma,et al.  An improved discriminative filter bank selection approach for motor imagery EEG signal classification using mutual information , 2017, BMC Bioinformatics.

[41]  Tzyy-Ping Jung,et al.  Combining ERPs and EEG spectral features for decoding intended movement direction , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[42]  Qingsong Ai,et al.  Feature extraction of four-class motor imagery EEG signals based on functional brain network , 2019, Journal of neural engineering.

[43]  Wenlong Li,et al.  Phase Synchronization Information for Classifying Motor Imagery EEG From the Same Limb , 2019, IEEE Access.

[44]  Chao Chen,et al.  Classification of EEG Multiple Imagination Tasks Based on Independent Component Analysis and Relevant Vector Machines , 2019, 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC).

[45]  Ki-Baek Lee,et al.  Estimation of Brain Connectivity during Motor Imagery Tasks using Noise-Assisted Multivariate Empirical Mode Decomposition , 2016 .

[46]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[47]  Paul Bustios,et al.  Restricted exhaustive search for frequency band selection in motor imagery classification , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[48]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[49]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[50]  D.J. McFarland,et al.  An Evaluation of Autoregressive Spectral Estimation Model Order for Brain-Computer Interface Applications , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[51]  Mohammad Reza Karami Mollaei,et al.  A novel method for classification of BCI multi-class motor imagery task based on Dempster-Shafer theory , 2019, Inf. Sci..

[52]  Bangyan Zhou,et al.  How many channels are suitable for independent component analysis in motor imagery brain-computer interface , 2019, Biomed. Signal Process. Control..

[53]  Peng Chen,et al.  Driving Fatigue Classification Based on Fusion Entropy Analysis Combining EOG and EEG , 2019, IEEE Access.

[54]  Jing Liu,et al.  Feature selection based on FDA and F-score for multi-class classification , 2017, Expert Syst. Appl..

[55]  Yunfa Fu,et al.  Time–Frequency Cross Mutual Information Analysis of the Brain Functional Networks Underlying Multiclass Motor Imagery , 2018, Journal of motor behavior.

[56]  Nitish V. Thakor,et al.  Performance Improvement of Driving Fatigue Identification Based on Power Spectra and Connectivity Using Feature Level and Decision Level Fusions , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).