Motor Imagery EEG Signals Decoding by Multivariate Empirical Wavelet Transform-Based Framework for Robust Brain–Computer Interfaces

The robustness and computational load are the key challenges in motor imagery (MI) based on electroencephalography (EEG) signals to decode for the development of practical brain-computer interface (BCI) systems. In this study, we propose a robust and simple automated multivariate empirical wavelet transform (MEWT) algorithm for the decoding of different MI tasks. The main contributions of this study are four-fold. First, the multiscale principal component analysis method is utilized in the preprocessing module to obtain robustness against noise. Second, a novel automated channel selection strategy is proposed and then is further verified with comprehensive comparisons among three different strategies for decoding channel combination selection. Third, a sub-band alignment method by utilizing MEWT is adopted to obtain joint instantaneous amplitude and frequency components for the first time in MI applications. Four, a robust correlation-based feature selection strategy is applied to largely reduce the system complexity and computational load. Extensive experiments for subject-specific and subject independent cases are conducted with the three-benchmark datasets from BCI competition III to evaluate the performances of the proposed method by employing typical machine-learning classifiers. For subject-specific case, experimental results show that an average sensitivity, specificity and classification accuracy of 98% was achieved by employing multilayer perceptron neural networks, logistic model tree and least-square support vector machine (LS-SVM) classifiers, respectively for three datasets, resulting in an improvement of upto 23.50% in classification accuracy as compared with other existing method. While an average sensitivity, specificity and classification accuracy of 93%, 92.1% and 91.4% was achieved for subject independent case by employing LS-SVM classifier for all datasets with an increase of up to 18.14% relative to other existing methods. Results also show that our proposed algorithm provides a classification accuracy of 100% for subjects with small training size in subject-specific case, and for subject independent case by employing a single source subject. Such satisfactory results demonstrate the great potential of the proposed MEWT algorithm for practical MI EEG signals classification.

[1]  T. Martin McGinnity,et al.  Quantum Neural Network-Based EEG Filtering for a Brain–Computer Interface , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Jasmin Kevric,et al.  Biomedical Signal Processing and Control , 2016 .

[3]  L. Cohen,et al.  Brain–computer interface in paralysis , 2008, Current opinion in neurology.

[4]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[5]  Pedro J. García-Laencina,et al.  Automatic and Adaptive Classification of Electroencephalographic Signals for Brain Computer Interfaces , 2012, Journal of Medical Systems.

[6]  Valer Jurcak,et al.  10/20, 10/10, and 10/5 systems revisited: Their validity as relative head-surface-based positioning systems , 2007, NeuroImage.

[7]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  T.M. McGinnity,et al.  Comparative Analysis of Spectral Approaches to Feature Extraction for EEG-Based Motor Imagery Classification , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[10]  Le Song,et al.  Classifying EEG for Brain-Computer Interface: Learning Optimal Filters for Dynamical System Features , 2006, ICML.

[11]  Bangyan Zhou,et al.  To Explore the Potentials of Independent Component Analysis in Brain-Computer Interface of Motor Imagery , 2020, IEEE Journal of Biomedical and Health Informatics.

[12]  Yan Li,et al.  Identification of motor imagery tasks through CC-LR algorithm in brain computer interface , 2013, Int. J. Bioinform. Res. Appl..

[13]  Laxmidhar Behera,et al.  Online Eye state recognition from EEG data using Deep architectures , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[14]  Chin-Teng Lin,et al.  Electroencephalogram Based Reaction Time Prediction With Differential Phase Synchrony Representations Using Co-Operative Multi-Task Deep Neural Networks , 2019, IEEE Transactions on Emerging Topics in Computational Intelligence.

[15]  Laxmidhar Behera,et al.  HJB-Equation-Based Optimal Learning Scheme for Neural Networks With Applications in Brain–Computer Interface , 2020, IEEE Transactions on Emerging Topics in Computational Intelligence.

[16]  Johan A. K. Suykens,et al.  Coupled Simulated Annealing , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Laxmidhar Behera,et al.  EEG Based Motor Imagery Classification Using Instantaneous Phase Difference Sequence , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[18]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[19]  Verónica Bolón-Canedo,et al.  A review of feature selection methods in medical applications , 2019, Comput. Biol. Medicine.

[20]  U. Rajendra Acharya,et al.  Application of entropies for automated diagnosis of epilepsy using EEG signals: A review , 2015, Knowl. Based Syst..

[21]  Yan Li,et al.  Clustering technique-based least square support vector machine for EEG signal classification , 2011, Comput. Methods Programs Biomed..

[22]  Gui-Bin Bian,et al.  Removal of Artifacts from EEG Signals: A Review , 2019, Sensors.

[23]  S. Voloshynovskiy,et al.  EEG-Based Synchronized Brain-Computer Interfaces: A Model for Optimizing the Number of Mental Tasks , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Abdulhamit Subasi,et al.  Classification of EEG signals using neural network and logistic regression , 2005, Comput. Methods Programs Biomed..

[25]  Yan Li,et al.  Modified CC-LR algorithm with three diverse feature sets for motor imagery tasks classification in EEG based brain-computer interface , 2014, Comput. Methods Programs Biomed..

[26]  Trent W. Lewis,et al.  Reducing training requirements through evolutionary based dimension reduction and subject transfer , 2016, Neurocomputing.

[27]  Kemal Polat,et al.  Classification of epileptiform EEG using a hybrid system based on decision tree classifier and fast Fourier transform , 2007, Appl. Math. Comput..

[28]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[29]  M G Jibukumar,et al.  Ictal EEG classification based on amplitude and frequency contours of IMFs , 2017 .

[30]  Tareq Manzoor,et al.  A Strategy for Classification of “Vaginal vs. Cesarean Section” Delivery: Bivariate Empirical Mode Decomposition of Cardiotocographic Recordings , 2019, Front. Physiol..

[31]  Wei Chen,et al.  A novel ensemble approach of bivariate statistical-based logistic model tree classifier for landslide susceptibility assessment , 2018 .

[32]  Oluwarotimi Williams Samuel,et al.  Towards Efficient Decoding of Multiple Classes of Motor Imagery Limb Movements Based on EEG Spectral and Time Domain Descriptors , 2017, Journal of Medical Systems.

[33]  Oluwarotimi Williams Samuel,et al.  Motor imagery classification of upper limb movements based on spectral domain features of EEG patterns , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  N Sriraam,et al.  Classification of epileptic seizures using wavelet packet log energy and norm entropies with recurrent Elman neural network classifier , 2016, Cognitive Neurodynamics.

[35]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[36]  Ram Bilas Pachori,et al.  A Multivariate Approach for Patient-Specific EEG Seizure Detection Using Empirical Wavelet Transform , 2017, IEEE Transactions on Biomedical Engineering.

[37]  G Pfurtscheller,et al.  Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[38]  G. Pfurtscheller,et al.  Graz-BCI: state of the art and clinical applications , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Yanchun Zhang,et al.  A New Design of Mental State Classification for Subject Independent BCI Systems , 2019, IRBM.

[40]  Oluwarotimi Williams Samuel,et al.  A motion-classification strategy based on sEMG-EEG signal combination for upper-limb amputees , 2017, Journal of NeuroEngineering and Rehabilitation.

[41]  G. Oriolo,et al.  Non-invasive brain–computer interface system: Towards its application as assistive technology , 2008, Brain Research Bulletin.

[42]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[43]  S. Kara,et al.  Log Energy Entropy-Based EEG Classification with Multilayer Neural Networks in Seizure , 2009, Annals of Biomedical Engineering.

[44]  Wei Wu,et al.  Classifying Single-Trial EEG During Motor Imagery by Iterative Spatio-Spectral Patterns Learning (ISSPL) , 2008, IEEE Transactions on Biomedical Engineering.

[45]  U. Rajendra Acharya,et al.  An Integrated Index for the Identification of Focal Electroencephalogram Signals Using Discrete Wavelet Transform and Entropy Measures , 2015, Entropy.

[46]  Jasmin Kevric,et al.  The Effect of Multiscale PCA De-noising in Epileptic Seizure Detection , 2014, Journal of Medical Systems.

[47]  S. G. Ponnambalam,et al.  Binary and multi-class motor imagery using Renyi entropy for feature extraction , 2017, Neural Computing and Applications.

[48]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[49]  Hua Wang,et al.  Detection of motor imagery EEG signals employing Naïve Bayes based learning process , 2016 .

[50]  Abdulhamit Subasi,et al.  Effect of multiscale PCA de-noising on EMG signal classification for diagnosis of neuromuscular disorders , 2014, Journal of Medical Systems.

[51]  Yan Li,et al.  Improving the Separability of Motor Imagery EEG Signals Using a Cross Correlation-Based Least Square Support Vector Machine for Brain–Computer Interface , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[52]  Mohammed Imamul Hassan Bhuiyan,et al.  Classification of motor imagery movements using multivariate empirical mode decomposition and short time Fourier transform based hybrid method , 2016 .

[53]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[54]  Anindya Bijoy Das,et al.  Motor imagery movements detection of EEG signals using statistical features in the Dual Tree Complex Wavelet Transform domain , 2015, 2015 International Conference on Electrical Engineering and Information Communication Technology (ICEEICT).

[55]  Jérôme Gilles,et al.  Empirical Wavelet Transform , 2013, IEEE Transactions on Signal Processing.

[56]  Yangsong Zhang,et al.  Z-Score Linear Discriminant Analysis for EEG Based Brain-Computer Interfaces , 2013, PloS one.

[57]  Zhaohui Yuan,et al.  Motor Imagery EEG Signals Classification Based on Mode Amplitude and Frequency Components Using Empirical Wavelet Transform , 2019, IEEE Access.

[58]  Gary E. Birch,et al.  Sparse spatial filter optimization for EEG channel reduction in brain-computer interface , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  N Sriraam,et al.  Multichannel EEG based inter-ictal seizures detection using Teager energy with backpropagation neural network classifier , 2018, Australasian Physical & Engineering Sciences in Medicine.

[60]  Abdulhamit Subasi,et al.  Ensemble SVM Method for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Instrumentation and Measurement.

[61]  Moritz Grosse-Wentrup,et al.  Multisubject Learning for Common Spatial Patterns in Motor-Imagery BCI , 2011, Comput. Intell. Neurosci..

[62]  Eibe Frank,et al.  Logistic Model Trees , 2003, ECML.

[63]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[64]  Fusheng Yang,et al.  BCI competition 2003-data set IIb: enhancing P300 wave detection using ICA-based subspace projections for BCI applications , 2004, IEEE Transactions on Biomedical Engineering.

[65]  Ahmed H. Tewfik,et al.  Adapting subject specific motor imagery EEG patterns in space-time-frequency for a brain computer interface , 2009, Biomed. Signal Process. Control..

[66]  Dheeraj Sharma,et al.  Features based on analytic IMF for classifying motor imagery EEG signals in BCI applications , 2018 .

[67]  Kwee-Bo Sim,et al.  Analysis the effect of PCA for feature reduction in non-stationary EEG based motor imagery of BCI system , 2014 .

[68]  Zied Elouedi,et al.  Ranking-Based Feature Selection Method for Dynamic Belief Clustering , 2011, ICAIS.

[69]  Abdulhamit Subasi,et al.  Effect of Multiscale PCA De-noising in ECG Beat Classification for Diagnosis of Cardiovascular Diseases , 2015, Circuits Syst. Signal Process..

[70]  Fathi E. Abd El-Samie,et al.  A review of channel selection algorithms for EEG signal processing , 2015, EURASIP Journal on Advances in Signal Processing.