Brain wave classification using long short-term memory network based OPTICAL predictor

Brain-computer interface (BCI) systems having the ability to classify brain waves with greater accuracy are highly desirable. To this end, a number of techniques have been proposed aiming to be able to classify brain waves with high accuracy. However, the ability to classify brain waves and its implementation in real-time is still limited. In this study, we introduce a novel scheme for classifying motor imagery (MI) tasks using electroencephalography (EEG) signal that can be implemented in real-time having high classification accuracy between different MI tasks. We propose a new predictor, OPTICAL, that uses a combination of common spatial pattern (CSP) and long short-term memory (LSTM) network for obtaining improved MI EEG signal classification. A sliding window approach is proposed to obtain the time-series input from the spatially filtered data, which becomes input to the LSTM network. Moreover, instead of using LSTM directly for classification, we use regression based output of the LSTM network as one of the features for classification. On the other hand, linear discriminant analysis (LDA) is used to reduce the dimensionality of the CSP variance based features. The features in the reduced dimensional plane after performing LDA are used as input to the support vector machine (SVM) classifier together with the regression based feature obtained from the LSTM network. The regression based feature further boosts the performance of the proposed OPTICAL predictor. OPTICAL showed significant improvement in the ability to accurately classify left and right-hand MI tasks on two publically available datasets. The improvements in the average misclassification rates are 3.09% and 2.07% for BCI Competition IV Dataset I and GigaDB dataset, respectively. The Matlab code is available at https://github.com/ShiuKumar/OPTICAL.

[1]  Alok Sharma,et al.  A new parameter tuning approach for enhanced motor imagery EEG signal classification , 2018, Medical & Biological Engineering & Computing.

[2]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[3]  H. S. Davis,et al.  A Controlled Study , 1966 .

[4]  Girijesh Prasad,et al.  Adaptive learning with covariate shift-detection for motor imagery-based brain–computer interface , 2015, Soft Computing.

[5]  Sung-Jin Cho,et al.  Draft genome of the sea cucumber Apostichopus japonicus and genetic polymorphism among color variants , 2017, GigaScience.

[6]  Suleyman Serdar Kozat,et al.  Efficient Online Learning Algorithms Based on LSTM Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Alok Sharma,et al.  CSP-TSM: Optimizing the performance of Riemannian tangent space mapping using common spatial pattern for MI-BCI , 2017, Comput. Biol. Medicine.

[8]  Intan Nurma Yulita,et al.  Multi-Layer Perceptron for Sleep Stage Classification , 2018 .

[9]  Ronesh Sharma,et al.  Predicting MoRFs in protein sequences using HMM profiles , 2016, BMC Bioinformatics.

[10]  Ahmed H. Tewfik,et al.  Extraction subject-specific motor imagery time-frequency patterns for single trial EEG classification , 2007, Comput. Biol. Medicine.

[11]  Konstantinos N. Plataniotis,et al.  Separable Common Spatio-Spectral Patterns for Motor Imagery BCI Systems , 2016, IEEE Transactions on Biomedical Engineering.

[12]  Xi Long,et al.  A comparison of probabilistic classifiers for sleep stage classification , 2018, Physiological measurement.

[13]  Moncef Gabbouj,et al.  Epileptic seizure detection in long-term EEG records using sparse rational decomposition and local Gabor binary patterns feature extraction , 2017, Knowl. Based Syst..

[14]  Ronesh Sharma,et al.  OPAL+: Length‐Specific MoRF Prediction in Intrinsically Disordered Protein Sequences , 2018, Proteomics.

[15]  Banghua Yang,et al.  Subject-based feature extraction by using fisher WPD-CSP in brain-computer interfaces , 2016, Comput. Methods Programs Biomed..

[16]  Yang Li,et al.  Epileptic Seizure Detection Based on Time-Frequency Images of EEG Signals Using Gaussian Mixture Model and Gray Level Co-Occurrence Matrix Features , 2018, Int. J. Neural Syst..

[17]  Xi En Cheng,et al.  An effective and robust method for tracking multiple fish in video image based on fish head detection , 2016, BMC Bioinformatics.

[18]  Chiew Tong Lau,et al.  A New Discriminative Common Spatial Pattern Method for Motor Imagery Brain–Computer Interfaces , 2009, IEEE Transactions on Biomedical Engineering.

[19]  Klaus D. McDonald-Maier,et al.  Seizure detection from EEG signals using Multivariate Empirical Mode Decomposition , 2017, Comput. Biol. Medicine.

[20]  Suparerk Janjarasjitt,et al.  Epileptic seizure classifications of single-channel scalp EEG data using wavelet-based features and SVM , 2017, Medical & Biological Engineering & Computing.

[21]  A. K. Das,et al.  A discriminative subject-specific spatio-spectral filter selection approach for EEG based motor-imagery task classification , 2016, Expert Syst. Appl..

[22]  Aimin Wang,et al.  A spatial-frequency-temporal optimized feature sparse representation-based classification method for motor imagery EEG pattern recognition , 2017, Medical & Biological Engineering & Computing.

[23]  Xiaomu Song,et al.  Improving brain-computer interface classification using adaptive common spatial patterns , 2015, Comput. Biol. Medicine.

[24]  Xuesong Lu,et al.  Robust common spatial patterns with sparsity , 2016, Biomed. Signal Process. Control..

[25]  Girijesh Prasad,et al.  EWMA model based shift-detection methods for detecting covariate shifts in non-stationary environments , 2015, Pattern Recognit..

[26]  Jun Zhang,et al.  Dynamic frequency feature selection based approach for classification of motor imageries , 2016, Comput. Biol. Medicine.

[27]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[29]  Siliveru Ramesh,et al.  Brain Computer Interface System for Mind Controlled Robot using Bluetooth , 2014 .

[30]  Rupert Ortner,et al.  A Motor Imagery Based Brain-Computer Interface for Stroke Rehabilitation , 2012, Annual Review of Cybertherapy and Telemedicine.

[31]  Qingguo Wei,et al.  Binary particle swarm optimization for frequency band selection in motor imagery based brain-computer interfaces. , 2015, Bio-medical materials and engineering.

[32]  Moritz Grosse-Wentrup,et al.  Multiclass Common Spatial Patterns and Information Theoretic Feature Extraction , 2008, IEEE Transactions on Biomedical Engineering.

[33]  Aamir Saeed Malik,et al.  A machine learning framework involving EEG-based functional connectivity to diagnose major depressive disorder (MDD) , 2018, Medical & Biological Engineering & Computing.

[34]  Urbano Nunes,et al.  Assisted navigation for a brain-actuated intelligent wheelchair , 2013, Robotics Auton. Syst..

[35]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[36]  Sung Chan Jun,et al.  EEG datasets for motor imagery brain–computer interface , 2017, GigaScience.

[37]  Norliza Zaini,et al.  Classification of Eeg Signals Based on Different Motor Movement Using Multi-layer Perceptron Artificial Neural Network , 2016 .

[38]  Ting Li,et al.  Development of a Novel Motor Imagery Control Technique and Application in a Gaming Environment , 2017, Comput. Intell. Neurosci..

[39]  Xingyu Wang,et al.  Optimizing spatial patterns with sparse filter bands for motor-imagery based brain–computer interface , 2015, Journal of Neuroscience Methods.

[40]  Satoru Miyano,et al.  A filter based feature selection algorithm using null space of covariance matrix for DNA microarray gene expression data , 2012 .

[41]  Wael A. Mohamed,et al.  EEG Signal Classification Using Neural Network and Support Vector Machine in Brain Computer Interface , 2016, AISI.

[42]  Ming-Ai Li,et al.  A novel EEG feature extraction method based on OEMD and CSP algorithm , 2016, J. Intell. Fuzzy Syst..

[43]  Xingyu Wang,et al.  Sparse Bayesian Learning for Obtaining Sparsity of EEG Frequency Bands Based Feature Vectors in Motor Imagery Classification , 2017, Int. J. Neural Syst..

[44]  Alok Sharma,et al.  An improved discriminative filter bank selection approach for motor imagery EEG signal classification using mutual information , 2017, BMC Bioinformatics.

[45]  Ronesh Sharma,et al.  OPAL: prediction of MoRF regions in intrinsically disordered protein sequences , 2018, Bioinform..

[46]  Jae Gwan Kim,et al.  Utilization of a combined EEG/NIRS system to predict driver drowsiness , 2017, Scientific Reports.

[47]  Haiping Lu,et al.  Regularized Common Spatial Pattern With Aggregation for EEG Classification in Small-Sample Setting , 2010, IEEE Transactions on Biomedical Engineering.

[48]  R. Ramírez-Mendoza,et al.  Motor imagery based brain–computer interfaces: An emerging technology to rehabilitate motor deficits , 2015, Neuropsychologia.

[49]  Hui Wang,et al.  A multi-class EEG-based BCI classification using multivariate empirical mode decomposition based filtering and Riemannian geometry , 2018, Expert Syst. Appl..

[50]  Chao Chen,et al.  Classification of multi-class motor imagery with a novel hierarchical SVM algorithm for brain–computer interfaces , 2017, Medical & Biological Engineering & Computing.

[51]  Xingyu Wang,et al.  Sparse Bayesian Classification of EEG for Brain–Computer Interface , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[52]  SharmaAlok,et al.  A Top-r Feature Selection Algorithm for Microarray Gene Expression Data , 2012 .

[53]  L. Cohen,et al.  Brain–machine interface in chronic stroke rehabilitation: A controlled study , 2013, Annals of neurology.

[54]  Cuntai Guan,et al.  A Randomized Controlled Trial of EEG-Based Motor Imagery Brain-Computer Interface Robotic Rehabilitation for Stroke , 2015, Clinical EEG and neuroscience.

[55]  Kuldip K. Paliwal,et al.  A deterministic approach to regularized linear discriminant analysis , 2015, Neurocomputing.

[56]  Tamer Olmez,et al.  A Neural Network-Based Optimal Spatial Filter Design Method for Motor Imagery Classification , 2015, PloS one.

[57]  Satoru Miyano,et al.  Null space based feature selection method for gene expression data , 2012, Int. J. Mach. Learn. Cybern..

[58]  Abdollah Dehzangi,et al.  Protein Fold Recognition Using Genetic Algorithm Optimized Voting Scheme and Profile Bigram , 2016, J. Softw..

[59]  Shugang Li,et al.  Research on Gas Concentration Prediction Models Based on LSTM Multidimensional Time Series , 2019, Energies.

[60]  Kuldip K. Paliwal,et al.  A two-stage linear discriminant analysis for face-recognition , 2012, Pattern Recognit. Lett..

[61]  Toshihisa Tanaka,et al.  Common Spatio-Time-Frequency Patterns for Motor Imagery-Based Brain Machine Interfaces , 2013, Comput. Intell. Neurosci..

[62]  Kuldip K. Paliwal,et al.  Rotational Linear Discriminant Analysis Technique for Dimensionality Reduction , 2008, IEEE Transactions on Knowledge and Data Engineering.

[63]  Jie Li,et al.  A hybrid brain computer interface system based on the neurophysiological protocol and brain-actuated switch for wheelchair control , 2014, Journal of Neuroscience Methods.