A Novel Deep Learning Approach With Data Augmentation to Classify Motor Imagery Signals

Brain–computer interface provides a new communication bridge between the human mind and devices, depending largely on the accurate classification and identification of non-invasive EEG signals. Recently, the deep learning approaches have been widely used in many fields to extract features and classify various types of data successfully. However, the deep learning approach requires massive data to train its neural networks, and the amount of data impacts greatly on the quality of the classifiers. This paper proposes a novel approach that combines deep learning and data augmentation for EEG classification. We applied the empirical mode decomposition on the EEG frames and mixed their intrinsic mode functions to create new artificial EEG frames, followed by transforming all EEG data into tensors as inputs of the neural network by complex Morlet wavelets. We proposed two neural networks—convolutional neural network and wavelet neural network—to train the weights and classify two classes of motor imagery signals. The wavelet neural network is a new type of neural network using wavelets to replace the convolutional layers. The experimental results show that the artificial EEG frames substantially improve the training of neural networks, and both two networks yield relatively higher classification accuracies compared to prevailing approaches. Meanwhile, we also verified the performance of our new proposed wavelet neural network model in the classification of steady-state visual evoked potentials.

[1]  Pedro J. García-Laencina,et al.  Exploring dimensionality reduction of EEG features in motor imagery task classification , 2014, Expert Syst. Appl..

[2]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[3]  Howard Jay Chizeck,et al.  Some Properties of an Empirical Mode Type Signal Decomposition Algorithm , 2010, IEEE Signal Process. Lett..

[4]  Subhojit Ghosh,et al.  Jaya Based ANFIS for Monitoring of Two Class Motor Imagery Task , 2016, IEEE Access.

[5]  S. Francis,et al.  Within-Digit Functional Parcellation of Brodmann Areas of the Human Primary Somatosensory Cortex Using Functional Magnetic Resonance Imaging at 7 Tesla , 2012, The Journal of Neuroscience.

[6]  S. Small,et al.  Fine modulation in network activation during motor execution and motor imagery. , 2004, Cerebral cortex.

[7]  Kim Dremstrup,et al.  EMD-Based Temporal and Spectral Features for the Classification of EEG Signals Using Supervised Learning , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Fabien Lotte Generating Artificial EEG Signals To Reduce BCI Calibration Time , 2011 .

[9]  Rupert Ortner,et al.  A New Method to Generate Artificial Frames Using the Empirical Mode Decomposition for an EEG-Based Motor Imagery BCI , 2018, Front. Neurosci..

[10]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[11]  A. Cichocki,et al.  Tensor decompositions for feature extraction and classification of high dimensional datasets , 2010 .

[12]  Jie Li,et al.  Design of assistive Wheelchair System directly Steered by Human Thoughts , 2013, Int. J. Neural Syst..

[13]  Anindya Bijoy Das,et al.  Classification of EEG signals using normal inverse Gaussian parameters in the dual-tree complex wavelet transform domain for seizure detection , 2016, Signal Image Video Process..

[14]  Ricardo Ron-Angevin,et al.  Concentration on performance with P300-based BCI systems: a matter of interface features. , 2016, Applied ergonomics.

[15]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[16]  Minkyu Ahn,et al.  Journal of Neuroscience Methods , 2015 .

[17]  Hongzhi Qi,et al.  EEG feature comparison and classification of simple and compound limb motor imagery , 2013, Journal of NeuroEngineering and Rehabilitation.

[18]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[19]  K. Amunts,et al.  Architectonic Mapping of the Human Brain beyond Brodmann , 2015, Neuron.

[20]  Steven Lemm,et al.  BCI competition 2003-data set III: probabilistic modeling of sensorimotor /spl mu/ rhythms for classification of imaginary hand movements , 2004, IEEE Transactions on Biomedical Engineering.

[21]  Lianghua He,et al.  A Deep Learning Method for Classification of EEG Data Based on Motor Imagery , 2014, ICIC.

[22]  Yu Zhang,et al.  EEG classification using sparse Bayesian extreme learning machine for brain–computer interface , 2018, Neural Computing and Applications.

[23]  Xiaopei Wu,et al.  Dynamic Analysis of Motor Imagery EEG Using Kurtosis Based Independent Component Analysis , 2008 .

[24]  Thomas E. Nichols,et al.  Thresholding of Statistical Maps in Functional Neuroimaging Using the False Discovery Rate , 2002, NeuroImage.

[25]  Chin-Teng Lin,et al.  Using a Novel LDA-Ensemble Framework to Classification of Motor Imagery Tasks for Brain-Computer Interface Applications , 2014, ICS.

[26]  MengChu Zhou,et al.  Common Bayesian Network for Classification of EEG-Based Multiclass Motor Imagery BCI , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[28]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[29]  Po-Lei Lee,et al.  Total Design of an FPGA-Based Brain–Computer Interface Control Hospital Bed Nursing System , 2013, IEEE Transactions on Industrial Electronics.

[30]  Gert Pfurtscheller,et al.  Characterization of four-class motor imagery EEG data for the BCI-competition 2005 , 2005, Journal of neural engineering.

[31]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[32]  Na Lu,et al.  A Deep Learning Scheme for Motor Imagery Classification based on Restricted Boltzmann Machines , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[33]  George Atia,et al.  A New Statistical Model of Electroencephalogram Noise Spectra for Real-Time Brain–Computer Interfaces , 2016, IEEE Transactions on Biomedical Engineering.

[34]  Rupert Lanzenberger,et al.  The suppressive influence of SMA on M1 in motor imagery revealed by fMRI and dynamic causal modeling , 2008, NeuroImage.

[35]  Chris Beck,et al.  An integrated neuro-robotic interface for stroke rehabilitation using the NASA X1 powered lower limb exoskeleton , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[37]  Yu Zhang,et al.  Sparse Group Representation Model for Motor Imagery EEG Classification , 2019, IEEE Journal of Biomedical and Health Informatics.

[38]  Jie Li,et al.  Evaluation and Application of a Hybrid Brain Computer Interface for Real Wheelchair Parallel Control with Multi-Degree of Freedom , 2014, Int. J. Neural Syst..

[39]  Sung Chan Jun,et al.  EEG datasets for motor imagery brain–computer interface , 2017, GigaScience.

[40]  T. Martin McGinnity,et al.  EEG-Based Mobile Robot Control Through an Adaptive Brain–Robot Interface , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[41]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[42]  Maysam F. Abbod,et al.  Application of Multivariate Empirical Mode Decomposition and Sample Entropy in EEG Signals via Artificial Neural Networks for Interpreting Depth of Anesthesia , 2013, Entropy.

[43]  Javier Gomez-Pilar,et al.  Adaptive semi-supervised classification to reduce intersession non-stationarity in multiclass motor imagery-based brain-computer interfaces , 2015, Neurocomputing.