A Novel MI-EEG Imaging With the Location Information of Electrodes

Combination of the Motor Imagery EEG (MI-EEG) imaging and Deep Convolutional Neural Network is a prospective recognition method in brain computer interface. Nowadays, the frequency or time-frequency analysis has been applied to each channel of MI-EEG signal to obtain a spatio-frequency or time-frequency image, and even the images from several channels are infused to generate a combined image. However, the real position information of channels or electrodes is lost in these MI-EEG images, and this is contradictory to the activation area of MI-tasks. In this paper, the MI period and the frequency band covered by $\mu $ and $\beta $ rhythms are divided into ten time windows and three sub-bands, respectively. Then, for each electrode, Fast Fourier Transform (FFT) is employed to transform each time window to spectrum, and its inverse FFT is calculated for each sub-band. The time-domain powers of ten time windows are averaged for the same sub-band. So, three average powers are generated as the time-frequency features of each electrode of MI-EEG. They are further arranged to the electrode coordinate figure by using Clough-Tocher interpolation algorithm, and a complicated image, in which the time-frequency features are correctly located at the real position of each electrode, is obtained to embody the MI-EEG in detail. Furthermore, a VGG network is modified to perform effective recognition for MI-EEG image, and it is called mVGG. Extensive experiments are conducted on three publicly available datasets, and the 10-folds cross validation accuracies of 88.62%, 92.28% and 96.86% are achieved respectively, and they are higher than that of the state-of-the-art imaging methods. Kappa values and ROC curves demonstrate our method has lower class skew and error costs. The experimental results show that the effectiveness of proposed MI-EEG imaging method, and it is well-matched with mVGG.

[1]  Xiong Zhang,et al.  Portable brain-computer interface based on novel convolutional neural network , 2019, Comput. Biol. Medicine.

[2]  Bin He,et al.  EEG Control of a Virtual Helicopter in 3-Dimensional Space Using Intelligent Control Strategies , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Lina Yao,et al.  Converting Your Thoughts to Texts: Enabling Brain Typing via Deep Feature Learning of EEG Signals , 2017, 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[4]  R. V. D. Van der Lubbe,et al.  Lateralized power spectra of the EEG as an index of visuospatial attention , 2013, Advances in cognitive psychology.

[5]  Lei Cao,et al.  Short time Fourier transformation and deep neural networks for motor imagery brain computer interface recognition , 2018, Concurr. Comput. Pract. Exp..

[6]  J. Polich,et al.  Meditation states and traits: EEG, ERP, and neuroimaging studies. , 2006, Psychological bulletin.

[7]  Gordon Cheng,et al.  Validating Deep Neural Networks for Online Decoding of Motor Imagery Movements from EEG Signals , 2018, Sensors.

[8]  Shuicheng Yan,et al.  Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Liqing Zhang,et al.  Feature learning from incomplete EEG with denoising autoencoder , 2014, Neurocomputing.

[11]  Cuntai Guan,et al.  On the use of convolutional neural networks and augmented CSP features for multi-class motor imagery of EEG signals classification , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Chung-Hsien Kuo,et al.  P300 and Motor Imagery Based Brain-Computer Interface for Controlling Wheelchairs , 2014 .

[13]  Amit Konar,et al.  Motor imagery, P300 and error-related EEG-based robot arm movement control for rehabilitation purpose , 2014, Medical & Biological Engineering & Computing.

[14]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[15]  Xiaoyu Wang,et al.  Architecture optimization, training convergence and network estimation robustness of a fully connected recurrent neural network , 2010 .

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Peter Alfeld,et al.  A trivariate clough-tocher scheme for tetrahedral data , 1984, Comput. Aided Geom. Des..

[18]  Aiguo Song,et al.  Wavelet Transform Time-Frequency Image and Convolutional Network-Based Motor Imagery EEG Classification , 2019, IEEE Access.

[19]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[20]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[21]  Vacius Jusas,et al.  Application of Convolutional Neural Networks to Four-Class Motor Imagery Classification Problem , 2017, Inf. Technol. Control..

[22]  Dezhong Yao,et al.  Separated channel convolutional neural network to realize the training free motor imagery BCI systems , 2019, Biomed. Signal Process. Control..

[23]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[24]  Philip Smith,et al.  Transfer Learning with Deep CNNs for Gender Recognition and Age Estimation , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[25]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[26]  Qinghe Zheng,et al.  Improvement of Generalization Ability of Deep CNN via Implicit Regularization in Two-Stage Training Process , 2018, IEEE Access.

[27]  Shuai Wang,et al.  EEG Classification of Motor Imagery Using a Novel Deep Learning Framework , 2019, Sensors.

[28]  Abdulkadir Sengur,et al.  Convolutional Neural Network Based Approach Towards Motor Imagery Tasks EEG Signals Classification , 2019, IEEE Sensors Journal.

[29]  Sadasivan Puthusserypady,et al.  An end-to-end deep learning approach to MI-EEG signal classification for BCIs , 2018, Expert Syst. Appl..

[30]  M. Shamim Hossain,et al.  Multilevel Weighted Feature Fusion Using Convolutional Neural Networks for EEG Motor Imagery Classification , 2019, IEEE Access.

[31]  Shuicheng Yan,et al.  Parallel convolutional-linear neural network for motor imagery classification , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).