CWT Based Transfer Learning for Motor Imagery Classification for Brain computer Interfaces

BACKGROUND The processing of brain signals for Motor imagery (MI) classification to have better accuracy is a key issue in the Brain-Computer Interface (BCI). While conventional methods like Artificial neural network (ANN), Linear discernment analysis (LDA), K-Nearest Neighbor (KNN), Support vector machine (SVM), etc. have made significant progress in terms of classification accuracy, deep transfer learning-based systems have shown the potential to outperform them. BCI can play a vital role in enabling communication with the external world for persons with motor disabilities. NEW METHODS Deep learning has been a success in many fields. However, for Electroencephalogram (EEG) signals, relatively minimal work has been carried out using deep learning. This paper proposes a combination of Continuous Wavelet Transform (CWT) along with deep learning-based transfer learning to solve the problem. CWT transforms one dimensional EEG signals into two-dimensional time-frequency-amplitude representation enabling us to exploit available deep networks through transfer learning. RESULTS The effectiveness of the proposed approach is evaluated in this study using an openly available BCI competition data-set. The results of the approach have been compared to earlier works on the same dataset, and a promising validation accuracy of 97.06% is achieved in our investigation. COMPARISON WITH EXISTING METHODS AND CONCLUSION Our approach has shown significant improvement over other studies, which is 5.71% improvement over earlier reported algorithm (Tabar and Halici, 2017) using the same dataset. Results show the validity of the proposed Deep Transfer-Learning based technique as a state of the art technique for MI classification in BCI.

[1]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[2]  Sadasivan Puthusserypady,et al.  An Improved Five Class MI Based BCI Scheme for Drone Control Using Filter Bank CSP , 2019, 2019 7th International Winter Conference on Brain-Computer Interface (BCI).

[3]  Abdulhamit Subasi,et al.  EEG signal classification using wavelet feature extraction and a mixture of expert model , 2007, Expert Syst. Appl..

[4]  Hüseyin Göksu,et al.  BCI oriented EEG analysis using log energy entropy of wavelet packets , 2018, Biomed. Signal Process. Control..

[5]  Germain Forestier,et al.  Deep learning for time series classification: a review , 2018, Data Mining and Knowledge Discovery.

[6]  Michael Wainberg,et al.  Deep learning in biomedicine , 2018, Nature Biotechnology.

[7]  Nader Jafarnia Dabanloo,et al.  A GA-based feature selection of the EEG signals by classification evaluation: Application in BCI systems , 2019, ArXiv.

[8]  Seungjin Choi,et al.  Bayesian common spatial patterns for multi-subject EEG classification , 2014, Neural Networks.

[9]  Sam Kwong,et al.  G-MS2F: GoogLeNet based multi-stage feature fusion of deep CNN for scene recognition , 2017, Neurocomputing.

[10]  Hamid Mirvaziri,et al.  Improvement of EEG-based motor imagery classification using ring topology-based particle swarm optimization , 2017, Biomed. Signal Process. Control..

[11]  Steven Lemm,et al.  BCI competition 2003-data set III: probabilistic modeling of sensorimotor /spl mu/ rhythms for classification of imaginary hand movements , 2004, IEEE Transactions on Biomedical Engineering.

[12]  Nikola Kasabov,et al.  Deep learning and deep knowledge representation in Spiking Neural Networks for Brain-Computer Interfaces , 2020, Neural Networks.

[13]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[14]  Bao-Liang Lu,et al.  Personalizing EEG-Based Affective Models with Transfer Learning , 2016, IJCAI.

[15]  Minho Lee,et al.  Advances in Cognitive Engineering Using Neural Networks , 2017, Neural Networks.

[16]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[17]  Young-Seok Choi,et al.  A convolution neural networks scheme for classification of motor imagery EEG based on wavelet time-frequecy image , 2018, 2018 International Conference on Information Networking (ICOIN).

[18]  M. Kemal Kiymik,et al.  Comparison of STFT and wavelet transform methods in determining epileptic seizure activity in EEG signals for real-time application , 2005, Comput. Biol. Medicine.

[19]  Xingyu Wang,et al.  Optimizing spatial patterns with sparse filter bands for motor-imagery based brain–computer interface , 2015, Journal of Neuroscience Methods.

[20]  Yaacob Sazali,et al.  Classification of human emotion from EEG using discrete wavelet transform , 2010 .

[21]  Mohamed El-Sharkawy,et al.  Pruning convolution neural network (squeezenet) using taylor expansion-based criterion , 2018, 2018 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[22]  Francisco Sepulveda,et al.  Classifying mental tasks based on features of higher-order statistics from EEG signals in brain-computer interface , 2008, Inf. Sci..

[23]  Kenneth Revett,et al.  EEG Signal Classification Using Wavelet Feature Extraction and Neural Networks , 2006, IEEE John Vincent Atanasoff 2006 International Symposium on Modern Computing (JVA'06).

[24]  Abdulkadir Sengur,et al.  Convolutional Neural Network Based Approach Towards Motor Imagery Tasks EEG Signals Classification , 2019, IEEE Sensors Journal.

[25]  Wei-Yen Hsu,et al.  EEG-based motor imagery analysis using weighted wavelet transform features , 2009, Journal of Neuroscience Methods.

[26]  T. Jung,et al.  Improving EEG-Based Emotion Classification Using Conditional Transfer Learning , 2017, Front. Hum. Neurosci..

[27]  Wang Hong,et al.  CSP/SVM-Based EEG Classification of Imagined Hand Movements , 2010 .

[28]  Taghi M. Khoshgoftaar,et al.  A survey of transfer learning , 2016, Journal of Big Data.

[29]  Byeong Man Kim,et al.  Motor-imagery EEG signal classification using position matching and vector quantisation , 2016 .

[30]  Fengzhen Tang,et al.  Learning joint space-time-frequency features for EEG decoding on small labeled data , 2019, Neural Networks.

[31]  Xiang Li,et al.  Adaptive power projection method for accumulative EEG classification , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Jupitara Hazarika,et al.  Wavelet transform based approach for EEG feature selection of motor imagery data for braincomputer interfaces , 2019, 2019 Third International Conference on Inventive Systems and Control (ICISC).

[33]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[34]  Danilo P. Mandic,et al.  Motor Imagery Classification Using Mu and Beta Rhythms of EEG with Strong Uncorrelating Transform Based Complex Common Spatial Patterns , 2016, Comput. Intell. Neurosci..

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  G. Pfurtscheller,et al.  Event-related desynchronization (ERD) and the Dm effect: does alpha desynchronization during encoding predict later recall performance? , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[37]  Yuan-Pin Lin,et al.  Deep Transfer Learning for Cross-subject and Cross-experiment Prediction of Image Rapid Serial Visual Presentation Events from EEG Data , 2017, HCI.

[38]  Reinhold Scherer,et al.  Motor Imagery based Brain-Computer Interfaces , 2018 .

[39]  Saeid Sanei,et al.  Deep learning for epileptic intracranial EEG data , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[40]  S Soundarya,et al.  A Survey Based on Human Emotion Identification Using Machine Learning and Deep Learning , 2018 .

[41]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[42]  J. Wolpaw,et al.  Mu and Beta Rhythm Topographies During Motor Imagery and Actual Movements , 2004, Brain Topography.

[43]  Amit Konar,et al.  Performance analysis of LDA, QDA and KNN algorithms in left-right limb movement classification from EEG data , 2010, 2010 International Conference on Systems in Medicine and Biology.

[44]  Klaus-Robert Müller,et al.  Interpretable deep neural networks for single-trial EEG classification , 2016, Journal of Neuroscience Methods.