The novel recognition method with Optimal Wavelet Packet and LSTM based Recurrent Neural Network

In order to adaptively extract the subject-based time-frequency features of motor imagery EEG (MI-EEG) and make full use of the sequential information hidden in MI-EEG features, a Long Short-Term Memory (LSTM) based Recurrent Neural Network (RNN) is integrated with Optimal Wavelet Packet Transform (OWPT) to yield a novel recognition method, denoted as OWLR. Firstly, OWPT is applied to each channel of MI-EEG, and the improved distance criterion is used to find the optimal wavelet packet subspaces, whose coefficients are further selected as the time-frequency features of MI-EEG. Finally, a LSTM based RNN is used for classifying MI-EEG features. Experiments are conducted on a publicly available dataset, and the 5-fold cross validation experimental results show that OWLR yields relatively higher classification accuracies compared to the existing approaches. This is helpful for the future research and application of RNN in processing of MI-EEG.

[1]  Jun Li,et al.  Study on EEG Password based on AR Power Spectrum and BP network , 2012 .

[2]  S. Aglioti,et al.  Selective impairment of hand mental rotation in patients with focal hand dystonia. , 2005, Brain : a journal of neurology.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  G. Pfurtscheller,et al.  Using adaptive autoregressive parameters for a brain-computer-interface experiment , 1997, Proceedings of the 19th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. 'Magnificent Milestones and Emerging Opportunities in Medical Engineering' (Cat. No.97CH36136).

[5]  Fei-Fei Li,et al.  Deep visual-semantic alignments for generating image descriptions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[7]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[8]  Aiguo Song,et al.  Algorithm of Imagined Left-Right Hand Movement Classification Based on Wavelet Transform and AR Parameter Model , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[9]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[10]  Abdulhamit Subasi,et al.  EEG signal classification using PCA, ICA, LDA and support vector machines , 2010, Expert Syst. Appl..

[11]  Murat Cenk Cavusoglu,et al.  Assessment of EEG event-related desynchronization in stroke survivors performing shoulder-elbow movements , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  Leslie G. Ungerleider,et al.  Imaging Brain Plasticity during Motor Skill Learning , 2002, Neurobiology of Learning and Memory.

[13]  Ming-Ai Li,et al.  Applying a Locally Linear Embedding Algorithm for Feature Extraction and Visualization of MI-EEG , 2016, J. Sensors.

[14]  Donald C. Wunsch,et al.  Recurrent neural network based prediction of epileptic seizures in intra- and extracranial EEG , 2000, Neurocomputing.

[15]  Christos Faloutsos,et al.  Coercively Adjusted Auto Regression Model for Forecasting in Epilepsy EEG , 2013, Comput. Math. Methods Medicine.

[16]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  Alexandre Balbinot,et al.  Executed Movement Using EEG Signals through a Naive Bayes Classifier , 2014, Micromachines.

[18]  Jing Hai Yin,et al.  EEG Feature Extraction Based on Wavelet Decomposition , 2014 .