Classification of Motor Imagery EEG Signals with Deep Learning Models

Motor imagery (MI) is a mental process of a motor action including preparation for movement, passive observations of action and mental operations of motor representations. Brain computer interfaces can discriminate different status of individuals according to their EEG signals during imagery tasks. Power spectral density and common spatial patterns are both feature extraction methods that are commonly used to in the classification tasks of EEG series. In this paper, we combine recurrent neural networks and convolutional neural networks inspired by speech recognition and natural language processing. Furthermore, we apply deep models consist of stacking random forests to enhance the ability of feature representation and classification abilities for motor imagery EEG signals. Compared with traditional feature extraction methods, our approaches achieve significant improvements both in the MI-EEG dataset of BCI competitions with healthy individuals and the dataset collected from stroke patients.

[1]  Darren J. Leamy,et al.  An exploration of EEG features during recovery following stroke – implications for BCI-mediated neurorehabilitation therapy , 2014, Journal of NeuroEngineering and Rehabilitation.

[2]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[3]  Jdel.R. Millan,et al.  On the need for on-line learning in brain-computer interfaces , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[4]  Andrzej Cichocki,et al.  Tensor Decompositions for Signal Processing Applications: From two-way to multiway component analysis , 2014, IEEE Signal Processing Magazine.

[5]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[6]  Liqing Zhang,et al.  Slice Oriented Tensor Decomposition of EEG Data for Feature Extraction in Space, Frequency and Time Domains , 2009, ICONIP.

[7]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[8]  Jun Zhao,et al.  Recurrent Convolutional Neural Networks for Text Classification , 2015, AAAI.

[9]  Ji Feng,et al.  Deep Forest: Towards An Alternative to Deep Neural Networks , 2017, IJCAI.

[10]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[11]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[12]  Yijun Wang,et al.  Common Spatial Pattern Method for Channel Selelction in Motor Imagery Based Brain-computer Interface , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[13]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[14]  Monica Fira,et al.  Classifications of Motor Imagery Tasks in Brain Computer Interface Using Linear Discriminant Analysis , 2014 .