A Motor-Imagery BCI System Based on Deep Learning Networks and Its Applications

Motor imagery brain-computer interface (BCI) by using of deep-learning models is proposed in this paper. In which, we used the electroencephalogram (EEG) signals of motor imagery (MI-EEG) to identify different imagery activities. The brain dynamics of motor imagery are usually measured by EEG as non-stationary time series of low signal-to-noise ratio. However, a variety of methods have been previously developed to classify MI-EEG signals getting not satisfactory results owing to lack of characteristics in time-frequency features. In this paper, discrete wavelet transform (DWT) was applied to transform MIEEG signals and extract their effective coefficients as the time-frequency features. Then two deep learning (DL) models named Long-short term memory (LSTM) and gated recurrent neural networks (GRNN) are used to classify MI-EEG data. LSTM is designed to fight against vanishing gradients. GRNN makes each recurrent unit to capture dependencies of different time scales adaptively. Similar scheme of the LSTM unit, GRNN has gating units that modulate the flow of information inside the unit, but without having a separate memory cells. Experimental results show that GRNN and LSTM yield higher classification accuracies compared to the existing approaches that is helpful for the further research and application of relative RNN in processing of MI-EEG.

[1]  Meng Zhang,et al.  Combined long short-term memory based network employing wavelet coefficients for MI-EEG recognition , 2016, 2016 IEEE International Conference on Mechatronics and Automation.

[2]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Rajdeep Chatterjee,et al.  EEG Based Motor Imagery Classification Using SVM and MLP , 2016, 2016 2nd International Conference on Computational Intelligence and Networks (CINE).

[5]  Debarshi Kumar Sanyal,et al.  Effects of wavelets on quality of features in motor-imagery EEG signal classification , 2016, 2016 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[6]  Anand Darji,et al.  Comparative analysis of classification techniques for motor imagery based BCI , 2015, 2015 IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (WCI).

[8]  Toshihisa Tanaka,et al.  Active Data Selection for Motor Imagery EEG Classification , 2015, IEEE Transactions on Biomedical Engineering.

[9]  Shang-Lin Wu,et al.  Fuzzy Integral With Particle Swarm Optimization for a Motor-Imagery-Based Brain–Computer Interface , 2017, IEEE Transactions on Fuzzy Systems.

[10]  Donald C. Wunsch,et al.  Recurrent neural network based prediction of epileptic seizures in intra- and extracranial EEG , 2000, Neurocomputing.

[11]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Bing Zhang,et al.  Applications of Recurrent Neural Network Language Model in Offline Handwriting Recognition and Word Spotting , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[13]  Aida Khorshidtalab,et al.  A Transform-Based Feature Extraction Approach for Motor Imagery Tasks Classification , 2015, IEEE Journal of Translational Engineering in Health and Medicine.

[14]  I. Daubechies Orthonormal bases of compactly supported wavelets , 1988 .

[15]  Seyyed Ali Seyyedsalehi,et al.  Nonlinear analysis of video images using deep recurrent auto-associative neural networks for facial understanding , 2017, 2017 3rd International Conference on Pattern Recognition and Image Analysis (IPRIA).

[16]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jürgen Schmidhuber,et al.  Recurrent nets that time and count , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[18]  Alex Graves,et al.  Supervised Sequence Labelling with Recurrent Neural Networks , 2012, Studies in Computational Intelligence.

[19]  Xiaofeng Xie,et al.  Motor Imagery Classification Based on Bilinear Sub-Manifold Learning of Symmetric Positive-Definite Matrices , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Klaus-Robert Müller,et al.  The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials , 2004, IEEE Transactions on Biomedical Engineering.

[21]  Linda B. Smith Dynamic Systems, Sensorimotor Processes, and the Origins of Stability and Flexibility , 2009 .

[22]  J. Decety,et al.  Brain structures participating in mental simulation of motor behavior: a neuropsychological interpretation. , 1990, Acta psychologica.

[23]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[24]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.