Walking Imagery Evaluation Based on Multi-view Features and Stacked Denoising Auto-encoder Network

Brain-computer interfaces (BCIs) based on motor imagery (MI) have played an important role and obtained impressive achievement in exercise rehabilitation. However, most of the previous researches focused on the upper limb, while many disabled patients need the same technology to assist their rehabilitation training. It is more difficult to detect lower limb MI than upper limb because of the deeper and smaller corresponding sensorimotor cortex. To solve this problem, a new paradigm is proposed to perform waking imagery (WI) for subjects in a virtual environment (VE) to further enhance their brain activities. Furthermore, to decode WI efficiently when facing the low reliable and limited data, we propose a stacked denoising auto-encoder (SDAE) network, which is trained on multi-view feature obtained from VE. First, the spatial and frequency based features are extracted and fused from the raw data. Second, we use SDAE network to extract the hidden features from the above features. Third, we fuse the previous features and hidden features to train the Softmax classifier. Experimental results on our self-collected data demonstrate that, SDAE network outperforms other deep learning methods in classifying WI in VE.

[1]  Rupert Ortner,et al.  How many people can control a motor imagery based BCI using common spatial patterns? , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[2]  Duoqian Miao,et al.  Best basis-based wavelet packet entropy feature extraction and hierarchical EEG classification for epileptic detection , 2011, Expert Syst. Appl..

[3]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[4]  Bin He,et al.  EEG Source Imaging Enhances the Decoding of Complex Right-Hand Motor Imagery Tasks , 2016, IEEE Transactions on Biomedical Engineering.

[5]  Kup-Sze Choi,et al.  Walking Imagery Evaluation in Brain Computer Interfaces via a Multi-View Multi-Level Deep Polynomial Network , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Jason Farquhar,et al.  Using Actual and Imagined Walking Related Desynchronization Features in a BCI , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[8]  Toshiyuki Kondo,et al.  Effect of instructive visual stimuli on neurofeedback training for motor imagery-based brain-computer interface. , 2015, Human movement science.

[9]  Mohammed J. Alhaddad,et al.  Common Average Reference (CAR) Improves P300 Speller , 2012 .

[10]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[11]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[12]  Banghua Yang,et al.  Subject-based feature extraction by using fisher WPD-CSP in brain-computer interfaces , 2016, Comput. Methods Programs Biomed..

[13]  Zoran Nenadic,et al.  Brain-computer interface controlled robotic gait orthosis , 2012, Journal of NeuroEngineering and Rehabilitation.

[14]  Monica A. Gorassini,et al.  Effects of transcranial direct current stimulation on the excitability of the leg motor cortex , 2007, Experimental Brain Research.

[15]  Tele Tan,et al.  3D visualization of movements can amplify motor cortex activation during subsequent motor imagery , 2015, Front. Hum. Neurosci..

[16]  Jaime Fernando Delgado Saa,et al.  EEG Signal Classification Using Power Spectral Features and linear Discriminant Analysis: A Brain Computer Interface Application , 2010 .