A Channel Selection Approach Based on Convolutional Neural Network for Multi-channel EEG Motor Imagery Decoding

For many disabled people, brain computer interface (BCI) may be the only way to communicate with others and to control things around them. Using motor imagery paradigm, one can decode an individual's intention by using their brainwaves to help them interact with their environment without having to make any physical movement. For decades, machine learning models, trained on features extracted from acquired electroencephalogram (EEG) signals have been used to decode motor imagery activities. This method has several limitations and constraints especially during feature extraction. Large number of channels on the current EEG devices make them hard to use in real-life as they are bulky, uncomfortable to wear, and takes lot of time in preparation. In this paper, we introduce a technique to perform channel selection using convolutional neural network (CNN) and to decode multiple classes of motor imagery intentions from four participants who are amputees. A CNN model trained on EEG data of 64 channels achieved a mean classification accuracy of 99.7% with five classes. Channel selection based on weights extracted from the trained model has been performed with subsequent models trained on eight selected channels achieved a reasonable accuracy of 91.5%. Training the model in time domain and frequency domain was also compared, different window sizes were experimented to test the possibilities of realtime application. Our method of channel selection was then evaluated on a publicly available motor imagery EEG dataset.

[1]  Guangyi Chen,et al.  Automatic EEG seizure detection using dual-tree complex wavelet-Fourier features , 2014, Expert Syst. Appl..

[2]  D. Akinwande,et al.  Thinnest transparent epidermal sensor system based on graphene , 2016, 2016 IEEE International Electron Devices Meeting (IEDM).

[3]  Yu Zhang,et al.  Optimal-channel Selection Algorithms in Mental Tasks based Brain-computer Interface , 2018, ICBBB 2018.

[4]  Marco Marchesi,et al.  From Mobie to Neu: 3D animated contents controlled by a brain-computer interface , 2012, VRIC.

[5]  A Kostov,et al.  Parallel man-machine training in development of EEG-based cursor control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Yufei Huang,et al.  EEG-based biometric identification with deep learning , 2017, 2017 8th International IEEE/EMBS Conference on Neural Engineering (NER).

[7]  Fei Wang,et al.  BCI control system for humanoid robot based on motor imaginary , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[8]  Oluwarotimi Williams Samuel,et al.  A Hybrid Non-invasive Method for the Classification of Amputee’s Hand and Wrist Movements , 2015 .

[9]  M Unser,et al.  Fast wavelet transformation of EEG. , 1994, Electroencephalography and clinical neurophysiology.

[10]  Oluwarotimi Williams Samuel,et al.  A motion-classification strategy based on sEMG-EEG signal combination for upper-limb amputees , 2017, Journal of NeuroEngineering and Rehabilitation.

[11]  Jongin Kim,et al.  Motor imagery EEG classification with optimal subset of wavelet based common spatial pattern and kernel extreme learning machine , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[12]  Franck Tarpin-Bernard,et al.  Conceptual Priming for In-game BCI Training , 2015, TCHI.

[13]  Zhi-Hong Mao,et al.  Brain-computer interface combining eye saccade two-electrode EEG signals and voice cues to improve the maneuverability of wheelchair , 2017, 2017 International Conference on Rehabilitation Robotics (ICORR).

[14]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[15]  Oluwarotimi Williams Samuel,et al.  Towards Efficient Decoding of Multiple Classes of Motor Imagery Limb Movements Based on EEG Spectral and Time Domain Descriptors , 2017, Journal of Medical Systems.

[16]  Francesco Carlo Morabito,et al.  Deep convolutional neural networks for classification of mild cognitive impaired and Alzheimer's disease patients from scalp EEG recordings , 2016, 2016 IEEE 2nd International Forum on Research and Technologies for Society and Industry Leveraging a better tomorrow (RTSI).

[17]  Lina Yao,et al.  Converting Your Thoughts to Texts: Enabling Brain Typing via Deep Feature Learning of EEG Signals , 2017, 2018 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[18]  Dario Pompili,et al.  Optimized Deep Learning for EEG Big Data and Seizure Prediction BCI via Internet of Things , 2017, IEEE Transactions on Big Data.

[19]  Oluwarotimi Williams Samuel,et al.  Motor imagery classification of upper limb movements based on spectral domain features of EEG patterns , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Zhang Weidong,et al.  Deep learning EEG response representation for brain computer interface , 2015, 2015 34th Chinese Control Conference (CCC).

[21]  H. Johansen-Berg,et al.  Motor correlates of phantom limb pain , 2017, Cortex.

[22]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[23]  Ayman Atia,et al.  Brain computer interfacing: Applications and challenges , 2015 .

[24]  Joelle Pineau,et al.  Learning Robust Features using Deep Learning for Automatic Seizure Detection , 2016, MLHC.

[25]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[26]  Francisco Sepulveda,et al.  Classifying mental tasks based on features of higher-order statistics from EEG signals in brain-computer interface , 2008, Inf. Sci..

[27]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jelena Mladenovic,et al.  When HCI Meets Neurotechnologies: What You Should Know about Brain-Computer Interfaces , 2017, CHI Extended Abstracts.