CNN-based Approaches For Cross-Subject Classification in Motor Imagery: From the State-of-The-Art to DynamicNet

The accurate detection of motor imagery (MI) from electroencephalography (EEG) is a fundamental, as well as challenging, task to provide reliable control of robotic devices to support people suffering from neuro-motor impairments, e.g., in brain-computer interface (BCI) applications. Recently, deep learning approaches have been able to extract subject-independent features from EEG, to cope with its poor SNR and high intra-subject and cross-subject variability. In this paper, we first present a review of the most recent studies using deep learning for MI classification, with particular attention to their cross-subject performance. Second, we propose DynamicNet, a Python-based tool for quick and flexible implementations of deep learning models based on convolutional neural networks. We showcase the potentiality of DynamicNet by implementing EEGNet, a well-established architecture for effective EEG classification. Finally, we compare its performance with the filter bank common spatial pattern (FBCSP) in a 4-class MI task (data from a public dataset). To infer cross-subject classification performance, we applied three different cross-validation schemes. From our results, we show that EEGNet implemented with DynamicNet outperforms FBCSP by about 25 %, with a statistically significant difference when cross-subject validation schemes are applied. We conclude that deep learning approaches might be particularly helpful to provide higher cross-subject classification performance in multiclass MI classification scenarios. In the future, it is expected to improve DynamicNet to implement new architectures to further investigate cross-subject classification of MI tasks in real-world scenarios.

[1]  Abdellah Adib,et al.  Incep-EEGNet: A ConvNet for Motor Imagery Decoding , 2020, ICISP.

[2]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[3]  Shuicheng Yan,et al.  Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[5]  M. Shamim Hossain,et al.  Applying Deep Learning for Epilepsy Seizure Detection and Brain Mapping Visualization , 2019, ACM Trans. Multim. Comput. Commun. Appl..

[6]  Giulia Cisotto,et al.  Deep learning-based classification of fine hand movements from low frequency EEG , 2020, ArXiv.

[7]  Naveed Muhammad,et al.  Fusion Convolutional Neural Network for Cross-Subject EEG Motor Imagery Classification , 2020, Comput..

[8]  Michael S. Lazar,et al.  Spatial patterns underlying population differences in the background EEG , 2005, Brain Topography.

[9]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[10]  Cuntai Guan,et al.  BCI for stroke rehabilitation: motor and beyond , 2020, Journal of neural engineering.

[11]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[12]  Sadasivan Puthusserypady,et al.  An Improved Five Class MI Based BCI Scheme for Drone Control Using Filter Bank CSP , 2019, 2019 7th International Winter Conference on Brain-Computer Interface (BCI).

[13]  Yufeng Ke,et al.  Cross-Dataset Variability Problem in EEG Decoding With Deep Learning , 2020, Frontiers in Human Neuroscience.

[14]  Muhammad Ghulam,et al.  Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion , 2019, Future Gener. Comput. Syst..

[15]  Klaus-Robert Müller,et al.  The non-invasive Berlin Brain–Computer Interface: Fast acquisition of effective performance in untrained subjects , 2007, NeuroImage.

[16]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[17]  José del R. Millán,et al.  Brain-controlled telepresence robot by motor-disabled people , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[18]  Silvia Fantozzi,et al.  Interpretable and lightweight convolutional neural network for EEG decoding: Application to movement execution and imagination , 2020, Neural Networks.

[19]  Sang Hyun Park,et al.  Few-Shot Relation Learning with Attention for EEG-based Motor Imagery Classification , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[20]  D J McFarland,et al.  An EEG-based brain-computer interface for cursor control. , 1991, Electroencephalography and clinical neurophysiology.

[21]  Anton Nijholt,et al.  BCI for Games: A 'State of the Art' Survey , 2008, ICEC.

[22]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[23]  Giulia Cisotto,et al.  Kinematic and Neurophysiological Consequences of an Assisted-Force-Feedback Brain-Machine Interface Training: A Case Study , 2013, Front. Neurol..