FBCNet: A Multi-view Convolutional Neural Network for Brain-Computer Interface

Lack of adequate training samples and noisy highdimensional features are key challenges faced by Motor Imagery (MI) decoding algorithms for electroencephalogram (EEG) based Brain-Computer Interface (BCI). To address these challenges, inspired from neuro-physiological signatures of MI, this paper proposes a novel Filter-Bank Convolutional Network (FBCNet) for MI classification. FBCNet employs a multi-view data representation followed by spatial filtering to extract spectro-spatially discriminative features. This multistage approach enables efficient training of the network even when limited training data is available. More significantly, in FBCNet, we propose a novel Variance layer that effectively aggregates the EEG time-domain information. With this design, we compare FBCNet with stateof-the-art (SOTA) BCI algorithm on four MI datasets: The BCI competition IV dataset 2a (BCIC-IV-2a), the OpenBMI dataset, and two large datasets from chronic stroke patients. The results show that, by achieving 76.20% 4-class classification accuracy, FBCNet sets a new SOTA for BCIC-IV-2a dataset. On the other three datasets, FBCNet yields up to 8% higher binary classification accuracies. Additionally, using explainable AI techniques we present one of the first reports about the differences in discriminative EEG features between healthy subjects and stroke patients. Also, the FBCNet source code is available at https://github.com/ravikiran-mane/FBCNet.

[1]  Shuicheng Yan,et al.  Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Anirban Chowdhury,et al.  Deep Learning based Prediction of EEG Motor Imagery of Stroke Patients’ for Neuro-Rehabilitation Application , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[3]  Mouad RIYAD,et al.  MI-EEGNET: A novel convolutional neural network for motor imagery classification , 2020, Journal of Neuroscience Methods.

[4]  Cuntai Guan,et al.  Brain-computer interface-based robotic end effector system for wrist and hand rehabilitation: results of a three-armed randomized controlled trial for chronic stroke , 2014, Front. Neuroeng..

[5]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[6]  Cuntai Guan,et al.  Facilitating effects of transcranial direct current stimulation on motor imagery brain-computer interface with robotic feedback for stroke rehabilitation. , 2015, Archives of physical medicine and rehabilitation.

[7]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[8]  Xiangyang Zhu,et al.  Fast Recognition of BCI-Inefficient Users Using Physiological Features from EEG Signals: A Screening Study of Stroke Patients , 2018, Front. Neurosci..

[9]  Seong-Whan Lee,et al.  Subject-Independent Brain–Computer Interfaces Based on Deep Convolutional Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Cuntai Guan,et al.  A Large Clinical Study on the Ability of Stroke Patients to Use an EEG-Based Motor Imagery Brain-Computer Interface , 2011, Clinical EEG and neuroscience.

[11]  Steven C Cramer,et al.  Biomarkers of Stroke Recovery: Consensus-Based Core Recommendations from the Stroke Recovery and Rehabilitation Roundtable* , 2017, Neurorehabilitation and neural repair.

[12]  Cuntai Guan,et al.  A Multi-view CNN with Novel Variance Layer for Motor Imagery Brain Computer Interface , 2020, 2020 42nd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[13]  Cuntai Guan,et al.  Quantitative EEG as Biomarkers for the Monitoring of Post-Stroke Motor Recovery in BCI and tDCS Rehabilitation , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Steven C. Cramer Repairing the human brain after stroke: I. Mechanisms of spontaneous recovery , 2008, Annals of neurology.

[15]  S. Ali Etemad,et al.  RFNet: Riemannian Fusion Network for EEG-based Brain-Computer Interfaces , 2020, ArXiv.

[16]  John Williamson,et al.  EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy , 2019, GigaScience.

[17]  Yuanqing Li,et al.  An EEG-Based BCI System for 2-D Cursor Control by Combining Mu/Beta Rhythm and P300 Potential , 2010, IEEE Transactions on Biomedical Engineering.

[18]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[19]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern Algorithm on BCI Competition IV Datasets 2a and 2b , 2012, Front. Neurosci..

[20]  Tiago H. Falk,et al.  Deep learning-based electroencephalography analysis: a systematic review , 2019, Journal of neural engineering.

[21]  Clemens Brunner,et al.  Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks , 2006, NeuroImage.

[22]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[23]  Cuntai Guan,et al.  Mutual information-based selection of optimal spatial-temporal patterns for single-trial EEG-based BCIs , 2012, Pattern Recognit..

[24]  A. P. Vinod,et al.  Prognostic and Monitory EEG-Biomarkers for BCI Upper-Limb Stroke Rehabilitation , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Cuntai Guan,et al.  BCI for stroke rehabilitation: motor and beyond , 2020, Journal of neural engineering.

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[29]  Rajesh P. N. Rao Brain-Computer Interfacing: An Introduction , 2010 .

[30]  Quoc V. Le,et al.  Searching for Activation Functions , 2018, arXiv.

[31]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[32]  Cuntai Guan,et al.  EEG Representation in Deep Convolutional Neural Networks for Classification of Motor Imagery , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).