A channel attention based MLP-Mixer network for motor imagery decoding with EEG

Convolutional neural networks (CNNs) and their variants have been successfully applied to the electroencephalogram (EEG) based motor imagery (MI) decoding task. However, these CNN-based algorithms generally have limitations in perceiving global temporal dependencies of EEG signals. Besides, they also ignore the diverse contributions of different EEG channels to the classification task. To address such issues, a novel channel attention based MLP-Mixer network (CAMLP-Net) is proposed for EEG-based MI decoding. Specifically, the MLP-based architecture is applied in this network to capture the temporal and spatial information. The attention mechanism is further embedded into MLP-Mixer to adaptively exploit the importance of different EEG channels. Therefore, the proposed CAMLPNet can effectively learn more global temporal and spatial information. The experimental results on the newly built MI2 dataset indicate that our proposed CAMLP-Net achieves superior classification performance over all the compared algorithms.

[1]  Duo Chen,et al.  TSception:A Deep Learning Framework for Emotion Detection Using EEG , 2020, 2020 International Joint Conference on Neural Networks (IJCNN).

[2]  Shuicheng Yan,et al.  Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Wei Wei,et al.  Deep Channel-Correlation Network for Motor Imagery Decoding From the Same Limb , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Reza Abiri,et al.  A comprehensive review of EEG-based brain–computer interface paradigms , 2019, Journal of neural engineering.

[5]  Alexander Kolesnikov,et al.  MLP-Mixer: An all-MLP Architecture for Vision , 2021, NeurIPS.

[6]  Ghulam Muhammad,et al.  Deep learning techniques for classification of electroencephalogram (EEG) motor imagery (MI) signals: a review , 2021, Neural Computing and Applications.

[7]  José del R. Millán,et al.  Brain-Computer Interfaces , 2020, Handbook of Clinical Neurology.

[8]  Guiguang Ding,et al.  RepMLP: Re-parameterizing Convolutions into Fully-connected Layers for Image Recognition , 2021, ArXiv.

[9]  Muhammad Ghulam,et al.  Deep Learning for EEG motor imagery classification based on multi-layer CNNs feature fusion , 2019, Future Gener. Comput. Syst..

[10]  Juan Cheng,et al.  EEG-Based Emotion Recognition via Channel-Wise Attention and Self Attention , 2023, IEEE Transactions on Affective Computing.

[11]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[12]  Weiliang Xu,et al.  A Decoding Scheme for Incomplete Motor Imagery EEG With Deep Belief Network , 2018, Front. Neurosci..

[13]  Xianlun Tang,et al.  Motor imagery EEG recognition with KNN-based smooth auto-encoder , 2019, Artif. Intell. Medicine.

[14]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[15]  Shuang Qiu,et al.  Multi-channel EEG recording during motor imagery of different joints from the same limb , 2020, Scientific Data.

[16]  Stephen M. Gordon,et al.  EEGNet: A Compact Convolutional Neural Network for EEG-based Brain-Computer Interfaces , 2021 .

[17]  Weiming Hu,et al.  3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition , 2021, IEEE Journal of Biomedical and Health Informatics.

[18]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[19]  Jassim M. Abdul-Jabbar,et al.  Deep learning for motor imagery EEG-based classification: A review , 2021, Biomed. Signal Process. Control..

[20]  Yonghao Song,et al.  Transformer-based Spatial-Temporal Feature Learning for EEG Decoding , 2021, ArXiv.