A Graph-Based Hierarchical Attention Model for Movement Intention Detection from EEG Signals

An EEG-based Brain-Computer Interface (BCI) is a system that enables a user to communicate with and intuitively control external devices solely using the user’s intentions. Current EEG-based BCI research usually involves a subject-specific adaptation step before a BCI system is ready to be employed by a <italic>new</italic> user. However, the subject-independent scenario, in which a well-trained model can be directly applied to new users without pre-calibration, is particularly desirable yet rarely explored. Considering this critical gap, our focus in this paper is the subject-independent scenario of EEG-based human intention recognition. We present a <inline-formula> <tex-math notation="LaTeX">${G}$ </tex-math></inline-formula>raph-based <inline-formula> <tex-math notation="LaTeX">${H}$ </tex-math></inline-formula>ierarchical <inline-formula> <tex-math notation="LaTeX">${A}$ </tex-math></inline-formula>ttention <inline-formula> <tex-math notation="LaTeX">${M}$ </tex-math></inline-formula>odel (<italic>G-HAM</italic>) that utilizes the graph structure to represent the spatial information of EEG sensors and the hierarchical attention mechanism to focus on both the most discriminative temporal periods and EEG nodes. Extensive experiments on a large EEG dataset containing 105 subjects indicate that our model is capable of exploiting the underlying invariant EEG patterns across different subjects and generalizing the patterns to new subjects with better performance than a series of state-of-the-art and baseline approaches.

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  Yoshua Bengio,et al.  Neural Machine Translation by Jointly Learning to Align and Translate , 2014, ICLR.

[3]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[4]  Vidya M. Shettar,et al.  A New Spectral Technique Using Normalized Adjacency Matrices for Graph Matching , 2011 .

[5]  Ilaria De Munari,et al.  Improving BCI Usability as HCI in Ambient Assisted Living System Control , 2015, HCI.

[6]  Alberto Borboni,et al.  EEG-Based Control for Upper and Lower Limb Exoskeletons and Prostheses: A Systematic Review , 2018, Sensors.

[7]  Ganesh R. Naik,et al.  Channels selection using independent component analysis and scalp map projection for EEG-based driver fatigue classification , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Lina Yao,et al.  Cascade and Parallel Convolutional Recurrent Neural Networks on EEG-based Intention Recognition for Brain Computer Interface , 2017, AAAI.

[9]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[10]  Bahram Shafai,et al.  An Adaptive Proportional BCI-Controller for Linear Dynamic Systems , 2018, 2018 World Automation Congress (WAC).

[11]  Danilo P. Mandic,et al.  Motor Imagery Classification Using Mu and Beta Rhythms of EEG with Strong Uncorrelating Transform Based Complex Common Spatial Patterns , 2016, Comput. Intell. Neurosci..

[12]  Chethan Pandarinath,et al.  Rapid calibration of an intracortical brain–computer interface for people with tetraplegia , 2018, Journal of neural engineering.

[13]  Brent Lance,et al.  Driver Drowsiness Estimation From EEG Signals Using Online Weighted Adaptation Regularization for Regression (OwARR) , 2017, IEEE Transactions on Fuzzy Systems.

[14]  Chris D. Nugent,et al.  From Activity Recognition to Intention Recognition for Assisted Living Within Smart Homes , 2017, IEEE Transactions on Human-Machine Systems.

[15]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[16]  Chiew Tong Lau,et al.  A Study on the impact of spectral variability in brain-computer interface , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[17]  Klaus-Robert Müller,et al.  Subject independent EEG-based BCI decoding , 2009, NIPS.

[18]  Yunhao Liu,et al.  Making Sense of Spatio-Temporal Preserving Representations for EEG-Based Human Intention Recognition , 2020, IEEE Transactions on Cybernetics.

[19]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[20]  Brent Lance,et al.  EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces , 2016, Journal of neural engineering.

[21]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[22]  Joelle Pineau,et al.  Learning Robust Features using Deep Learning for Automatic Seizure Detection , 2016, MLHC.

[23]  Junfeng Chen,et al.  Learning Spatial–Spectral–Temporal EEG Features With Recurrent 3D Convolutional Neural Networks for Cross-Task Mental Workload Assessment , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[24]  Febo Cincotti,et al.  EEG-based Brain-Computer Interface to support post-stroke motor rehabilitation of the upper limb , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Benjamin Blankertz,et al.  Characterizing Regularization Techniques for Spatial Filter Optimization in Oscillatory EEG Regression Problems , 2018, Neuroinformatics.

[26]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[27]  V. J. Mathews,et al.  Deep Learning Movement Intent Decoders Trained With Dataset Aggregation for Prosthetic Limb Control , 2019, IEEE Transactions on Biomedical Engineering.

[28]  Ji-Hoon Jeong,et al.  Classification of Hand Motions within EEG Signals for Non-Invasive BCI-Based Robot Hand Control , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[30]  Lina Yao,et al.  Multi-Person Brain Activity Recognition via Comprehensive EEG Signal Analysis , 2017, MobiQuitous.

[31]  Jinhua She,et al.  Three-Layer Weighted Fuzzy Support Vector Regression for Emotional Intention Understanding in Human–Robot Interaction , 2018, IEEE Transactions on Fuzzy Systems.

[32]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[33]  Fumikazu Miwakeichi,et al.  Concurrent EEG/fMRI analysis by multiway Partial Least Squares , 2004, NeuroImage.

[34]  Nilanjan Sarkar,et al.  A Robotic Coach Architecture for Elder Care (ROCARE) Based on Multi-User Engagement Models , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.