Brain Signal Classification via Learning Connectivity Structure

Connectivity between different brain regions is one of the most important properties for classification of brain signals including electroencephalography (EEG). However, how to define the connectivity structure for a given task is still an open problem, because there is no ground truth about how the connectivity structure should be in order to maximize the performance. In this paper, we propose an end-to-end neural network model for EEG classification, which can extract an appropriate multi-layer graph structure and signal features directly from a set of raw EEG signals and perform classification. Experimental results demonstrate that our method yields improved performance in comparison to the existing approaches where manually defined connectivity structures and signal features are used. Furthermore, we show that the graph structure extraction process is reliable in terms of consistency, and the learned graph structures make much sense in the neuroscientific viewpoint.

[1]  Danielle S. Bassett,et al.  Multi-scale brain networks , 2016, NeuroImage.

[2]  T. Fernández,et al.  EEG delta activity: an indicator of attention to internal processing during performance of mental tasks. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  Reza Boostani,et al.  Entropy and complexity measures for EEG signal classification of schizophrenic and control participants , 2009, Artif. Intell. Medicine.

[4]  Philip S. Yu,et al.  A Comprehensive Survey on Graph Neural Networks , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Christopher R. Brown,et al.  EEG differences in children between eyes-closed and eyes-open resting conditions , 2009, Clinical Neurophysiology.

[6]  Ben Glocker,et al.  Distance Metric Learning Using Graph Convolutional Networks: Application to Functional Brain Networks , 2017, MICCAI.

[7]  Max Welling,et al.  Semi-Supervised Classification with Graph Convolutional Networks , 2016, ICLR.

[8]  Weisi Lin,et al.  A Dilated Inception Network for Visual Saliency Prediction , 2019, IEEE Transactions on Multimedia.

[9]  K. Grill-Spector,et al.  The human visual cortex. , 2004, Annual review of neuroscience.

[10]  Barry Horwitz,et al.  The elusive concept of brain connectivity , 2003, NeuroImage.

[11]  Yee Whye Teh,et al.  The Concrete Distribution: A Continuous Relaxation of Discrete Random Variables , 2016, ICLR.

[12]  L. Pessoa.  Emotion and cognition and the amygdala: From “what is it?” to “what's to be done?” , 2010, Neuropsychologia.

[13]  R. Zemel,et al.  Neural Relational Inference for Interacting Systems , 2018, ICML.

[14]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[15]  Javad Frounchi,et al.  Wavelet-based emotion recognition system using EEG signal , 2017, Neural Computing and Applications.

[16]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[17]  Wenming Zheng,et al.  EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks , 2020, IEEE Transactions on Affective Computing.

[18]  Seong-Eun Moon,et al.  Convolutional Neural Network Approach for Eeg-Based Emotion Recognition Using Brain Connectivity and its Spatial Information , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[20]  Wuzhen Shi,et al.  Single image super-resolution with dilated convolution based multi-scale information learning inception module , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[21]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[22]  Massimiliano Pontil,et al.  Learning Discrete Structures for Graph Neural Networks , 2019, ICML.

[23]  Nicola De Cao,et al.  MolGAN: An implicit generative model for small molecular graphs , 2018, ArXiv.

[24]  Seong-Eun Moon,et al.  Eeg-Based Video Identification Using Graph Signal Modeling and Graph Convolutional Neural Network , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[25]  Jaime Fernando Delgado Saa,et al.  EEG Signal Classification Using Power Spectral Features and linear Discriminant Analysis: A Brain Computer Interface Application , 2010 .

[26]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Ben Poole,et al.  Categorical Reparameterization with Gumbel-Softmax , 2016, ICLR.

[29]  Dimitri Van De Ville,et al.  The dynamic functional connectome: State-of-the-art and perspectives , 2017, NeuroImage.

[30]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[31]  John J. B. Allen,et al.  Frontal asymmetry as a mediator and moderator of emotion: An updated review. , 2018, Psychophysiology.

[32]  L. Trainor,et al.  Frontal brain electrical activity (EEG) distinguishes valence and intensity of musical emotions , 2001 .

[33]  Soraia M. Alarcão,et al.  Emotions Recognition Using EEG Signals: A Survey , 2019, IEEE Transactions on Affective Computing.

[34]  Daniel D. Dilks,et al.  The occipital place area represents the local elements of scenes , 2016, NeuroImage.

[35]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[36]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[37]  Dinggang Shen,et al.  Data-driven graph construction and graph learning: A review , 2018, Neurocomputing.

[38]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[39]  Philip A. Gable,et al.  The role of asymmetric frontal cortical activity in emotion-related phenomena: A review and update , 2010, Biological Psychology.

[40]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[41]  Lina Yao,et al.  Cascade and Parallel Convolutional Recurrent Neural Networks on EEG-based Intention Recognition for Brain Computer Interface , 2017, AAAI.

[42]  S. Bressler,et al.  Granger Causality: Basic Theory and Application to Neuroscience , 2006, q-bio/0608035.

[43]  Chee-Ming Ting,et al.  A Multi-Domain Connectome Convolutional Neural Network for Identifying Schizophrenia From EEG Connectivity Patterns , 2019, IEEE Journal of Biomedical and Health Informatics.

[44]  Xavier Bresson,et al.  Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering , 2016, NIPS.

[45]  Danielle S Bassett,et al.  Brain graphs: graphical models of the human brain connectome. , 2011, Annual review of clinical psychology.

[46]  O. Hauk,et al.  Neurophysiological distinction of action words in the fronto‐central cortex , 2004, Human brain mapping.