EEG Classification by Factoring in Sensor Spatial Configuration

Electroencephalography (EEG) serves as an effective diagnostic tool for mental disorders and neurological abnormalities. Enhanced analysis and classification of EEG signals can help improve performance in classifying the disorders and abnormalities. A new approach is examined here for enhancing EEG classification performance using a novel model of data representation that leverages knowledge of spatial layout of EEG sensors. An investigation of the performance of the proposed data representation model provides evidence of consistently higher classification accuracy of the proposed model compared with a model that ignores the sensor layout. The performance is assessed for models that represent the information content of the EEG signals in two different ways: a one-dimensional concatenation of the channels of the frequency bands and a proposed image-like two-dimensional representation of the EEG channel locations. The models are used in conjunction with different machine learning techniques. Performance of these models is examined on two tasks: social anxiety disorder classification, and emotion recognition using a dataset, DEAP, for emotion analysis using physiological signals. We hypothesize that the proposed two-dimensional model will significantly outperform the one-dimensional model and this is validated in our results as this model consistently yields 5–8% higher accuracy in all machine learning algorithms investigated. Among the algorithms investigated, Convolutional Neural Networks provide the best performance, far exceeding that of Support Vector Machine and k-Nearest Neighbors algorithms.

[1]  Liang Dong,et al.  Emotion Recognition from Multiband EEG Signals Using CapsNet , 2019, Sensors.

[2]  N. Kamel,et al.  Review of EEG, ERP, and Brain Connectivity Estimators as Predictive Biomarkers of Social Anxiety Disorder , 2020, Frontiers in Psychology.

[3]  Liang Dong,et al.  Recognition of Emotions Using Multichannel EEG Data and DBN-GC-Based Ensemble Deep Learning Framework , 2018, Comput. Intell. Neurosci..

[4]  Mohammed Abo-Zahhad,et al.  A New EEG Acquisition Protocol for Biometric Identification Using Eye Blinking Signals , 2015 .

[5]  Helena Chmura Kraemer,et al.  DSM-5: how reliable is reliable enough? , 2012, The American journal of psychiatry.

[6]  Dan J Stein,et al.  Social Anxiety Disorder , 1999, CNS Spectrums.

[7]  B. A. Eckstein Evalution of spline and weighted average interpolation algorithms , 1989 .

[8]  Ian Daly,et al.  Internal Feature Selection Method of CSP Based on L1-Norm and Dempster–Shafer Theory , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  R. Levenson,et al.  Emotion recognition across cultures: the influence of ethnicity on empathic accuracy and physiological linkage. , 2009, Emotion.

[11]  Lei Wang,et al.  A Novel Bi-Hemispheric Discrepancy Model for EEG Emotion Recognition , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[12]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[13]  S. Hofmann,et al.  Cognitive Behavioral Therapy for Social Anxiety Disorder: Evidence-Based and Disorder-Specific Treatment Techniques , 2008 .

[14]  M. Teplan FUNDAMENTALS OF EEG MEASUREMENT , 2002 .

[15]  J R Wolpaw,et al.  Spatial filter selection for EEG-based communication. , 1997, Electroencephalography and clinical neurophysiology.

[16]  A. Harrewijn,et al.  Putative EEG measures of social anxiety: Comparing frontal alpha asymmetry and delta–beta cross-frequency correlation , 2016, Cognitive, Affective, & Behavioral Neuroscience.

[17]  Kenneth Revett,et al.  EEG Signal Classification Using Wavelet Feature Extraction and Neural Networks , 2006, IEEE John Vincent Atanasoff 2006 International Symposium on Modern Computing (JVA'06).

[18]  E Donchin,et al.  A new method for off-line removal of ocular artifact. , 1983, Electroencephalography and clinical neurophysiology.

[19]  A. Toga,et al.  Mapping brain asymmetry , 2003, Nature Reviews Neuroscience.

[20]  Arif Mahmood,et al.  Internal Emotion Classification Using EEG Signal With Sparse Discriminative Ensemble , 2019, IEEE Access.

[21]  L. Schmidt,et al.  Changes in EEG Cross-Frequency Coupling During Cognitive Behavioral Therapy for Social Anxiety Disorder , 2011, Psychological science.

[22]  H. Adeli,et al.  Analysis of EEG records in an epileptic patient using wavelet transform , 2003, Journal of Neuroscience Methods.

[23]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[24]  Reda A. El-Khoribi,et al.  A 3D-convolutional neural network framework with ensemble learning techniques for multi-modal emotion recognition , 2020, Egyptian Informatics Journal.

[25]  Liang Dong,et al.  Improved Deep Feature Learning by Synchronization Measurements for Multi-Channel EEG Emotion Recognition , 2020, Complex..

[26]  Peter Corcoran,et al.  Smart Augmentation Learning an Optimal Data Augmentation Strategy , 2017, IEEE Access.

[27]  Youjun Li,et al.  Human Emotion Recognition with Electroencephalographic Multidimensional Features by Hybrid Deep Neural Networks , 2017 .

[28]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[29]  Stephen M. Gordon,et al.  EEGNet: A Compact Convolutional Neural Network for EEG-based Brain-Computer Interfaces , 2021 .

[30]  Alex D. Leow,et al.  EEG Classification based on Image Configuration in Social Anxiety Disorder , 2018, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[31]  Siuly Siuly,et al.  Significance of EEG Signals in Medical and Health Research , 2016 .

[32]  Brendan McCane,et al.  EmotioNet: A 3-D Convolutional Neural Network for EEG-based Emotion Recognition , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[33]  Olga Sourina,et al.  Real-Time Subject-Dependent EEG-Based Emotion Recognition Algorithm , 2014, Trans. Comput. Sci..

[34]  Y. F. Huang,et al.  Accurate EEG-Based Emotion Recognition on Combined Features Using Deep Convolutional Neural Networks , 2019, IEEE Access.

[35]  Jasmin Kevric,et al.  Biomedical Signal Processing and Control , 2016 .

[36]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[37]  Hao Chao,et al.  Emotion Recognition Using Three-Dimensional Feature and Convolutional Neural Network from Multichannel EEG Signals , 2021, IEEE Sensors Journal.

[38]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[39]  Louis A. Schmidt,et al.  Frontal EEG asymmetry and symptom response to cognitive behavioral therapy in patients with social anxiety disorder , 2011, Biological Psychology.

[40]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[41]  Tardi Tjahjadi,et al.  A Mutual Information Based Adaptive Windowing of Informative EEG for Emotion Recognition , 2020, IEEE Transactions on Affective Computing.

[42]  Zhen Cui,et al.  From Regional to Global Brain: A Novel Hierarchical Spatial-Temporal Neural Network Model for EEG Emotion Recognition , 2019, IEEE Transactions on Affective Computing.