EEG-Based Emotion Recognition by Exploiting Fused Network Entropy Measures of Complex Networks across Subjects

It is well known that there may be significant individual differences in physiological signal patterns for emotional responses. Emotion recognition based on electroencephalogram (EEG) signals is still a challenging task in the context of developing an individual-independent recognition method. In our paper, from the perspective of spatial topology and temporal information of brain emotional patterns in an EEG, we exploit complex networks to characterize EEG signals to effectively extract EEG information for emotion recognition. First, we exploit visibility graphs to construct complex networks from EEG signals. Then, two kinds of network entropy measures (nodal degree entropy and clustering coefficient entropy) are calculated. By applying the AUC method, the effective features are input into the SVM classifier to perform emotion recognition across subjects. The experiment results showed that, for the EEG signals of 62 channels, the features of 18 channels selected by AUC were significant (p < 0.005). For the classification of positive and negative emotions, the average recognition rate was 87.26%; for the classification of positive, negative, and neutral emotions, the average recognition rate was 68.44%. Our method improves mean accuracy by an average of 2.28% compared with other existing methods. Our results fully demonstrate that a more accurate recognition of emotional EEG signals can be achieved relative to the available relevant studies, indicating that our method can provide more generalizability in practical use.

[1]  Bin Liu,et al.  Efficient measurement model for critical nodes based on edge clustering coefficients and edge betweenness , 2019, Wireless Networks.

[2]  Daming Shi,et al.  Multi-objective evolutionary clustering with complex networks , 2021, Expert Syst. Appl..

[3]  Xin Wang,et al.  Hemispheric Asymmetry of Functional Brain Networks under Different Emotions Using EEG Data , 2020, Entropy.

[4]  Vincent Froese,et al.  Computational complexity aspects of point visibility graphs , 2017, Discret. Appl. Math..

[5]  Liang Dong,et al.  Improved Deep Feature Learning by Synchronization Measurements for Multi-Channel EEG Emotion Recognition , 2020, Complex..

[6]  Xinchun Cui,et al.  EEG emotion recognition using fusion model of graph convolutional neural networks and LSTM , 2021, Appl. Soft Comput..

[7]  Simon Fong,et al.  Nonlinear characterization and complexity analysis of cardiotocographic examinations using entropy measures , 2018, The Journal of Supercomputing.

[8]  Zuyu Zhang,et al.  EEG Emotion Recognition Based on Channel Attention for E-Healthcare Applications , 2021, MMM.

[9]  Shahab Abdulla,et al.  EEG sleep stages identification based on weighted undirected complex networks , 2020, Comput. Methods Programs Biomed..

[10]  Wenming Zheng,et al.  Multichannel EEG-Based Emotion Recognition via Group Sparse Canonical Correlation Analysis , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[11]  Yongli Liu,et al.  Emotion Recognition From Multi-Channel EEG Signals by Exploiting the Deep Belief-Conditional Random Field Framework , 2020, IEEE Access.

[12]  Mingjiang Wang,et al.  Dynamic entropy-based pattern learning to identify emotions from EEG signals across individuals , 2020 .

[13]  Varun Bajaj,et al.  Emotion recognition from single-channel EEG signals using a two-stage correlation and instantaneous frequency-based filtering method , 2019, Comput. Methods Programs Biomed..

[14]  Xun Chen,et al.  Emotion Recognition From Multi-Channel EEG via Deep Forest , 2020, IEEE Journal of Biomedical and Health Informatics.

[15]  Humaira Nisar,et al.  Comparison of different feature extraction methods for EEG-based emotion recognition , 2020 .

[16]  Olaf Sporns,et al.  Complex network measures of brain connectivity: Uses and interpretations , 2010, NeuroImage.

[17]  Matti Pietikäinen,et al.  Discriminative Spatiotemporal Local Binary Pattern with Revisited Integral Projection for Spontaneous Facial Micro-Expression Recognition , 2019, IEEE Transactions on Affective Computing.

[18]  Andrzej Cichocki,et al.  EEG-based approach for recognizing human social emotion perception , 2020, Adv. Eng. Informatics.

[19]  John Atkinson,et al.  Improving BCI-based emotion recognition by combining EEG feature selection and kernel classifiers , 2016, Expert Syst. Appl..

[20]  Lizheng Pan,et al.  Emotional State Recognition from Peripheral Physiological Signals Using Fused Nonlinear Features and Team-Collaboration Identification Strategy , 2020, Entropy.

[21]  Mohammad Shorfuzzaman,et al.  Semi-Skipping Layered Gated Unit and Efficient Network: Hybrid Deep Feature Selection Method for Edge Computing in EEG-Based Emotion Classification , 2021, IEEE Access.

[22]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[23]  Bao-Liang Lu,et al.  Identifying Stable Patterns over Time for Emotion Recognition from EEG , 2016, IEEE Transactions on Affective Computing.

[24]  Kuldeep Singh,et al.  Level-2 node clustering coefficient-based link prediction , 2019, Applied Intelligence.

[25]  Moon Inder Singh,et al.  Development of a real time emotion classifier based on evoked EEG , 2017 .

[26]  Wang Wan,et al.  Recognition of Emotional States Using Multiscale Information Analysis of High Frequency EEG Oscillations , 2019, Entropy.

[27]  Bao-Liang Lu,et al.  Differential entropy feature for EEG-based emotion classification , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[28]  G. Fagiolo Clustering in complex directed networks. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Guifang Fu,et al.  Emotion recognition by deeply learned multi-channel textual and EEG features , 2021, Future Gener. Comput. Syst..

[30]  Bin Hu,et al.  Exploring EEG Features in Cross-Subject Emotion Recognition , 2018, Front. Neurosci..

[31]  Soraia M. Alarcão,et al.  Emotions Recognition Using EEG Signals: A Survey , 2019, IEEE Transactions on Affective Computing.

[32]  A. Hussain,et al.  A novel explainable machine learning approach for EEG-based brain-computer interface systems , 2021, Neural Computing and Applications.

[33]  Yong-Jin Liu,et al.  Real-Time Movie-Induced Discrete Emotion Recognition from EEG Signals , 2018, IEEE Transactions on Affective Computing.

[34]  Erhan Ekmekcioglu,et al.  Investigating the Use of Pretrained Convolutional Neural Network on Cross-Subject and Cross-Dataset EEG Emotion Recognition , 2020, Sensors.

[35]  M. Plechawska-Wójcik,et al.  Interpretable Machine Learning Models for Three-Way Classification of Cognitive Workload Levels for Eye-Tracking Features , 2021, Brain sciences.

[36]  Mi Li,et al.  Emotion recognition from multichannel EEG signals using K-nearest neighbor classification , 2018, Technology and health care : official journal of the European Society for Engineering and Medicine.