Identification of Emotional Valences via Memory-Informed Deep Neural Network with Entropy Features

Emotion plays an important role in people's everyday routine and work. Using electroencephalograph (EEG) signals to identify emotional states of human brain is one of the most valuable methods for emotion recognition. This paper studied positive and negative emotional valences identification from EEG signals via memory-informed deep neural network with entropy features. To quantify EEG signals over time, we first used sliding time windows to calculate sample entropy in EEG signals. Then we integrated a life-long memory module into deep neural network to accumulate prior knowledge of the entropy features of positive and negative emotional valences during training phase, so as to enhance the performance of emotional valences identification. Finally, we performed our experimental analysis with the SEED (SJTU Emotion EEG Dataset) dataset, a publicly available EEG dataset for emotion analysis. The average accuracy of 92.22% was achieved for the identification of positive and negative emotional valences for 15 subjects in SEED dataset. The experimental results showed that the proposed framework could effectively achieve the identification of positive and negative emotional valences from EEG signals, which had broad application prospects in healthcare decision-making system.

[1]  Bao-Liang Lu,et al.  Cross-subject and Cross-gender Emotion Classification from EEG , 2015 .

[2]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[3]  Jason Weston,et al.  End-To-End Memory Networks , 2015, NIPS.

[4]  E. Karademas,et al.  The Impact of Emotion Regulation and Illness-focused Coping Strategies on the Relation of Illness-related Negative Emotions to Subjective Health , 2011, Journal of health psychology.

[5]  Alex Graves,et al.  Neural Turing Machines , 2014, ArXiv.

[6]  Mi Li,et al.  Emotion recognition from multichannel EEG signals using K-nearest neighbor classification , 2018, Technology and health care : official journal of the European Society for Engineering and Medicine.

[7]  José Manuel Pastor,et al.  Application of Entropy-Based Metrics to Identify Emotional Distress from Electroencephalographic Recordings , 2016, Entropy.

[8]  Li Ni,et al.  Analyzing EEG of Quasi-Brain-Death Based on Dynamic Sample Entropy Measures , 2013, Comput. Math. Methods Medicine.

[9]  L. F. Barrett Discrete Emotions or Dimensions? The Role of Valence Focus and Arousal Focus , 1998 .

[10]  Suhua Zhang,et al.  An approach to EEG-based emotion recognition using combined feature extraction method , 2016, Neuroscience Letters.

[11]  J. Russell A circumplex model of affect. , 1980 .

[12]  Aurko Roy,et al.  Learning to Remember Rare Events , 2017, ICLR.

[13]  Javad Frounchi,et al.  Wavelet-based emotion recognition system using EEG signal , 2017, Neural Computing and Applications.

[14]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[15]  Gernot R. Müller-Putz,et al.  Domain Adaptation Techniques for EEG-Based Emotion Recognition: A Comparative Study on Two Public Datasets , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[16]  Roberto Sassi,et al.  Bubble Entropy: An Entropy Almost Free of Parameters , 2017, IEEE Transactions on Biomedical Engineering.

[17]  Bao-Liang Lu,et al.  Identifying Stable Patterns over Time for Emotion Recognition from EEG , 2016, IEEE Transactions on Affective Computing.

[18]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Bao-Liang Lu,et al.  Differential entropy feature for EEG-based emotion classification , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[20]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[21]  Li Li,et al.  Emotion recognition based on the sample entropy of EEG. , 2014, Bio-medical materials and engineering.