EEG based Emotional State Estimation using 2-D Deep Learning Technique

Emotion detection is very crucial role on diagnosis of brain disorders and psychological disorders. Electroencephalogram (EEG) is useful tool that obtain complex physiological brain signals from human. In this paper, we proposed a novel approach for emotional state estimation using convolutional neural network (CNN) based deep learning technique from EEG signals. Firstly, we convert 32 lead EEG signals to 2D EEG images with Azimuthal Equidistant Projection (AEP) technique. Then, 2D images that represented measurements of EEG signals sent to CNN based deep neural network for classification. In this study, we have achieved accuracy of 95.96% two classes as negative and positive valence, 96.09% two classes as high and low arousal and 95.90% two classes as high and low arousal dominance.

[1]  Gabriela Moise,et al.  Fear Level Classification Based on Emotional Dimensions and Machine Learning Techniques , 2019, Sensors.

[2]  Uma Shanker Tiwary,et al.  Affect representation and recognition in 3D continuous valence–arousal–dominance space , 2016, Multimedia Tools and Applications.

[3]  Wenming Zheng,et al.  EEG Emotion Recognition Using Dynamical Graph Convolutional Neural Networks , 2020, IEEE Transactions on Affective Computing.

[4]  Bao-Liang Lu,et al.  EEG-based emotion recognition during watching movies , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[5]  J. Russell A circumplex model of affect. , 1980 .

[6]  Reda A. El-Khoribi,et al.  Emotion Recognition based on EEG using LSTM Recurrent Neural Network , 2017 .

[7]  Chi Zhang,et al.  Emotion Recognition from EEG Signals Using Multidimensional Information in EMD Domain , 2017, BioMed research international.

[8]  Hyo Jong Lee,et al.  Deep learninig of EEG signals for emotion recognition , 2015, 2015 IEEE International Conference on Multimedia & Expo Workshops (ICMEW).

[9]  Wei Liu,et al.  Emotion Recognition Using Multimodal Deep Learning , 2016, ICONIP.

[10]  Bao-Liang Lu,et al.  Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks , 2015, IEEE Transactions on Autonomous Mental Development.

[11]  Chung-Hsien Wu,et al.  Speech Emotion Recognition Using Deep Neural Network Considering Verbal and Nonverbal Speech Sounds , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Melissa H. Black,et al.  Mechanisms of facial emotion recognition in autism spectrum disorders: Insights from eye tracking and electroencephalography , 2017, Neuroscience & Biobehavioral Reviews.

[13]  L. D. de Sonneville,et al.  Recognition of Facial Emotion and Affective Prosody in Children at High Risk of Criminal Behavior , 2018, Journal of the International Neuropsychological Society.

[14]  Xiang Li,et al.  Emotion recognition from multi-channel EEG data through Convolutional Recurrent Neural Network , 2016, 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[15]  Guangyuan Liu,et al.  Emotion Recognition of GSR Based on an Improved Quantum Neural Network , 2016, 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).