Emotion detection using physiological signals EEG & ECG

Emotion modeling and identification has attracted substantial interest from disciplines including computer science, cognitive science and psychology. Despite the fact that a lot of qualitative studies have been carried out on emotion, less investigated aspects include the quantifying of physiological signals. This paper presents two physiological signals which are ECG and EEG and shows analysis of its emotional properties. A solution based on the short Fourier transform is proposed for the recognition of dynamically developing emotion patterns on ECG and EEG. Features extraction that are used in this paper are Kernel Density Estimation known as (KDE) and Mel-frequency cepstral coefficients known as MFCC. The classifier that is used in this work is Multi-layer Perceptron known as MLP, classification features are based on the valence and arousal. The experimental setup presented in this work for the elicitation of emotions is based on passive valence /arousal. The results shows that the ECG signal has direct relationship with the arousal factor rather than the valence factor. Also, EEG signal using 19 channels reported high accuracy results for determining emotions.

[1]  Dimitrios Hatzinakos,et al.  ECG Pattern Analysis for Emotion Detection , 2012, IEEE Transactions on Affective Computing.

[2]  Regan L. Mandryk,et al.  Using psychophysiological techniques to measure user experience with entertainment technologies , 2006, Behav. Inf. Technol..

[3]  Mohd Nasir Taib,et al.  The preliminary study on the effect of nasyid music and rock music on brainwave signal using EEG , 2010, 2010 2nd International Congress on Engineering Education.

[4]  Byoung-Jun Park,et al.  Emotion classification based on physiological signals induced by negative emotions: Discriminantion of negative emotions by machine learning algorithm , 2012, Proceedings of 2012 9th IEEE International Conference on Networking, Sensing and Control.

[5]  M. A. Dzulkifli,et al.  Stress Assessment While Listening to Quran Recitation , 2014, 2014 International Conference on Computer Assisted System in Health.

[6]  Frédéric Bousefsaf,et al.  Remote assessment of the heart rate variability to detect mental stress , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[7]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[8]  Dezhong Yao,et al.  Large-Scale Functional Networks Identified from Resting-State EEG Using Spatial ICA , 2016, PloS one.

[9]  A. J. Fridlund,et al.  Facial Expressions , 2018, Encyclopedia of Evolutionary Psychological Science.

[10]  Mahmut Ozer,et al.  EEG signals classification using the K-means clustering and a multilayer perceptron neural network model , 2011, Expert Syst. Appl..

[11]  Elmar Nöth,et al.  Real-time Recognition of the Affective User State with Physiological Signals , 2022 .

[12]  Veikko Surakka,et al.  Emotions and heart rate while sitting on a chair , 2005, CHI.

[13]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[14]  Rosalind W. Picard.  Affective computing: challenges , 2003, Int. J. Hum. Comput. Stud..

[15]  M. Murugappan,et al.  Human emotional stress analysis through time domain electromyogram features , 2013, 2013 IEEE Symposium on Industrial Electronics & Applications.

[16]  Christian Martyn Jones,et al.  Biometric valence and arousal recognition , 2007, OZCHI '07.

[17]  Abdul Wahab,et al.  EEG Emotion Recognition Based on the Dimensional Models of Emotions , 2013 .

[18]  Léon J. M. Rothkrantz,et al.  Stress assessment of car-drivers using EEG-analysis , 2010, CompSysTech '10.

[19]  Abdul Wahab,et al.  EEG Emotion Recognition System , 2009 .

[20]  Kai Keng Ang,et al.  Affective computation on EEG correlates of emotion from musical and vocal stimuli , 2009, 2009 International Joint Conference on Neural Networks.

[21]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.