The emotional state classification using physiological signal interpretation framework

This paper proposes and evaluates an emotional state classification using a physiological signal interpretation framework. The proposed Emo-CSI framework consists of three components which are the following: 1) physiological signal sensing, 2) data pre-processing, and 3) emotional state classification. The Emo-CSI framework applies physiological signals (i.e., heart rate, breathing pattern, skin temperature, skin humidity, and skin conductivity) to classify the emotional state. The emotional state classification results in an emotional state (i.e., displeasure, neutral, pleasure, calm, medium, and excited). This research also investigates the accuracy of three classification techniques which are the following: 1) support vector machine (SVM), 2) artificial neural network (ANN), and 3) decision tree (DT). The evaluation results show that the physiological signals are related to emotional state. Using SVM as a classification in Emo-CSI outperforms the other classification techniques.

[1]  M. Mahadevappa,et al.  Emotion recognition based on physiological signals using valence-arousal model , 2015, 2015 Third International Conference on Image Information Processing (ICIIP).

[2]  Imad Fakhri Taha Alshaikhli,et al.  EEG-based Emotion Recognition while Listening to Quran Recitation Compared with Relaxing Music Using Valence-Arousal Model , 2015, 2015 4th International Conference on Advanced Computer Science Applications and Technologies (ACSAT).

[3]  R. Levenson,et al.  Emotion recognition across cultures: the influence of ethnicity on empathic accuracy and physiological linkage. , 2009, Emotion.

[4]  Florian Vogt,et al.  Physiological data analysis for an emotional provoking exergame , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[5]  Shan Suthaharan,et al.  Support Vector Machine , 2016 .

[6]  P. Lang.  International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[7]  P. Ekman.  Are there basic emotions? , 1992, Psychological review.

[8]  Walter J. Freeman,et al.  Emotion is Essential to All Intentional Behaviors , 2000 .

[9]  Jan B. F. van Erp,et al.  Perceiving blocks of emotional pictures and sounds: effects on physiological variables , 2013, Front. Hum. Neurosci..

[10]  E. Jang,et al.  Identification of the optimal emotion recognition algorithm using physiological signals , 2012, 2011 2nd International Conference on Engineering and Industries (ICEI).

[11]  R. Plutchik.  Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice , 2016 .

[12]  William Stafford Noble,et al.  Support vector machine , 2013 .

[13]  Takahiro Hayashi,et al.  Impression Estimation of a Video Based on the Valence-Arousal Model , 2016, 2016 International Conference on Multimedia Systems and Signal Processing (ICMSSP).

[14]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[15]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[16]  Byoung-Jun Park,et al.  A Study on Analysis of Bio-Signals for Basic Emotions Classification: Recognition Using Machine Learning Algorithms , 2014, 2014 International Conference on Information Science & Applications (ICISA).

[17]  Heather T. Ma,et al.  Emotion recognition based on the multiple physiological signals , 2016, 2016 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[18]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[19]  David Matsumoto,et al.  Methodological requirements to test a possible in-group advantage in judging emotions across cultures: comment on Elfenbein and Ambady (2002) and evidence. , 2002, Psychological bulletin.

[20]  M. Kutas,et al.  Combined perception of emotion in pictures and musical sounds , 2006, Brain Research.

[21]  P. Ekman.  An argument for basic emotions , 1992 .

[22]  C. Darwin.  The Expression of the Emotions in Man and Animals , .

[23]  F. B. Reguig,et al.  Emotion recognition from physiological signals , 2011, Journal of medical engineering & technology.

[24]  Zied Lachiri,et al.  Emotion sensing from physiological signals using three defined areas in arousal-valence model , 2017, 2017 International Conference on Control, Automation and Diagnosis (ICCAD).