Classification of Human Emotions from Physiological signals using Machine Learning Algorithms

Emotion recognition is one of the key steps towards emotional intelligence in advanced human-machine interaction. Recently, emotion recognition using physiological signals has been performed by various machine learning algorithms as physiological signals are important for emotion recognition abilities of human-computer systems. The purpose of this study is to classify three different emotional states (boredom, pain, and surprise) from physiological signals using several machine learning algorithms and to identify the optimal algorithms being able to classify these emotions. 217 subjects participated in this experiment. The emotional stimuli designed to induce three emotions (boredom, pain, and surprise) were presented to subjects and physiological signals were measured for 1 minute as baseline and for 1-1.5 minutes during emotional states. The obtained signals were analyzed for 30 seconds from the baseline and the emotional state and 27 parameters were extracted from these signals. For classification of three different emotions, machine learning algorithms of Decision tree, k-NN (k-nearest neighbor algorithm), LDA (linear discriminant analysis), and SVM (support vector machine) were done by using the difference values of signal parameters subtracting baseline from the emotional state. Classification accuracy using LDA was 74.9% and the result of emotion recognition using Decision Tree showed that accuracy to recognize all emotions was 67.8%. In analysis of k-NN and SVM, classification accuracy was 62.0%. The result of emotion recognition shows that LDA is the best algorithm being able to classify pain, surprise, and boredom emotions. This led to better chance to recognize other emotions except human basic emotions and to assist more accurate and greater understanding on emotional interactions between man and machine based on physiological signals.

[1]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .

[2]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[3]  J. Arroyo-Palacios Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems , 2008 .

[4]  Philip D. Wasserman,et al.  Advanced methods in neural computing , 1993, VNR computer library.

[5]  A. Angrilli,et al.  Cardiac responses associated with affective processing of unpleasant film stimuli. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[6]  Christine L. Lisetti,et al.  Bio-sensing for Emotional Characterization without Word Labels , 2009, HCI.

[7]  Mann Oo. Hay Emotion recognition in human-computer interaction , 2012 .

[8]  Christine L. Lisetti,et al.  Emotion recognition from physiological signals using wireless sensors for presence technologies , 2004, Cognition, Technology & Work.

[9]  A. Ax The Physiological Differentiation between Fear and Anger in Humans , 1953, Psychosomatic medicine.

[10]  Vili Podgorelec,et al.  Decision Trees: An Overview and Their Use in Medicine , 2002, Journal of Medical Systems.

[11]  Nicu Sebe,et al.  MULTIMODAL EMOTION RECOGNITION , 2005 .

[12]  Chad L. Stephens,et al.  Autonomic specificity of basic emotions: Evidence from pattern classification and cluster analysis , 2010, Biological Psychology.

[13]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[14]  F. Boiten,et al.  Autonomic response patterns during voluntary facial action. , 1996, Psychophysiology.

[15]  Kazuhiko Takahashi Remarks on Emotion Recognition from Bio-Potential Signals , 2004 .

[16]  Rajita Sinha,et al.  Multivariate Response Patterning of Fear and Anger , 1996 .

[17]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Gerhard Stemmler,et al.  Physiological processes during emotion. , 2004 .

[19]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[20]  P. Drummond,et al.  The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians. , 2001, Psychophysiology.

[21]  A. Dittmar,et al.  Basic Emotions Evoked by Odorants Comparison Between Autonomic Responses and Self-Evaluation , 1997, Physiology & Behavior.