Emotion classification based on bio-signals emotion recognition using machine learning algorithms

Emotions are complex processes involving multiple response channels, including physiological systems, facial expressions and voices. Bio-signals reflect sequences of neural activity, which result in changes in autonomic and neuroendocrine systems induced by emotional events. Therefore in human-computer interaction researches, one of the most current interesting topics in emotion recognition is to recognize human's feeling using bio-signals. The aim of this study is to classify emotions (joy, sadness, anger, fear, surprise, and neutral) that human have often experienced in real life from multichannel bio-signals using machine learning algorithms. We have measured physiological responses of three-hundred participants for acquisition of bio-signals such as electrodermal activity, electrocardiograph, skin temperature, and photoplethysmo-graph during six emotions induction. Also, for emotion classification, we have extracted eighteen features from the signals and performed emotion classification using four algorithms, linear discriminant analysis, Naïve Bayes, classification and regression tree and support vector machine. The used algorithms were evaluated by only training, 10-fold cross-validation and repeated random sub-sampling validation. We have obtained recognition accuracy from 56.4 to 100% for only training and 39.2 to 53.9% for testing. Also, the result for testing showed that an accuracy of emotion recognition by Naïve Bayes was highest (53.9%) and lowest by support vector machine (39.2%). This means that Naïve Bayes is the best emotion recognition algorithm for basic emotions. This result can be helpful to provide the basis for the emotion recognition technique in human-computer interaction.

[1]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[2]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[3]  D. Kahneman,et al.  Well-being : the foundations of hedonic psychology , 1999 .

[4]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  L. F. Barrett,et al.  Affect as a Psychological Primitive. , 2009, Advances in experimental social psychology.

[6]  B. Fredrickson,et al.  Measurement issues in emotion research. , 1999 .

[7]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.

[8]  William R. Lovallo,et al.  Stress hormones in psychophysiological research: Emotional, behavioral, and cognitive implications. , 2000 .

[9]  Christine L. Lisetti,et al.  Emotion recognition from physiological signals using wireless sensors for presence technologies , 2004, Cognition, Technology & Work.

[10]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[11]  David A. Balota,et al.  Not All Negative Words Slow Down Lexical Decision and Naming Speed: Importance of Word Arousal , 2008 .

[12]  Nicu Sebe,et al.  MULTIMODAL EMOTION RECOGNITION , 2005 .

[13]  Joon-Hyuk Chang,et al.  Adaptive Kernel Function of SVM for Improving Speech/Music Classification of 3GPP2 SMV , 2011 .

[14]  P. Drummond,et al.  The effect of expressing anger on cardiovascular reactivity and facial blood flow in Chinese and Caucasians. , 2001, Psychophysiology.

[15]  J. Arroyo-Palacios Towards a Standardization in the Use of Physiological Signals for Affective Recognition Systems , 2008 .

[16]  E. Miller Handbook of Social Psychology , 1946, Mental Health.

[17]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[18]  Jennifer A. Healey,et al.  Wearable and automotive systems for affect recognition from physiology , 2000 .