From the lab to the real-world: An investigation on the influence of human movement on Emotion Recognition using physiological signals

The recognition of human emotions using physiological signals such as Electrodermal Activity (EDA), Electrocardiogram (ECG) or Electromyography (EMG), has been extensively researched in the past attracting a lot of interest during the last few decades. Although showing a relatively satisfactory performance under lab conditions, Emotion Recognition (ER) systems using physiological signals are not widely used in real-world scenarios. One important fact is that, in the real world, physiological signals may be influenced by human movement and therefore, they cannot be used as a unique indicative of emotions. In this paper, we investigate the influence of human movement on ER using physiological signals. We compare different measures of emotion before and after a test person has performed some physical activity (e.g. walking, going upstairs). We discuss the main differences between recognizing emotions in the lab and the real world and provide new insights into the development of ER systems in real-world scenarios.

[1]  P. Ekman,et al.  Approaches To Emotion , 1985 .

[2]  Elisabeth André,et al.  Emotion recognition based on physiological changes in music listening , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[4]  H. Prendinger,et al.  Emotion Recognition from Electromyography and Skin Conductance , 2005 .

[5]  Christine L. Lisetti,et al.  A User-Modeling Approach to Build User's Psycho-Physiological Maps of Emotions using Bio-Sensors , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[6]  Masood Mehmood Khan,et al.  Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature , 2009, TAP.

[7]  M. Glickman,et al.  Studying Protein Ubiquitylation in Yeast. , 2016, Methods in molecular biology.

[8]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[9]  Thierry Pun,et al.  Valence-arousal evaluation using physiological signals in an emotion recall paradigm , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[10]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[11]  R. Levenson Emotion and the autonomic nervous system: A prospectus for research on autonomic specificity. , 1988 .

[12]  K. Scherer What are emotions? And how can they be measured? , 2005 .

[13]  E. Jang,et al.  Identification of the optimal emotion recognition algorithm using physiological signals , 2012, 2011 2nd International Conference on Engineering and Industries (ICEI).

[14]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jason Williams,et al.  Emotion Recognition Using Bio-sensors: First Steps towards an Automatic System , 2004, ADS.