Technique for automatic emotion recognition by body gesture analysis

This paper illustrates our recent work on the analysis of expressive gesture related to the motion of the upper body (the head and the hands) in the context of emotional portrayals performed by professional actors. An experiment is presented which is the result of a multidisciplinary joint work. The experiment aims at (i) developing models and algorithms for analysis of such expressive content (ii) individuating which motion cues are involved in conveying the actorpsilas expressive intentions to portray four emotions (anger, joy, relief, sadness) via a scenario approach. The paper discusses the experiment in detail with reference to related conceptual issues, developed techniques, and the obtained results.

[1]  K. Scherer,et al.  Bodily expression of emotion , 2009 .

[2]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[3]  Antonio Camurri,et al.  Developing multimodal interactive systems with EyesWeb XMI , 2007, NIME '07.

[4]  Rosalind W. Picard.  Affective Computing , 1997 .

[5]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[6]  M. D. Meijer.  The contribution of general features of body movement to the attribution of emotions , 1989 .

[7]  C. C. Wood,et al.  The ɛ-Adjustment Procedure for Repeated-Measures Analyses of Variance , 1976 .

[8]  R. Blake,et al.  Perception of human motion. , 2007, Annual review of psychology.

[9]  Ginevra Castellano,et al.  Recognising Human Emotions from Body Movement and Gesture Dynamics , 2007, ACII.

[10]  P. Juslin,et al.  Emotional Expression in Music Performance: Between the Performer's Intention and the Listener's Experience , 1996 .

[11]  A. Kirschmann,et al.  Lectures on human and animal psychology. , 2022 .

[12]  Peter F. Driessen,et al.  Gesture-Based Affective Computing on Motion Capture Data , 2005, ACII.

[13]  Peter Robinson,et al.  Detecting Affect from Non-stylised Body Motions , 2007, ACII.

[14]  J. Russell.  A circumplex model of affect. , 1980 .

[15]  Klaus R. Scherer,et al.  Using Actor Portrayals to Systematically Study Multimodal Emotion Expression: The GEMEP Corpus , 2007, ACII.

[16]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.