The effect of posture and dynamics on the perception of emotion

Motion capture remains a popular and widely-used method for animating virtual characters. However, all practical applications of motion capture rely on motion editing techniques to increase the reusability and flexibility of captured motions. Because humans are proficient in detecting and interpreting subtle details in human motion, understanding the perceptual consequences of motion editing is essential. Thus in this work, we perform three experiments to gain a better understanding of how motion editing might affect the emotional content of a captured performance, particularly changes in posture and dynamics, two factors shown to be important perceptual indicators of bodily emotions. In these studies, we analyse the properties (angles and velocities) and perception (recognition rates and perceived intensities) of a varied set of full-body motion clips representing the six emotions anger, disgust, fear, happiness, sadness, and surprise. We have found that emotions are mostly conveyed through the upper body, that the perceived intensity of an emotion can be reduced by blending with a neutral motion, and that posture changes can alter the perceived emotion but subtle changes in dynamics only alter the intensity.

[1]  P. Ekman Are there basic emotions? , 1992, Psychological review.

[2]  Ken-ichi Anjyo,et al.  Fourier principles for emotion-based human figure animation , 1995, SIGGRAPH.

[3]  Ken Perlin,et al.  Real Time Responsive Animation with Personality , 1995, IEEE Trans. Vis. Comput. Graph..

[4]  Kenji Amaya,et al.  Emotion from Motion , 1996, Graphics Interface.

[5]  H. Wallbott Bodily expression of emotion , 1998 .

[6]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[7]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.

[8]  Armin Bruderlin,et al.  Perceiving affect from arm movement , 2001, Cognition.

[9]  M. Frank,et al.  The forced-choice paradigm and the perception of facial expressions of emotion. , 2001, Journal of personality and social psychology.

[10]  Nadia Magnenat-Thalmann,et al.  A Model for Personality and Emotion Simulation , 2003, KES.

[11]  M. Sawada,et al.  Expression of Emotions in Dance: Relation between Arm Movement Characteristics and Emotion , 2003, Perceptual and motor skills.

[12]  Nancy S. Pollard,et al.  Perceptual metrics for character animation: sensitivity to errors in ballistic motion , 2003, ACM Trans. Graph..

[13]  Georgios C. Anagnostopoulos,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2003, Lecture Notes in Computer Science.

[14]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[15]  Mark C. Coulson Attributing Emotion to Static Body Postures: Recognition Accuracy, Confusions, and Viewpoint Dependence , 2004 .

[16]  A. Young,et al.  Emotion Perception from Dynamic and Static Body Expressions in Point-Light and Full-Light Displays , 2004, Perception.

[17]  Kari Pulli,et al.  Style translation for human motion , 2005, SIGGRAPH 2005.

[18]  Jessica K. Hodgins,et al.  Analyzing the physical correctness of interpolated human motion , 2005, SCA '05.

[19]  Maurizio Mancini,et al.  Implementing Expressive Gesture Synthesis for Embodied Conversational Agents , 2005, Gesture Workshop.

[20]  James M. Rehg,et al.  A data-driven approach to quantifying natural human motion , 2005, ACM Trans. Graph..

[21]  James Diebel,et al.  Representing Attitude : Euler Angles , Unit Quaternions , and Rotation Vectors , 2006 .

[22]  Yong Cao,et al.  Style components , 2006, Graphics Interface.

[23]  Andrea Kleinsmith,et al.  Cross-cultural differences in recognizing affect from body posture , 2006, Interact. Comput..

[24]  Lorenzo Torresani,et al.  Learning Motion Style Synthesis from Perceptual Observations , 2006, NIPS.

[25]  Elizabeth A. Crane,et al.  Motion Capture and Emotion: Affect Detection in Whole Body Movement , 2007, ACII.

[26]  Ronald Poppe,et al.  Person or Puppet? The Role of Stimulus Realism in Attributing Emotion to Static Body Postures , 2007, ACII.

[27]  Sophie Jörg,et al.  Evaluating the emotional content of human motions on real and virtual characters , 2008, APGV '08.

[28]  Claire L. Roether,et al.  Critical features for the perception of emotion from gait. , 2009, Journal of vision.

[29]  Andrea Lockerd Thomaz,et al.  Stylized motion generalization through adaptation of velocity profiles , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[30]  Ludovic Hoyet,et al.  Evaluating the plausibility of edited throwing animations , 2012, SCA '12.

[31]  Arjan Egges,et al.  Perception of Complex Emotional Body Language of a Virtual Character , 2012, MIG.