Evaluating the Communication of Emotion via Expressive Gesture Copying Behaviour in an Embodied Humanoid Agent

We present an evaluation of copying behaviour in an embodied agent capable of processing expressivity characteristics of a user's movement and conveying aspects of it in real-time. The agent responds to affective cues from gestures performed by actors, producing synthesised gestures that exhibit similar expressive qualities. Thus, copying is performed only at the expressive level and information about other aspects of the gesture, such as the shape, is not retained. This research is significant to social interaction between agents and humans, for example, in cases where an agent wishes to show empathy with a conversational partner without an exact copying of their motions.

[1]  K. Scherer,et al.  A blueprint for affective computing: A sourcebook , 2010 .

[2]  K. Scherer,et al.  Introducing the Geneva Multimodal Emotion Portrayal (GEMEP) corpus , 2010 .

[3]  Antonio Camurri,et al.  Analysis of Expressive Gesture: The EyesWeb Expressive Gesture Processing Library , 2003, Gesture Workshop.

[4]  Hyniewska,et al.  Communicating emotional states with the Greta agent , 2010 .

[5]  Boone Rt,et al.  Children's Decoding of Emotion in Expressive Body Movement: The Development of Cue Attunement. , 1998 .

[6]  Peter Robinson,et al.  Detecting Affect from Non-stylised Body Motions , 2007, ACII.

[7]  J. Cunningham,et al.  Children's decoding of emotion in expressive body movement: the development of cue attunement. , 1998, Developmental psychology.

[8]  Nicolas Courty,et al.  Gesture in Human-Computer Interaction and Simulation , 2006 .

[9]  Stefan Kopp,et al.  Imitation Games with an Artificial Agent: From Mimicking to Understanding Shape-Related Iconic Gestures , 2003, Gesture Workshop.

[10]  Antonio Camurri,et al.  Gesture-Based Communication in Human-Computer Interaction , 2003, Lecture Notes in Computer Science.

[11]  Hatice Gunes,et al.  Automatic Temporal Segment Detection and Affect Recognition From Face and Body Display , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  H. Wallbott.  Bodily expression of emotion , 1998 .

[13]  C. Pelachaud,et al.  Emotion-Oriented Systems: The Humaine Handbook , 2011 .

[14]  Antonio Camurri,et al.  Developing multimodal interactive systems with EyesWeb XMI , 2007, NIME '07.

[15]  Ginevra Castellano,et al.  Recognising Human Emotions from Body Movement and Gesture Dynamics , 2007, ACII.

[16]  Stacy Marsella,et al.  Natural Behavior of a Listening Agent , 2005, IVA.

[17]  Caridakis,et al.  Body gesture and facial expression analysis for automatic affect recognition , 2010 .

[18]  Andrea Kleinsmith,et al.  A categorical approach to affective gesture recognition , 2003, Connect. Sci..

[19]  Maurizio Mancini,et al.  Design and evaluation of expressive gesture synthesis for embodied conversational agents , 2005, AAMAS '05.

[20]  Ana Paiva,et al.  Automatic analysis of affective postures and body motion to detect engagement with a game companion , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Antonio Camurri,et al.  Recognizing emotion from dance movement: comparison of spectator recognition and automated techniques , 2003, Int. J. Hum. Comput. Stud..

[22]  Maurizio Mancini,et al.  Analysis of Emotional Gestures for the Generation of Expressive Copying Behaviour in an Embodied Agent , 2009, Gesture Workshop.

[23]  Sophie Jörg,et al.  Investigating the role of body shape on the perception of emotion , 2009, TAP.

[24]  Andrea Kleinsmith,et al.  Recognizing Affective Dimensions from Body Posture , 2007, ACII.

[25]  Anton Nijholt,et al.  Virtual rap dancer: invitation to dance , 2006, CHI Extended Abstracts.

[26]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .