What do we express without knowing?: Emotion in Gesture

Emotional Gestural Expression is an aspect of nonverbal communication that is critical for social agents. The way we perform gestures provides both intentional and unintentional information, leaking our emotional state. In this paper, we analyze the perception of a group of base gestures under a wide set of modifications to understand how users perceive the emotional content of the movement, according to the valence and arousal dimensions of Russell'sCircumplex model. From these results, we are able to extract the perceived emotional quality of the base gesture forms and how the modifications shift that perception. An analysis is provided on the impact of different performance modifications of the gesture

[1]  Jonathan Gratch,et al.  Reading people's minds from emotion expressions in interdependent decision making. , 2014, Journal of personality and social psychology.

[2]  Jean-Claude Martin,et al.  Gesture and emotion: Can basic gestural form features discriminate emotions? , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[3]  Yukiko I. Nakano,et al.  MACK: Media lab Autonomous Conversational Kiosk , 2002 .

[4]  Norman I. Badler,et al.  The effect of posture and dynamics on the perception of emotion , 2013, SAP.

[5]  Ekaterina P. Volkova,et al.  Emotion categorization of body expressions in narrative scenarios , 2014, Front. Psychol..

[6]  Catherine Pelachaud,et al.  Perception of Emotions and Body Movement in the Emilya Database , 2018, IEEE Transactions on Affective Computing.

[7]  Stacy Marsella,et al.  Gesture with Meaning , 2013, IVA.

[8]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[9]  Michael Neff,et al.  A Corpus of Gesture-Annotated Dialogues for Monologue-to-Dialogue Generation from Personal Narratives , 2016, LREC.

[10]  Koen V. Hindriks,et al.  Mood expression through parameterized functional behavior of robots , 2013, 2013 IEEE RO-MAN.

[11]  Joseph Bates,et al.  The role of emotion in believable agents , 1994, CACM.

[12]  C. Creider.  Hand and Mind: What Gestures Reveal about Thought , 1994 .

[13]  Radoslaw Niewiadomski,et al.  Greta: an interactive expressive ECA system , 2009, AAMAS.

[14]  Maurizio Mancini,et al.  Implementing Expressive Gesture Synthesis for Embodied Conversational Agents , 2005, Gesture Workshop.

[15]  Maurizio Mancini,et al.  Design and evaluation of expressive gesture synthesis for embodied conversational agents , 2005, AAMAS '05.

[16]  Michael Kipp,et al.  Gesture generation by imitation: from human behavior to computer character animation , 2005 .

[17]  Michael Neff,et al.  Understanding the impact of animated gesture performance on personality perceptions , 2017, ACM Trans. Graph..

[18]  Jon Sprouse.  A validation of Amazon Mechanical Turk for the collection of acceptability judgments in linguistic theory , 2010, Behavior research methods.

[19]  Martijn Goudbeek,et al.  Perceived Gesture Dynamics in Nonverbal Expression of Emotion , 2013, Perception.