Bigger (Gesture) Isn't Always Better

The literature suggests that familiarity and rapport are enhanced by larger, more extraverted gestures. However, the sizes of the increases in amplitude have not been reported. We sought to determine whether this relationship holds true for interaction between humans and embodied conversational agents. To this end, we conducted an experiment in which we increased gesture amplitude, with quantification of the gesture sizes. We hypothesized that rapport would be increased in the larger-gesture condition. However, our results were exactly the opposite: Rapport fell significantly in the larger-gesture condition. This means that larger may not always be better for building human-agent rapport. Our unexpected results may be because our agent’s gestures were simply too big, odd, awkward, or strange, or because of a statistical anomaly.

[1]  Timothy W. Bickmore,et al.  Maintaining reality: Relational agents for antipsychotic medication adherence , 2010, Interact. Comput..

[2]  Stacy Marsella,et al.  Virtual Rapport , 2006, IVA.

[3]  Daniel Gatica-Perez,et al.  How Do You Like Your Virtual Agent?: Human-Agent Interaction Experience through Nonverbal Features and Personality Traits , 2014, HBU.

[4]  Adam J. Sporka,et al.  Recognition of Personality Traits from Human Spoken Conversations , 2011, INTERSPEECH.

[5]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[6]  Dirk Heylen,et al.  First Impressions: Users' Judgments of Virtual Agents' Personality and Interpersonal Attitude in First Encounters , 2012, IVA.

[7]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[8]  A. Mehrabian,et al.  Inference of attitudes from nonverbal communication in two channels. , 1967, Journal of consulting psychology.

[9]  Michael Neff,et al.  Evaluating the Effect of Gesture and Language on Personality Perception in Conversational Agents , 2010, IVA.

[10]  Michael Neff,et al.  Storytelling Agents with Personality and Adaptivity , 2015, IVA.

[11]  Kallirroi Georgila,et al.  Verbal indicators of psychological distress in interactive dialogue with a virtual human , 2013, SIGDIAL Conference.

[12]  Hans-Peter Seidel,et al.  Annotated New Text Engine Animation Animation Lexicon Animation Gesture Profiles MR : . . . JL : . . . Gesture Generation Video Annotated Gesture Script , 2007 .

[13]  David G. Novick,et al.  Building Rapport between Human and ECA: A Pilot Study , 2014, HCI.

[14]  David G. Novick,et al.  Recorded Speech, Virtual Environments, and the Effectiveness of Embodied Conversational Agents , 2014, IVA.

[15]  Justine Cassell,et al.  Relational agents: a model and implementation of building user trust , 2001, CHI.

[16]  Jacqueline Brixey Virtual rapport with extraverted agents , 2015 .

[17]  P. Costa,et al.  Personality trait structure as a human universal. , 1997, The American psychologist.

[18]  Anton Leuski,et al.  Ada and Grace: Toward Realistic and Engaging Virtual Museum Guides , 2010, IVA.