Storytelling Agents with Personality and Adaptivity

We explore the expression of personality and adaptivity through the gestures of virtual agents in a storytelling task. We conduct two experiments using four different dialogic stories. We manipulate agent personality on the extraversion scale, whether the agents adapt to one another in their gestural performance and agent gender. Our results show that subjects are able to perceive the intended variation in extraversion between different virtual agents, independently of the story they are telling and the gender of the agent. A second study shows that subjects also prefer adaptive to nonadaptive virtual agents.

[1]  Marilyn A. Walker,et al.  Entrainment in Pedestrian Direction Giving: How Many Kinds of Entrainment? , 2014, IWSDS.

[2]  Yukiko I. Nakano,et al.  Investigating culture-related aspects of behavior for virtual characters , 2013, Autonomous Agents and Multi-Agent Systems.

[3]  Fey Parrill,et al.  Seeing and Hearing Double: The Influence of Mimicry in Speech and Gesture on Observers , 2006 .

[4]  Marilyn A. Walker,et al.  Bossy or Wimpy: Expressing Social Dominance by Combining Gaze and Linguistic Behaviors , 2010, IVA.

[5]  Ning Wang,et al.  Creating Rapport with Virtual Agents , 2007, IVA.

[6]  Sotaro Kita,et al.  Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders , 1997, Gesture Workshop.

[7]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[8]  Alexis Héloir,et al.  EMBR: A realtime animation engine for interactive embodied agents , 2009, ACII.

[9]  W. T. Norman,et al.  Toward an adequate taxonomy of personality attributes: replicated factors structure in peer nomination personality ratings. , 1963, Journal of abnormal and social psychology.

[10]  Michael Neff,et al.  The Influence of Prosody on the Requirements for Gesture-Text Alignment , 2013, IVA.

[11]  Jean E. Fox Tree,et al.  Listening in on monologues and dialogues , 1999 .

[12]  S. Gosling,et al.  Personality in its natural habitat: manifestations and implicit folk theories of personality in daily life. , 2006, Journal of personality and social psychology.

[13]  Stefan Kopp,et al.  Synthesizing multimodal utterances for conversational agents , 2004, Comput. Animat. Virtual Worlds.

[14]  Ning Wang,et al.  The Politeness Effect: Pedagogical Agents and Learning Gains , 2005, AIED.

[15]  A. Thorne,et al.  Channeling Identity: A Study of Storytelling in Conversations Between Introverted and Extraverted Friends. , 2007, Journal of research in personality.

[16]  C. Nass,et al.  How “Real” Are Computer Personalities? , 1996 .

[17]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[18]  Maurizio Mancini,et al.  Implementing Expressive Gesture Synthesis for Embodied Conversational Agents , 2005, Gesture Workshop.

[19]  Timothy W. Bickmore,et al.  The comforting presence of relational agents , 2006, CHI Extended Abstracts.

[20]  R. Swanson,et al.  Identifying Personal Stories in Millions of Weblog Entries , 2009, ICWSM 2009.

[21]  Michael Neff,et al.  Judging IVA Personality Using an Open-Ended Question , 2013, IVA.

[22]  Norman I. Badler,et al.  Design of a Virtual Human Presenter , 2000, IEEE Computer Graphics and Applications.

[23]  Stefan Kopp,et al.  Increasing the expressiveness of virtual agents: autonomous generation of speech and gesture for spatial description tasks , 2009, AAMAS.

[24]  Marilyn A. Walker,et al.  Controlling User Perceptions of Linguistic Style: Trainable Generation of Personality Traits , 2011, CL.

[25]  Thomas Rist,et al.  WIP/PPP: automatic generation of personalized multimedia presentations , 1997, MULTIMEDIA '96.

[26]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[27]  Stacy Marsella,et al.  SmartBody: behavior realization for embodied conversational agents , 2008, AAMAS.

[28]  Alexis Héloir,et al.  EMBR: A realtime animation engine for interactive embodied agents , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[29]  Stefan Kopp,et al.  An Alignment-Capable Microplanner for Natural Language Generation , 2009, ENLG.

[30]  Michael Neff,et al.  Gestural Adaptation in Extravert-Introvert Pairs and Implications for IVAs , 2013 .

[31]  Claire Dormann,et al.  Embodied Conversational Agents on a Common Ground , 2004, From Brows to Trust.

[32]  Hans-Peter Seidel,et al.  Annotated New Text Engine Animation Animation Lexicon Animation Gesture Profiles MR : . . . JL : . . . Gesture Generation Video Annotated Gesture Script , 2007 .

[33]  Michael Neff,et al.  Evaluating the Effect of Gesture and Language on Personality Perception in Conversational Agents , 2010, IVA.

[34]  J. Bailenson,et al.  Digital Chameleons , 2005, Psychological science.

[35]  Michael Neff,et al.  Don't Scratch! Self-adaptors Reflect Emotional Stability , 2011, IVA.

[36]  Jackson Tolins,et al.  Addressee backchannels steer narrative development , 2014 .

[37]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.