Social Puppets: Towards Modular Social Animation for Agents and Avatars

State-of-the-art computer graphics can give autonomous agents a compelling appearance as animated virtual characters. Typically the agents are directly responsible for controlling their graphical representation, but this places too much burden on the agents that already deal with difficult high-level tasks such as dialog planning. This paper presents work, done in the context of an interactive language and culture training system, on a new kind of engine that fits between the high level cognitive agent models and the animated graphics that represent them. This is a social engine that generates socially appropriate nonverbal behavior based on rules reflecting social norms. Similar to modular physics engines, the social engine introduces a re-usable component that can heighten believability of animated agents in games and simulations with relatively little effort.

[1]  Justine Cassell,et al.  BEAT: the Behavior Expression Animation Toolkit , 2001, Life-like characters.

[2]  Demetri Terzopoulos,et al.  Autonomous pedestrians , 2007, Graph. Model..

[3]  Hannes Högni Vilhjálmsson Animating Conversation in Online Games , 2004, ICEC.

[4]  Justine Cassell,et al.  Negotiated Collusion: Modeling Social Language and its Relationship Effects in Intelligent Agents , 2003, User Modeling and User-Adapted Interaction.

[5]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[6]  Elisabeth André,et al.  A Plug-and-Play Framework for Theories of Social Group Dynamics , 2006, IVA.

[7]  Elisabeth André,et al.  Lets Come Together - Social Navigation Behaviors of Virtual and Real Humans , 2005, INTETAIN.

[8]  Mel Slater,et al.  Building Expression into Virtual Characters , 2006, Eurographics.

[9]  Stacy Marsella,et al.  The DARWARS Tactical Language Training System , 2004 .

[10]  Marco Gillies,et al.  A Model of Interpersonal Attitude and Posture Generation , 2003, IVA.

[11]  M. Black Avatars , 2008, BMJ : British Medical Journal.

[12]  Stacy Marsella,et al.  Thespian: Modeling Socially Normative Behavior in a Decision-Theoretic Framework , 2006, IVA.

[13]  H. Vilhjálmsson,et al.  Engendering Believable Communicative Behaviors in Synthetic Entities for Tactical Language Training : An Interim Report , 2005 .

[14]  Stacy Marsella,et al.  Tactical Language Training System: An Interim Report , 2004, Intelligent Tutoring Systems.

[15]  Stacy Marsella,et al.  Thespian: using multi-agent fitting to craft interactive drama , 2005, AAMAS '05.

[16]  Catherine Pelachaud,et al.  Computational Model of Believable Conversational Agents , 2003, Communication in Multiagent Systems.

[17]  Mitsuru Ishizuka,et al.  Social role awareness in animated agents , 2001, AGENTS '01.

[18]  David Traum,et al.  Simulation of Small Group Discussions for Middle level of Detail Crowds , 2004 .

[19]  R. Rollefson,et al.  Army Science Conference , 1957 .

[20]  Ning Wang,et al.  The politeness effect: Pedagogical agents and learning outcomes , 2008, Int. J. Hum. Comput. Stud..

[21]  Ana Paiva,et al.  Synthetic group dynamics in entertainment scenarios: creating believable interactions in groups of synthetic characters , 2005, ACE '05.

[22]  Prasan Samtani,et al.  MissionEngine: Multi-system integration using Python in the Tactical Language Project , 2005 .

[23]  Stacy Marsella,et al.  Nonverbal Behavior Generator for Embodied Conversational Agents , 2006, IVA.

[24]  Claude Ghaoui,et al.  Encyclopedia of Human Computer Interaction , 2005 .

[25]  Kristinn R. Thórisson,et al.  Real-time decision making in multimodal face-to-face communication , 1998, AGENTS '98.

[26]  K. Chang,et al.  Embodiment in conversational interfaces: Rea , 1999, CHI '99.

[27]  Stacy Marsella,et al.  Evaluating the modeling and use of emotion in virtual humans , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[28]  Manfred Tscheligi,et al.  Proceedings of the international conference on Advances in computer entertainment technology , 2007, ACE 2008.

[29]  Matthias Rauterberg,et al.  Entertainment Computing – ICEC 2007 , 2007, Lecture Notes in Computer Science.

[30]  Stefan Kopp,et al.  Towards a Common Framework for Multimodal Generation: The Behavior Markup Language , 2006, IVA.

[31]  Alfred Mele,et al.  Autonomous agents , 1995 .