Body Buddies: Social Signaling through Puppeteering

While virtual worlds have evolved to provide a good medium for social communication, they are very primitive in their social and affective communication design. The social communication methods within these worlds have progressed from early text-based social worlds, e.g. MUDS (multi-user dungeons) to 3D graphical interfaces with avatar control, such as Second Life. Current communication methods include triggering gestures by typed commands, and/or selecting a gesture by name through the user interface. There are no agreed-upon standards for organizing such gestures or interfaces. In this paper, we address this problem by discussing a Unity-based avatar pupeteering prototype we developed called Body Buddies. Body Buddies sits on top of the communication program Skype, and provides additional modalities for social signaling through avatar pupeteering. Additionally, we discuss results from an exploratory study we conducted to investigate how people use the interface. We also outline steps to continuously develop and evolve Body Buddies.

[1]  E. Hall,et al.  Proxemics [and Comments and Replies] , 1968, Current Anthropology.

[2]  Nigel Simpson,et al.  Porta-person: telepresence for the connected conference room , 2007, CHI Extended Abstracts.

[3]  Mark Steedman,et al.  Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents , 1994, SIGGRAPH.

[4]  Ray L. Birdwhistell,et al.  Introduction to kinesics : an annotation system for analysis of body motion and gesture , 1952 .

[5]  Jeremy N. Bailenson,et al.  Gaze and task performance in shared virtual environments , 2002, Comput. Animat. Virtual Worlds.

[6]  Alex Pentland,et al.  Social signal processing: state-of-the-art and future perspectives of an emerging domain , 2008, ACM Multimedia.

[7]  Daniel Thalmann,et al.  Nonverbal communication interface for collaborative virtual environments , 1999, Virtual Reality.

[8]  JAMES ANDERSON,et al.  Presence and Usability in Shared Space Virtual Conferencing: A Participatory Design Study , 2001, Cyberpsychology Behav. Soc. Netw..

[9]  Ann Lantz,et al.  Meetings in a distributed group of experts: Comparing face-to-face, chat and collaborative virtual environments , 2001, Behav. Inf. Technol..

[10]  S. Drucker,et al.  The Role of Eye Gaze in Avatar Mediated Conversational Interfaces , 2000 .

[11]  N. Sadat Shami,et al.  Avatars meet meetings: design issues in integrating avatars in distributed corporate meetings , 2010, GROUP.

[12]  Jeremy N. Bailenson,et al.  Intelligent Agents Who Wear Your Face: Users' Reactions to the Virtual Self , 2001, IVA.

[13]  E. Hall,et al.  The Hidden Dimension , 1970 .

[14]  John Bowers,et al.  Talk and embodiment in collaborative virtual environments , 1996, CHI.

[15]  P. Ekman,et al.  The Repertoire of Nonverbal Behavior: Categories, Origins, Usage, and Coding , 1969 .

[16]  Jeffrey Ventrella,et al.  Virtual Body Language , 2011 .

[17]  Steve Benford,et al.  MASSIVE: a collaborative virtual environment for teleconferencing , 1995, TCHI.

[18]  Emmanuel Frécon,et al.  Building distributed virtual environments to support collaborative work , 1998, VRST '98.

[19]  Jeremy N. Bailenson,et al.  The Unbearable Likeness of Being Digital: The Persistence of Nonverbal Social Norms in Online Virtual Environments , 2007, Cyberpsychology Behav. Soc. Netw..

[20]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[21]  K. Allmendinger Social Presence in Synchronous Virtual Learning Situations: The Role of Nonverbal Signals Displayed by Avatars , 2010 .

[22]  J. Cassell Computer Vision for Human–Machine Interaction: A Framework for Gesture Generation and Interpretation , 1998 .

[23]  A. Pentland,et al.  Computer Vision for Human–Machine Interaction: A Framework for Gesture Generation and Interpretation , 1998 .

[24]  D. McNeill Gesture and Thought , 2005 .

[25]  Genny Tortora,et al.  SLMeeting: supporting collaborative work in Second Life , 2008, AVI '08.

[26]  Mel Slater,et al.  Spatial Social Behavior in Second Life , 2007, IVA.