Natural interaction with culturally adaptive virtual characters

Recently, the verbal and non-verbal behavior of virtual characters has become more and more sophisticated due to advances in behavior planning and rendering. Nevertheless, the appearance and behavior of these characters is in most cases based on the cultural background of their designers. Especially in combination with new natural interaction interfaces, there is the risk that characters developed for a particular culture might not find acceptance when being presented to another culture. A few attempts have been made to create characters that reflect a particular cultural background. However, interaction with these characters still remains an awkward experience in particular when it comes to non-verbal interaction. In many cases, human users either have to choose actions from a menu their avatar has to execute or they have to struggle with obtrusive interaction devices. In contrast, our paper combines an approach to the generation of culture-specific behaviors with full body avatar control based on the Kinect sensor. A first study revealed that users are able to easily control an avatar through their body movements and immediately adapt its behavior to the cultural background of the agents they interact with.

[1]  E. Hall,et al.  The Hidden Dimension , 1970 .

[2]  O. Watson,et al.  Proxemic Behavior: A Cross-Cultural Study. , 1971 .

[3]  A. Pease,et al.  Body Language: How to Read Others''Thoughts by Their Gestures (Overcoming Common Problems). Sheldon , 1981 .

[4]  H. Rosenfeld,et al.  Influence of culture, language, and sex on conversational distance. , 1982 .

[5]  A. Kendon Conducting Interaction: Patterns of Behavior in Focused Encounters , 1990 .

[6]  Gary P. Ferraro,et al.  The Cultural Dimension of International Business , 1990 .

[7]  J. Cassell,et al.  Embodied conversational agents , 2000 .

[8]  C. Nass,et al.  Truth is beauty: researching embodied conversational agents , 2001 .

[9]  Jeremy N. Bailenson,et al.  Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments , 2001, Presence: Teleoperators & Virtual Environments.

[10]  M. Rehm,et al.  Proceedings of AAMAS , 2005 .

[11]  M. Broadway,et al.  Exploring Culture: Exercises, Stories, and Synthetic Cultures. , 2006 .

[12]  David G. Novick,et al.  A Computational Model of Culture-Specific Conversational Behavior , 2007, IVA.

[13]  Antonella De Angeli,et al.  Mapping the demographics of virtual humans , 2007 .

[14]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[15]  Antonella De Angeli,et al.  Mapping the demographics of virtual humans , 2007, BCS HCI.

[16]  Matthias Rehm,et al.  Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions , 2008 .

[17]  W. Lewis Johnson,et al.  Tactical Language and Culture Training Systems: Using Artificial Intelligence to Teach Foreign Languages and Cultures , 2008, AAAI.

[18]  Ana Paiva,et al.  But that was in another country: agents and intercultural empathy , 2009, AAMAS.

[19]  Ana Paiva,et al.  Using rituals to express cultural differences in synthetic characters , 2009, AAMAS.

[20]  Catherine Pelachaud,et al.  Studies on gesture expressivity for a virtual agent , 2009, Speech Commun..

[21]  Hannes Högni Vilhjálmsson,et al.  SPONTANEOUS AVATAR BEHAVIOR FOR HUMAN TERRITORIALITY , 2010, Appl. Artif. Intell..

[22]  Alon Lerner,et al.  Enhanced interactive gaming by blending full-body tracking and gesture animation , 2010, SA '10.

[23]  Elisabeth André,et al.  Full Body Gestures Enhancing a Game Book for Interactive Story Telling , 2011, ICIDS.

[24]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[25]  Yukiko I. Nakano,et al.  Culture-Related Topic Selection in Small Talk Conversations across Germany and Japan , 2011, IVA.

[26]  Yukiko I. Nakano,et al.  Culture-related differences in aspects of behavior for virtual characters across Germany and Japan , 2011, AAMAS.

[27]  Michael Rohs,et al.  Protractor3D: a closed-form solution to rotation-invariant 3D gestures , 2011, IUI '11.

[28]  Peter Huber,et al.  Individualized Agent Interactions , 2011, MIG.