Multimodal Corpus Analysis as a Method for Ensuring Cultural Usability of Embodied Conversational Agents

In this paper we propose the method of multimodal corpus analysis to collect enough empirical data for modeling the behavior of embodied conversational agents. This is a prerequisite to ensure the usability of such complex interactive systems. So far, the development of embodied agents suffers from a lack of explicit usability methods. In most cases, the consideration of usability aspects is constrained to preliminary user tests at the end of the development process.

[1]  Shalom H. Schwartz,et al.  Identifying Culture-Specifics in the Content and Structure of Values , 1995 .

[2]  Ipke Wachsmuth,et al.  Modelling Communication with Robots and Virtual Humans , 2008 .

[3]  Elisabeth André,et al.  The CUBE-G approach – Coaching culture-specific nonverbal behavior by virtual agents , 2007 .

[4]  Gert Jan Hofstede,et al.  Exploring Culture: Exercises, Stories and Synthetic Cultures , 2002 .

[5]  Robert Trappl,et al.  Agent Culture: Human-Agent Interaction in a Multicultural World , 2004 .

[6]  Matthias Rehm,et al.  Nonsymbolic Gestural Interaction for Ambient Intelligence , 2010, AmI 2010.

[7]  Toyoaki Nishida,et al.  Culture-Specific First Meeting Encounters between Virtual Agents , 2008, IVA.

[8]  P. Gallaher.  Individual differences in nonverbal behavior : dimensions of style , 1992 .

[9]  M. Studdert-Kennedy.  Hand and Mind: What Gestures Reveal About Thought. , 1994 .

[10]  Michael Neff,et al.  Towards Natural Gesture Synthesis: Evaluating Gesture Units in a Data-Driven Approach to Gesture Synthesis , 2007, IVA.

[11]  Shrikanth Narayanan,et al.  Tactical Language Training System: Supporting the Rapid Acquisition of Foreign Language and Cultural Skills , 2004 .

[12]  E. Hall,et al.  The Hidden Dimension , 1970 .

[13]  Stacy Marsella,et al.  Tactical Language Training System: An Interim Report , 2004, Intelligent Tutoring Systems.

[14]  R. McCrae,et al.  The Five-Factor Model of Personality Across Cultures , 2002 .

[15]  R. Bhagat.  Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations , 2002 .

[16]  Francisco Iacobelli,et al.  Ethnic Identity and Engagement in Embodied Conversational Agents , 2007, IVA.

[17]  Stacy Marsella,et al.  Nonverbal Behavior Generator for Embodied Conversational Agents , 2006, IVA.

[18]  Elisabeth André,et al.  From Annotated Multimodal Corpora to Simulated Human-Like Behaviors , 2006, ZiF Workshop.

[19]  Elisabeth André,et al.  More Than Just a Friendly Phrase: Multimodal Aspects of Polite Behavior in Agents , 2007 .

[20]  Yukiko I. Nakano,et al.  Towards a Model of Face-to-Face Grounding , 2003, ACL.

[21]  William Ferguson,et al.  Simulating scenarios for research on culture & cognition using a commercial role-play game , 2005, Proceedings of the Winter Simulation Conference, 2005..

[22]  Kostas Karpouzis,et al.  Virtual agent multimodal mimicry of humans , 2007, Lang. Resour. Evaluation.

[23]  David G. Novick,et al.  A Computational Model of Culture-Specific Conversational Behavior , 2007, IVA.