Gesture activated mobile edutainment (GAME): intercultural training of nonverbal behavior with mobile phones

An approach to intercultural training of nonverbal behavior is presented that draws from research on role-plays with virtual agents and ideas from situated learning. To this end, a mobile serious game is realized where the user acquires knowledge about German emblematic gestures and tries them out in role-plays with virtual agents. Gesture performance is evaluated making use of build-in acceleration sensors of smart phones. After an account of the theoretical background covering diverse areas like virtual agents, situated learning and intercultural training, the paper presents the GAME approach along with details on the gesture recognition and content authoring. By its experience-based role-plays with virtual characters, GAME brings together ideas from situated learning and intercultural training in an integrated approach and paves the way for new m-learning concepts.

[1]  Gert Jan Hofstede,et al.  Exploring Culture: Exercises, Stories and Synthetic Cultures , 2002 .

[2]  E. Hall,et al.  The Hidden Dimension , 1970 .

[3]  Jani Mäntyjärvi,et al.  Enabling fast and effortless customisation in accelerometer based gesture interaction , 2004, MUM '04.

[4]  Shane F. Almeida,et al.  Getting down to business : Teaching cross-cultural social interaction skills in a serious game , 2008 .

[6]  Matthias Rehm,et al.  Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions , 2008 .

[7]  Aaron Marcus,et al.  A Practical Set of Culture Dimensions for Global User-Interface Development , 2004, APCHI.

[8]  Stella Ting-Toomey.  Communicating Across Cultures , 1999 .

[9]  Jani Mäntyjärvi,et al.  Accelerometer-based gesture control for a design environment , 2006, Personal and Ubiquitous Computing.

[10]  Ana Paiva,et al.  Virtual learning intervention to reduce bullying victimization in primary school: a controlled trial. , 2010, Journal of child psychology and psychiatry, and allied disciplines.

[11]  Vridhagiri Ganeshan,et al.  Interkulturelle Kommunikation , 2000 .

[12]  Niels Henze,et al.  Gesture recognition with a Wii controller , 2008, TEI.

[13]  W. Lewis Johnson,et al.  Tactical Language and Culture Training Systems: Using Artificial Intelligence to Teach Foreign Languages and Cultures , 2008, AAAI.

[14]  R. Bhagat.  Culture's Consequences: Comparing Values, Behaviors, Institutions, and Organizations Across Nations , 2002 .

[15]  Hung-Hsuan Huang,et al.  From observation to simulation: generating culture-specific behavior for interactive systems , 2009, AI & SOCIETY.

[16]  Elisabeth André,et al.  Culture-specific communication management for virtual agents , 2009, AAMAS.

[17]  Elisabeth André,et al.  Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions , 2008, BCS HCI.

[18]  Milton J. Bennett.  A developmental approach to training for intercultural sensitivity , 1986 .

[19]  E. W. Gould,et al.  Crosscurrents: cultural dimensions and global Web user-interface design , 2000, INTR.

[20]  Ana Paiva,et al.  But that was in another country: agents and intercultural empathy , 2009, AAMAS.

[21]  M. Urban,et al.  Recognition of arm gestures using multiple orientation sensors: repeatability assessment , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[22]  Helga Losche.  Interkulturelle Kommunikation : Sammlung praktischer Spiele und Übungen , 2005 .

[23]  Justine Cassell,et al.  Human conversation as a system framework: designing embodied conversational agents , 2001 .

[24]  William Ferguson,et al.  Simulating scenarios for research on culture & cognition using a commercial role-play game , 2005, Proceedings of the Winter Simulation Conference, 2005..

[25]  David G. Novick,et al.  A Computational Model of Culture-Specific Conversational Behavior , 2007, IVA.

[26]  Gert Jan Hofstede,et al.  Cultures and Organizations - Software of the Mind: Intercultural Cooperation and its Importance for Survival (3. ed.) , 2010 .

[27]  W. Clancey.  A Tutorial on Situated Learning , 1995 .

[28]  Marc Hassenzahl,et al.  The Effect of Perceived Hedonic Quality on Product Appealingness , 2001, Int. J. Hum. Comput. Interact..