Traveller: An Interactive Cultural Training System Controlled by User-Defined Body Gestures

In this paper, we describe a cultural training system based on an interactive storytelling approach and a culturally-adaptive agent architecture, for which a user-defined gesture set was created. 251 full body gestures by 22 users were analyzed to find intuitive gestures for the in-game actions in our system. After the analysis we integrated the gestures in our application using our framework for full body gesture recognition. We further integrated a second interaction type which applies a graphical interface controlled with freehand swiping gestures.

[1]  A. Campbell,et al.  Progress in Artificial Intelligence , 1995, Lecture Notes in Computer Science.

[2]  Gert Jan Hofstede,et al.  Cultures and Organizations - Software of the Mind: Intercultural Cooperation and its Importance for Survival (3. ed.) , 2010 .

[3]  C. Mora.  Cultures and Organizations: Software of the Mind Intercultural Cooperation and Its Importance for Survival , 2013 .

[4]  Ana Paiva,et al.  Feeling and Reasoning: A Computational Model for Emotional Characters , 2005, EPIA.

[5]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[6]  Michael P. Georgeff,et al.  Decision-Making in an Embedded Reasoning System , 1989, IJCAI.

[7]  Elisabeth André,et al.  Studying user-defined iPad gestures for interaction in multi-display environment , 2012, IUI '12.

[8]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[9]  Mohammad Obaid,et al.  User-Defined Body Gestures for Navigational Control of a Humanoid Robot , 2012, ICSR.

[10]  Ana Paiva,et al.  FAtiMA Modular: Towards an Agent Architecture with a Generic Appraisal Framework , 2014, Emotion Modeling.

[11]  Ionut Damian,et al.  Natural interaction with culturally adaptive virtual characters , 2012, Journal on Multimodal User Interfaces.

[12]  Ana Paiva,et al.  ION Framework - A Simulation Environment for Worlds with Virtual Agents , 2009, IVA.

[13]  Ana Paiva,et al.  "Can I ask you a favour?": a relational model of socio-cultural behaviour , 2013, AAMAS.

[14]  Gert Jan Hofstede,et al.  Synthetic Cultures: Intercultural Learning Through Simulation Games , 1999 .

[15]  T. D. Kemper,et al.  Status, Power and Ritual Interaction: A Relational Reading of Durkheim, Goffman and Collins , 2013 .

[16]  Elisabeth André,et al.  User-Defined Body Gestures for an Interactive Storytelling Scenario , 2013, INTERACT.