An integrated design flow in user interface and interaction for enhancing mobile AR gaming experiences

Interaction is a prominent feature that distinguishes computer (video) games from other kinds of entertainment [1, 2]. Given that Augmented Reality (AR) presentations enable the creation of user interactions that expand traditional HCI from 2D to 3D spaces, this offer an ideal opportunity for game developers to design more playful and interesting mobile AR games that embed various interaction forms. This paper introduces a mobile AR cooking game that is based on the integration of adopted AR interaction and user interface principles in its design flow. These embedded interactions are designed with considerations and spatial mappings to real cooking mechanisms in order to provide a unique gaming experience and increased engagement for a better overall AR interaction on the multimodal mobile device.

[1]  Arnd Vitzthum.  SSIML/AR: A Visual Language for the Abstract Specification of Augmented Reality User Interfaces , 2006, 3D User Interfaces (3DUI'06).

[2]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[3]  Fotis Liarokapis,et al.  Design experiences of multimodal mixed reality interfaces , 2007, SIGDOC '07.

[4]  Christian Geiger,et al.  3D-registered interaction-surfaces in augmented reality space , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[5]  Mark Billinghurst,et al.  Using a mobile phone for 6 DOF mesh editing , 2007, CHINZ.

[6]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[7]  Andrea Phillips.  Games in AR: Types and technologies , 2009, 2009 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media and Humanities.

[8]  S. DiVerdi,et al.  A framework for generic inter-application interaction for 3D AR environments , 2003, 2003 IEEE International Augmented Reality Toolkit Workshop.

[9]  Didier Stricker,et al.  Continuous natural user interface: Reducing the gap between real and digital world , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[10]  Christian Sandor,et al.  A rapid prototyping software infrastructure for user interfaces in ubiquitous augmented reality , 2005, Personal and Ubiquitous Computing.

[11]  M. Chalmers,et al.  Seamful and Seamless Design in Ubiquitous Computing , 2003 .

[12]  P. Vorderer.  Interactive entertainment and beyond , 2000 .

[13]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[14]  Michele D. Dickey.  Engaging by design: How engagement strategies in popular computer and video games can inform instructional design , 2005 .

[15]  T. Grodal.  Video Games and the Pleasure of Control , 2000 .

[16]  Fotis Liarokapis,et al.  Mobile augmented reality techniques for GeoVisualisation , 2005, Ninth International Conference on Information Visualisation (IV'05).

[17]  Ivan Poupyrev,et al.  Tangible Augmented Reality for Human Computer Interaction , 2002 .