A Visual Interaction Cue Framework from Video Game Environments for Augmented Reality

Based on an analysis of 49 popular contemporary video games, we develop a descriptive framework of visual interaction cues in video games. These cues are used to inform players what can be interacted with, where to look, and where to go within the game world. These cues vary along three dimensions: the purpose of the cue, the visual design of the cue, and the circumstances under which the cue is shown. We demonstrate that this framework can also be used to describe interaction cues for augmented reality applications. Beyond this, we show how the framework can be used to generatively derive new design ideas for visual interaction cues in augmented reality experiences.

[1]  Dieter Schmalstieg,et al.  Scalable Techniques for Collaborative Outdoor Augmented Reality , 2004 .

[2]  三嶋 博之.  The theory of affordances , 2008 .

[3]  Paul A. Cairns,et al.  Removing the HUD: The Impact of Non-Diegetic Game Elements and Expertise on Player Involvement , 2015, CHI PLAY.

[4]  Kristine Jørgensen,et al.  Between the Game System and the Fictional World , 2012, Games Cult..

[5]  Christian Sandor,et al.  Improving Spatial Perception for Augmented Reality X-Ray Vision , 2009, 2009 IEEE Virtual Reality Conference.

[6]  Dieter Schmalstieg,et al.  Navigation Techniques in Augmented and Mixed Reality: Crossing the Virtuality Continuum , 2011, Handbook of Augmented Reality.

[7]  Jesse Schell,et al.  The Art of Game Design: A book of lenses , 2019 .

[8]  Michael Thornton Wyman,et al.  2 – World of Warcraft , 2011 .

[9]  R. Shaw,et al.  Perceiving, Acting and Knowing : Toward an Ecological Psychology , 1978 .

[10]  Arindam Dey,et al.  Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality , 2009, 2010 IEEE Virtual Reality Conference (VR).

[11]  J. Schell.  The Art of Game Design: A Book of Lenses, Second Edition , 2014 .

[12]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[13]  Tobias Höllerer,et al.  Interactive tools for virtual x-ray vision in mobile augmented reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[14]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[15]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[16]  Marco Roccetti,et al.  Assessing the efficacy of a diegetic game interface with Oculus Rift , 2016, 2016 13th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[17]  Jacques Carette,et al.  Evaluating the effectiveness of HUDs and diegetic ammo displays in first-person shooter games , 2015, 2015 IEEE Games Entertainment Media Conference (GEM).

[18]  Stuart Cunningham,et al.  Game Sound Technology and Player Interaction : Concepts and Developments , 2013 .

[19]  Alex Musa,et al.  The Witcher 3 - Wild Hunt , 2016 .

[20]  Bruce H. Thomas,et al.  User evaluation of see-through vision for mobile outdoor augmented reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.