Exploring real world points of interest: Design and evaluation of object-centric exploration techniques for augmented reality

Abstract Augmented reality (AR) enables users to retrieve additional information about real world objects and locations. Exploring such location-based information in AR requires physical movement to different viewpoints, which may be tiring and even infeasible when viewpoints are out of reach. In this paper, we present object-centric exploration techniques for handheld AR that allow users to access information freely using a virtual copy metaphor. We focus on the design of techniques that allows the exploration of large real world objects. We evaluated our interfaces in a series of studies in controlled conditions and compared them to a 3D map interface, which is a more common method for accessing location-based information. Based on our findings, we put forward design recommendations that should be considered by future generations of location-based AR browsers, 3D tourist guides or situated urban planning.

[1]  Holger Regenbrecht,et al.  Techniques for view transition in multi-camera outdoor environments , 2010, Graphics Interface.

[2]  George W. Fitzmaurice,et al.  Safe 3D navigation , 2008, I3D '08.

[3]  Dieter Schmalstieg,et al.  360° panoramic overviews for location-based services , 2012, CHI.

[4]  Ivan Poupyrev,et al.  The MagicBook - Moving Seamlessly between Reality and Virtuality , 2001, IEEE Computer Graphics and Applications.

[5]  Dieter Schmalstieg,et al.  Exploring Distant Objects with Augmented Reality , 2013, EGVE/EuroVR.

[6]  Arindam Dey,et al.  Egocentric space-distorting visualizations for rapid environment exploration in mobile mixed reality , 2009, 2010 IEEE Virtual Reality Conference (VR).

[7]  Steven K. Feiner,et al.  An annotated situation-awareness aid for augmented reality , 2002, UIST '02.

[8]  Timo Engelke,et al.  The House of Olbrich — An Augmented Reality tour through architectural history , 2011, 2011 IEEE International Symposium on Mixed and Augmented Reality - Arts, Media, and Humanities.

[9]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[10]  Antti Oulasvirta,et al.  Embodied interaction with a 3D versus 2D mobile map , 2009, Personal and Ubiquitous Computing.

[11]  George W. Fitzmaurice,et al.  HoverCam: interactive 3D navigation for proximal object inspection , 2005, I3D '05.

[12]  Nassir Navab,et al.  Laparoscopic Virtual Mirror for Understanding Vessel Structure Evaluation Study by Twelve Surgeons , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[13]  Thomas Grechenig,et al.  Comparing viewing and filtering techniques for mobile urban exploration , 2011, J. Locat. Based Serv..

[14]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[15]  Tobias Höllerer,et al.  A hand-held AR magic lens with user-perspective rendering , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[16]  Dieter Schmalstieg,et al.  Exploring Distant Real World Objects with Augmented Reality , 2013 .

[17]  Dieter Schmalstieg,et al.  Zooming interfaces for augmented reality browsers , 2010, Mobile HCI.

[18]  Mark Billinghurst,et al.  Moving Between Contexts - A User Evaluation of a Transitional Interface , 2008 .

[19]  Naokazu Yokoya,et al.  A collaboration support technique by integrating a shared virtual reality and a shared augmented reality , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[20]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[21]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[22]  Steven K. Feiner,et al.  Quick viewpoint switching for manipulating virtual objects in hand-held augmented reality using stored snapshots , 2012, 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[23]  Bruce H. Thomas,et al.  Augmented Viewport: An action at a distance technique for outdoor AR using distant and zoom lens cameras , 2010, International Symposium on Wearable Computers (ISWC) 2010.

[24]  B. Pröll,et al.  Context-awareness in Mobile Tourism Guides – A Comprehensive Survey , 2005 .

[25]  Victor Ng,et al.  Mirrormap: augmenting 2d mobile maps with virtual mirrors , 2011, Mobile HCI.

[26]  Christian Sandor,et al.  Improving Spatial Perception for Augmented Reality X-Ray Vision , 2009, 2009 IEEE Virtual Reality Conference.

[27]  Tobias Höllerer,et al.  The Effects of Visual Realism on Search Tasks in Mixed Reality Simulation , 2013, IEEE Transactions on Visualization and Computer Graphics.

[28]  Tobias Höllerer,et al.  The role of latency in the validity of AR simulation , 2010, 2010 IEEE Virtual Reality Conference (VR).

[29]  Tobias Höllerer,et al.  Interactive tools for virtual x-ray vision in mobile augmented reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[30]  David D. Woods,et al.  Visual Momentum: A Concept to Improve the Cognitive Coupling of Person and Computer , 1984, Int. J. Man Mach. Stud..

[31]  Doug A. Bowman,et al.  Travel in immersive virtual environments: an evaluation of viewpoint motion control techniques , 1997, Proceedings of IEEE 1997 Annual International Symposium on Virtual Reality.

[32]  Matthias Trapp,et al.  Interactive Rendering Techniques for Highlighting in 3D Geovirtual Environments , 2011 .

[33]  Dieter Schmalstieg,et al.  Extended Overview Techniques for Outdoor Augmented Reality , 2012, IEEE Transactions on Visualization and Computer Graphics.