Locating nearby physical objects in augmented reality

Locating objects in physical environments can be an exhausting and frustrating task, particularly when these objects are out of the user's view or occluded by other objects. With recent advances in Augmented Reality (AR), these environments can be augmented to visualize objects for which the user searches. However, it is currently unclear which visualization strategy can best support users in locating these objects. In this paper, we compare a printed map to three different AR visualization strategies: (1) in-view visualization, (2) out-of-view visualization, and (3) the combination of in-view and out-of-view visualizations. Our results show that in-view visualization reduces error rates for object selection accuracy, while additional out-of-view object visualization improves users' search time performance. However, combining in-view and out-of-view visualizations leads to visual clutter, which distracts users.

[1]  Peter Kazanzides,et al.  Restoring the Awareness in the Occluded Visual Field for Optical See-Through Head-Mounted Displays , 2018, IEEE Transactions on Visualization and Computer Graphics.

[2]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[3]  Carl Gutwin,et al.  Wedge: clutter-free visualization of off-screen locations , 2008, CHI.

[4]  Anselmo Lastra,et al.  From Motion to Photons in 80 Microseconds: Towards Minimal Latency for Virtual and Augmented Reality , 2016, IEEE Transactions on Visualization and Computer Graphics.

[5]  Sebastian Boring,et al.  Augmented Reality Views for Occluded Interaction , 2019, CHI.

[6]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[7]  W Barfield,et al.  Situation awareness as a function of frame of reference, computer-graphics eyepoint elevation, and geometric field of view. , 1995, The International journal of aviation psychology.

[8]  Robert Xiao,et al.  Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays , 2016, CHI.

[9]  Gudrun Klinker,et al.  Supporting order picking with Augmented Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[10]  Susanne Boll,et al.  Visualizing out-of-view objects in head-mounted augmented reality , 2017, MobileHCI.

[11]  Shan Jiang,et al.  Intuitive visualization method for locating off-screen objects inspired by motion perception in peripheral vision , 2017, AH.

[12]  Yuichi Ohta,et al.  Visualization Methods for Outdoor See-Through Vision , 2006, IEICE Trans. Inf. Syst..

[13]  Stefanie Zollmann,et al.  Image-based X-ray visualization techniques for spatial understanding in outdoor augmented reality , 2014, OZCHI.

[14]  Stephen R. Ellis,et al.  Visual clutter management in augmented reality: Effects of three label separation methods on spatial judgments , 2009, 2009 IEEE Symposium on 3D User Interfaces.

[15]  Dieter Schmalstieg,et al.  Handheld augmented reality indoor navigation with activity-based instructions , 2011, Mobile HCI.

[16]  Nassir Navab,et al.  Towards Efficient Visual Guidance in Limited Field-of-View Head-Mounted Displays , 2018, IEEE Transactions on Visualization and Computer Graphics.

[17]  Susanne Boll,et al.  Beyond Halo and Wedge: visualizing out-of-view objects on head-mounted virtual and augmented reality devices , 2018, MobileHCI.

[18]  Tovi Grossman,et al.  Exploring the design space of multiscale 3D orientation , 2010, AVI.

[19]  Sungjae Hwang,et al.  Aroundplot: Focus+context interface for off-screen objects in 3D environments , 2011, Comput. Graph..

[20]  Henry Been-Lirn Duh,et al.  Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[21]  Valeria Herskovic,et al.  SidebARs: improving awareness of off-screen elements in mobile augmented reality , 2013, ChileCHI '13.

[22]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[23]  K. D. Duncan,et al.  TASK ANALYSIS AND TRAINING DESIGN. , 1967 .

[24]  Byron J. Pierce,et al.  Perceptual Issues in the Use of Head-Mounted Visual Displays , 2006, Hum. Factors.

[25]  Laurence Nigay,et al.  [POSTER] Halo3D: A Technique for Visualizing Off-Screen Points of Interest in Mobile Augmented Reality , 2017, 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[26]  Niels Henze,et al.  Experiments in the wild: public evaluation of off-screen visualizations in the Android market , 2010, NordiCHI.

[27]  Benjamin B. Bederson,et al.  A review of overview+detail, zooming, and focus+context interfaces , 2009, CSUR.

[28]  Kiyoshi Kiyokawa,et al.  Fisheye vision: peripheral spatial compression for improved field of view in head mounted displays , 2014, SUI.

[29]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[30]  Luca Chittaro,et al.  Visualizing locations of off-screen objects on mobile devices: a comparative evaluation of three approaches , 2006, Mobile HCI.

[31]  Didier Stricker,et al.  Continuous natural user interface: Reducing the gap between real and digital world , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[32]  Dieter Schmalstieg,et al.  Handheld Augmented Reality for underground infrastructure visualization , 2008, Personal and Ubiquitous Computing.

[33]  Ronald Azuma,et al.  Augmented-reality visualizations guided by cognition: perceptual heuristics for combining visible and obscured information , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[34]  Dieter Schmalstieg,et al.  Comprehensible Visualization for Augmented Reality , 2009, IEEE Transactions on Visualization and Computer Graphics.

[35]  Susanne Boll,et al.  EyeSee360: designing a visualization technique for out-of-view objects in head-mounted augmented reality , 2017, SUI.

[36]  Niels Henze,et al.  Visualization of off-screen objects in mobile augmented reality , 2010, Mobile HCI.

[37]  Wilko Heuten,et al.  EyeSeeX: Visualization of Out-of-View Objects on Small Field-of-View Augmented and Virtual Reality Devices , 2018, PerDis.

[38]  Manojit Sarkar,et al.  Graphical fisheye views , 1994, CACM.

[39]  Wataru Yamada,et al.  Expanding the Field-of-View of Head-Mounted Displays with Peripheral Blurred Images , 2016, UIST.

[40]  Simon J. Julier,et al.  Presence and discernability in conventional and non-photorealistic immersive augmented reality , 2014, 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[41]  Luca Chittaro,et al.  3D location-pointing as a navigation aid in Virtual Environments , 2004, AVI.

[42]  Jun Shingu,et al.  Camera pose navigation using Augmented Reality , 2010, 2010 IEEE International Symposium on Mixed and Augmented Reality.

[43]  Patrick Baudisch,et al.  Halo: a technique for visualizing off-screen objects , 2003, CHI '03.

[44]  Christian Sandor,et al.  Improving Spatial Perception for Augmented Reality X-Ray Vision , 2009, 2009 IEEE Virtual Reality Conference.