Getting out of Out of Sight: Evaluation of AR Mechanisms for Awareness and Orientation Support in Occluded Multi-Room Settings

Augmented Reality can provide orientation and awareness in situations in which objects or people are occluded by physical structures. This is relevant for many situations in the workplace, where objects are scattered across rooms and people are out of sight. While several AR mechanisms have been proposed to provide awareness and orientation in these situations, little is known about their effect on people's performance when searching objects and coordinating with each other. In this paper, we compare three AR based mechanisms (map, x-ray, compass) according to their utility, usability, social presence, task load and users' preferences. 48 participants had to work together in groups of four to find people and objects located around different rooms. Results show that map and x-ray performed best but provided least social presence among participants. We discuss these and other observations as well as potential impacts on designing AR awareness and orientation support.

[1]  Gaurav Bhorkar,et al.  A Survey of Augmented Reality Navigation , 2017, ArXiv.

[2]  Nassir Navab,et al.  Towards Efficient Visual Guidance in Limited Field-of-View Head-Mounted Displays , 2018, IEEE Transactions on Visualization and Computer Graphics.

[3]  Kwang-Yun Wohn,et al.  Effects on Productivity and Safety of Map and Augmented Reality Navigation Paradigms , 2011, IEICE Trans. Inf. Syst..

[4]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[5]  Anthony D. Andre,et al.  Taxiway Navigation and Situation Awareness (T-NASA) System: Problem, Design Philosophy, and Description of an Integrated Display Suite for Low-Visibility Airport Surface Operations , 1996 .

[6]  Mark A. Livingston,et al.  User interface design for military AR applications , 2011, Virtual Reality.

[7]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[8]  Jason Leigh,et al.  Lessons learned from employing multiple perspectives in a collaborative virtual environment for visualizing scientific data , 2000, CVE '00.

[9]  Niels Henze,et al.  Visualization of off-screen objects in mobile augmented reality , 2010, Mobile HCI.

[10]  Riku Suomela,et al.  Context compass , 2000, Digest of Papers. Fourth International Symposium on Wearable Computers.

[11]  Ann Morrison,et al.  Like bees around the hive: a comparative study of a mobile augmented reality map , 2009, CHI.

[12]  Jorge Bacca,et al.  Augmented Reality Trends in Education: A Systematic Review of Research and Applications , 2014, J. Educ. Technol. Soc..

[13]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[14]  Andy Hopper,et al.  Implementing a Sentient Computing System , 2001, Computer.

[15]  Myoung-Hee Kim,et al.  Evaluation of a Mobile Projector-Based Indoor Navigation Interface , 2014, Interact. Comput..

[16]  Tobias Höllerer,et al.  Resolving multiple occluded layers in augmented reality , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[17]  Gokhan Ince,et al.  Comparative Assessment of Mobile Navigation Applications using 2D Maps and Augmented Reality Interfaces , 2016, ACHI 2016.

[18]  Roohie Naaz,et al.  Augmented Reality for Fire & Emergency Services , 2014 .

[19]  Gudrun Klinker,et al.  Supporting order picking with Augmented Reality , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[20]  Susanne Boll,et al.  Visualizing out-of-view objects in head-mounted augmented reality , 2017, MobileHCI.

[21]  Mark Billinghurst,et al.  Exploring the use of handheld AR for outdoor navigation , 2012, Comput. Graph..

[22]  Dieter Schmalstieg,et al.  Zooming interfaces for augmented reality browsers , 2010, Mobile HCI.

[23]  Anthony D. Andre,et al.  Situation Awareness in an Augmented Reality Cockpit: Design, Viewpoints and Cognitive Glue , 2005 .

[24]  Markus Funk,et al.  Representing indoor location of objects on wearable computers with head-mounted displays , 2014, AH.

[25]  Susanne Boll,et al.  EyeSee360: designing a visualization technique for out-of-view objects in head-mounted augmented reality , 2017, SUI.

[26]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[27]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[28]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[29]  Patrick Baudisch,et al.  Halo: a technique for visualizing off-screen objects , 2003, CHI '03.

[30]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[31]  Oliver Bimber,et al.  Occlusion shadows: using projected light to generate realistic occlusion effects for view-dependent optical see-through displays , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[32]  Michael Prilla,et al.  How to Interact with AR Head mounted Devices in Care Work? A Study Comparing handheld touch (hands-on) and Gesture (hands-Free) Interaction , 2019, ECIS.

[33]  Dieter Schmalstieg,et al.  Location based Applications for Mobile Augmented Reality , 2003, AUIC.

[34]  Steven Reece,et al.  Supporting Team Coordination on the Ground: Requirements from a Mixed Reality Game , 2014, COOP.

[35]  Steven K. Feiner,et al.  A touring machine: Prototyping 3D mobile augmented reality systems for exploring the urban environment , 1997, Digest of Papers. First International Symposium on Wearable Computers.

[36]  T. Schnell,et al.  Terrain awareness & pathway guidance for head-up displays (tapguide); a simulator study of pilot performance , 2003, Digital Avionics Systems Conference, 2003. DASC '03. The 22nd.

[37]  Thies Pfeiffer,et al.  Attention guiding techniques using peripheral vision and eye tracking for feedback in augmented-reality-based assistance systems , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[38]  Johan N. Siebert,et al.  Adherence to AHA Guidelines When Adapted for Augmented Reality Glasses for Assisted Pediatric Cardiopulmonary Resuscitation: A Randomized Controlled Trial , 2017, Journal of medical Internet research.

[39]  Jung Sun Hahn,et al.  A Theoretical Review on Designing Virtual Reality in the Teaching-Learning Process , 2001 .

[40]  Takeo Kanade,et al.  Dynamic seethroughs: Synthesizing hidden views of moving objects , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[41]  Christian Sandor,et al.  An Evaluation of Augmented Reality X-Ray Vision for Outdoor Navigation , 2011 .

[42]  Jennifer L. Gregg,et al.  The Networked Minds Measure of Social Presence : Pilot Test of the Factor Structure and Concurrent Validity , 2001 .

[43]  Volker Wulf,et al.  Landmarke: an ad hoc deployable ubicomp infrastructure to support indoor navigation of firefighters , 2011, Personal and Ubiquitous Computing.

[44]  Brian F. Goldiez,et al.  Effects of Augmented Reality Display Settings on Human Wayfinding Performance , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[45]  Scott Bateman,et al.  Stabilized Annotations for Mobile Remote Assistance , 2016, CHI.

[46]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[47]  Tony DeRose,et al.  Toolglass and magic lenses: the see-through interface , 1993, SIGGRAPH.

[48]  D. Kort,et al.  Digital Games as Social Presence Technology: Development of the Social Presence in Gaming Questionnaire (SPGQ) , 2007 .

[49]  Pingbo Tang,et al.  A spatial orientation and information system for indoor spatial awareness , 2010, ISA '10.

[50]  Ratnesh Chaturvedi,et al.  A Review on the use of Augmented Reality to Generate Safety Awareness and Enhance Emergency Response , 2016 .

[51]  Weidong Huang,et al.  Helping Hands: Using Augmented Reality to Provide Remote Guidance to Health Professionals , 2017, CSHI.

[52]  Tobias Höllerer,et al.  Interactive tools for virtual x-ray vision in mobile augmented reality , 2004, Third IEEE and ACM International Symposium on Mixed and Augmented Reality.

[53]  Yuichi Ohta,et al.  Visualization methods for outdoor see-through vision , 2005, ICAT '05.

[54]  Alois Ferscha,et al.  Augmented reality navigation systems , 2006, Universal Access in the Information Society.

[55]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[56]  Steven K. Feiner,et al.  An annotated situation-awareness aid for augmented reality , 2002, UIST '02.

[57]  M. Schijven,et al.  Systematic review on the effectiveness of augmented reality applications in medical training , 2016, Surgical Endoscopy.

[58]  Dragos Datcu,et al.  Handheld Augmented Reality for Distributed Collaborative Crime Scene Investigation , 2016, GROUP.

[59]  T. H. Riehle,et al.  An indoor navigation system to support the visually impaired , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[60]  Tomasz Bednarz,et al.  A systematic review of the current state of collaborative mixed reality technologies: 2013–2018 , 2019, AIMS Electronics and Electrical Engineering.

[61]  Susanne Boll,et al.  Beyond Halo and Wedge: visualizing out-of-view objects on head-mounted virtual and augmented reality devices , 2018, MobileHCI.