Handheld Guides in Inspection Tasks: Augmented Reality versus Picture

Inspection tasks focus on observation of the environment and are required in many industrial domains. Inspectors usually execute these tasks by using a guide such as a paper manual, and directly observing the environment. The effort required to match the information in a guide with the information in an environment and the constant gaze shifts required between the two can severely lower the work efficiency of inspector in performing his/her tasks. Augmented reality (AR) allows the information in a guide to be overlaid directly on an environment. This can decrease the amount of effort required for information matching, thus increasing work efficiency. AR guides on head-mounted displays (HMDs) have been shown to increase efficiency. Handheld AR (HAR) is not as efficient as HMD-AR in terms of manipulability, but is more practical and features better information input and sharing capabilities. In this study, we compared two handheld guides: an AR interface that shows 3D registered annotations, that is, annotations having a fixed 3D position in the AR environment, and a non-AR picture interface that displays non-registered annotations on static images. We focused on inspection tasks that involve high information density and require the user to move, as well as to perform several viewpoint alignments. The results of our comparative evaluation showed that use of the AR interface resulted in lower task completion times, fewer errors, fewer gaze shifts, and a lower subjective workload. We are the first to present findings of a comparative study of an HAR and a picture interface when used in tasks that require the user to move and execute viewpoint alignments, focusing only on direct observation. Our findings can be useful for AR practitioners and psychology researchers.

[1]  Sujin Oh,et al.  Handheld AR indoor guidance system using vision technique , 2007, VRST '07.

[2]  Michael Haller,et al.  Mixed reality training application for an oil refinery: user requirements , 2004, VRCAI '04.

[3]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[4]  Mark Billinghurst,et al.  Virtual object manipulation using a mobile phone , 2005, ICAT '05.

[5]  Steven K. Feiner,et al.  Augmented reality in the psychomotor phase of a procedural task , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[6]  Tobias Höllerer,et al.  Integrating the physical environment into mobile remote collaboration , 2012, Mobile HCI.

[7]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[8]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[9]  Wendy E. Mackay,et al.  Evaluating the benefits of real-time feedback in mobile augmented reality with hand-held devices , 2012, CHI.

[10]  R. Shepard,et al.  Mental Rotation of Three-Dimensional Objects , 1971, Science.

[11]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[12]  Hirokazu Kato,et al.  SlidAR: A 3D positioning method for SLAM-based handheld augmented reality , 2016, Comput. Graph..

[13]  Blair MacIntyre,et al.  An evaluation of graphical context when the graphics are outside of the task area , 2008, 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality.

[14]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[15]  D. W. F. van Krevelen,et al.  A Survey of Augmented Reality Technologies, Applications and Limitations , 2010, Int. J. Virtual Real..

[16]  S. Kurkovsky,et al.  Current issues in handheld augmented reality , 2012, 2012 International Conference on Communications and Information Technology (ICCIT).

[17]  Tomoya Ishikawa,et al.  Mixed Reality Navigation on a Tablet Computer for Supporting Machine Maintenance in Wide-Area Indoor Environment , 2014, ICServ.

[18]  Hirotake Ishii,et al.  Augmented Reality Applications for Nuclear Power Plant Maintenance Work , 2007 .

[19]  Laurence Nigay,et al.  Classifying handheld Augmented Reality: Three categories linked by spatial mappings , 2012 .

[20]  L. Cooper Mental rotation of random two-dimensional shapes , 1975, Cognitive Psychology.

[21]  Yakup Genc,et al.  iAR: an exploratory augmented reality system for mobile devices , 2012, VRST '12.

[22]  Tim Hauke Heibel,et al.  A mobile markerless AR system for maintenance and repair , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[23]  G. Michael Poor,et al.  "How Do I Line Up?": Reducing Mental Transformations to Improve Performance , 2011, HCI.

[24]  Woodrow Barfield,et al.  Evaluating the effectiveness of augmented reality displays for a manual assembly task , 1999, Virtual Reality.

[25]  Ann-Sofie Gunnarsson,et al.  A novel interface to sensor networks using handheld augmented reality , 2006, Mobile HCI.

[26]  Thomas Olsson,et al.  Online user survey on current mobile augmented reality applications , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[27]  Mark Billinghurst,et al.  Augmented assembly using a mobile phone , 2008, ISMAR.

[28]  Mark Billinghurst,et al.  Exploring the use of handheld AR for outdoor navigation , 2012, Comput. Graph..

[29]  Dieter Schmalstieg,et al.  User experiences with augmented reality aided navigation on phones , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[30]  Barry A. T. Brown,et al.  Rotating maps and readers: praxiological aspects of alignment and orientation , 2008 .

[31]  Luca Chittaro,et al.  Visualizing locations of off-screen objects on mobile devices: a comparative evaluation of three approaches , 2006, Mobile HCI.

[32]  Hirokazu Kato,et al.  Evaluating a SLAM-based handheld augmented reality guidance system , 2014, SUI.

[33]  Tobias Höllerer,et al.  World-stabilized annotations and virtual scene navigation for remote collaboration , 2014, UIST.

[34]  Johannes Schöning,et al.  Impact of item density on the utility of visual context in magic lens interactions , 2009, Personal and Ubiquitous Computing.