User-Centered Evaluation of an Augmented Reality-based Assistance System for Maintenance

Abstract Mobile Augmented Reality solutions are a promising technology for supporting service technicians in maintenance. The possibilities of augmenting the technicians’ field of vision with virtual information are confronted with the challenges of new forms of interaction and thus changing requirements for the design of user interfaces compared to desktop applications. The optimal interaction between humans and technology remains the decisive criterion for the development of usable interactive systems. Therefore, we have conducted a user-centered evaluation study in this paper and collected both quantitative and qualitative data. In two consecutive laboratory studies and a final field study we could show that user participation has a significant impact on the usability of the developed AR-based assistance system for the maintenance of heating, air conditioning, and cooling systems.

[1]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[2]  Ronald Azuma,et al.  A Survey of Augmented Reality , 1997, Presence: Teleoperators & Virtual Environments.

[3]  Eleonora Bottani,et al.  Augmented reality technology in the manufacturing industry: A review of the last decade , 2019, IISE Trans..

[4]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[5]  Adrian Iftene,et al.  Augmented Reality , 2010, 2010 12th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[6]  Arindam Dey,et al.  A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014 , 2018, Front. Robot. AI.

[7]  Soh-Khim Ong,et al.  A context-aware augmented reality system to assist the maintenance operators , 2014 .

[8]  Mark Billinghurst,et al.  Evaluating Augmented Reality Systems , 2011, Handbook of Augmented Reality.

[9]  Markus König,et al.  Combining visual natural markers and IMU for improved AR based indoor navigation , 2017, Adv. Eng. Informatics.

[10]  John Ahmet Erkoyuncu,et al.  A systematic review of augmented reality applications in maintenance , 2018 .

[11]  Mani Golparvar-Fard,et al.  Fast and scalable structure-from-motion based localization for high-precision mobile augmented reality systems , 2016, mUX: The Journal of Mobile User Experience.

[12]  Panos E. Kourouthanassis,et al.  Demystifying the design of mobile augmented reality applications , 2015, Multimedia Tools and Applications.

[13]  Mark Billinghurst,et al.  A Survey of Augmented Reality , 2015, Found. Trends Hum. Comput. Interact..

[14]  Steven K. Feiner,et al.  Exploring the Benefits of Augmented Reality Documentation for Maintenance and Repair , 2011, IEEE Transactions on Visualization and Computer Graphics.

[15]  SampaioAlberto Quantifying the user experience , 2013 .