Comparing HMD-Based and Paper-Based Training

Collaborative Systems are in daily use by millions of people promising to improve everyone's life. Smartphones, smartwatches and tablets are everyday objects and life without these unimaginable. New assistive systems such as head-mounted displays (HMDs) are becoming increasingly important for various domains, especially for the industrial domain, because they claim to improve the efficiency and quality of procedural tasks. A range of scientific laboratory studies already demonstrated the potential of augmented reality (AR) technologies especially for training tasks. However, most researches are limited in terms of inadequate task complexity, measured variables and lacking comparisons. In this paper, we want to close this gap by introducing a novel multimodal HMD-based training application and compare it to paper-based learning for manual assembly tasks. We perform a user study with 30 participants measuring the training transfer of an engine assembly training task, the user satisfaction and perceived workload during the experiment. Established questionnaires such as the system usability scale (SUS), the user experience questionnaire (UEQ) and the Nasa Task Load Index (NASA-TLX) are used for the assessment. Results indicate significant differences between both learning approaches. Participants perform significantly faster and significantly worse using paper-based instructions. Furthermore, all trainees preferred HMD-based learning for future assembly trainings which was scientifically proven by the UEQ.

[1]  Eliot Winer,et al.  Evaluating the Microsoft HoloLens through an augmented reality assembly application , 2017, Defense + Security.

[2]  Oliver Korn,et al.  Industrial playgrounds: how gamification helps to enrich work for elderly or impaired persons in production , 2012, EICS '12.

[3]  Franco Tecchia,et al.  Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks , 2015, Interact. Learn. Environ..

[4]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[5]  Mark Billinghurst,et al.  A survey of evaluation techniques used in augmented reality studies , 2008, SIGGRAPH 2008.

[6]  Timo Engelke,et al.  Augmented Reality Training for Assembly and Maintenance Skills , 2011 .

[7]  Gunther Notni,et al.  Design Recommendations for HMD-based Assembly Training Tasks , 2018, SmartObjects@CHI.

[8]  Markus Funk,et al.  Using Head-Mounted Displays and In-Situ Projection for Assistive Systems: A Comparison , 2016, PETRA.

[9]  Timo Engelke,et al.  An augmented reality training platform for assembly and maintenance skills , 2013, Robotics Auton. Syst..

[10]  Xiangyu Wang,et al.  A study on the benefits of augmented reality in retaining working memory in assembly tasks: A focus on differences in gender , 2013 .

[11]  Fabian Quint,et al.  Comparing Video and Augmented Reality Assistance in Manual Assembly , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[12]  Arindam Dey,et al.  A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014 , 2018, Front. Robot. AI.

[13]  Fan Xiao,et al.  The Omnidirectional Attention Funnel: A Dynamic 3D Cursor for Mobile Augmented Reality Systems , 2006, Proceedings of the 39th Annual Hawaii International Conference on System Sciences (HICSS'06).

[14]  T. P. Caudell,et al.  Augmented reality: an application of heads-up display technology to manual manufacturing processes , 1992, Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences.

[15]  Markus Funk,et al.  Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments , 2016, ASSETS.

[16]  Petr Hořejší,et al.  Augmented Reality System for Virtual Training of Parts Assembly , 2015 .

[17]  Gunther Notni,et al.  Evaluating the training transfer of Head-Mounted Display based training for assembly tasks , 2018, PETRA.

[18]  Nassir Navab Developing killer apps for industrial augmented reality , 2004, IEEE Computer Graphics and Applications.

[19]  Markus Funk,et al.  HoloLens is more than air Tap: natural and intuitive interaction with holograms , 2017, IOT.

[20]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[21]  Gunther Notni,et al.  An Overview of Evaluations Using Augmented Reality for Assembly Training Tasks , 2017 .

[22]  Markus Funk,et al.  Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions , 2016, UbiComp.

[23]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[24]  Elsa Eiriksdottir,et al.  Procedural Instructions, Principles, and Examples , 2011, Hum. Factors.

[25]  Gunther Notni,et al.  Demand Analysis for an Augmented Reality based Assembly Training , 2017, PETRA.

[26]  Manuel Pérez Cota,et al.  Efficient Measurement of the User Experience of Interactive Products. How to use the User Experience Questionnaire (UEQ).Example: Spanish Language Version , 2013, Int. J. Interact. Multim. Artif. Intell..

[27]  Monique W. M. Jaspers,et al.  The think aloud method: a guide to user interface design , 2004, Int. J. Medical Informatics.

[28]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..