Augmented Reality Improves Procedural Work on an International Space Station Science Instrument

Objective: The purpose of the current study was to determine whether an augmented reality instruction method would result in faster task completion times, lower mental workload, and fewer errors for simple tasks in an operational setting. Background: Prior research on procedural work that directly compared augmented reality instructions to traditional instruction methods (e.g., paper) showed that augmented reality instructions can enhance procedural work, but this was not true for simple tasks in an operational setting. Method: Participants completed simple procedural tasks on spaceflight hardware using an augmented reality instruction method and a paper instruction method. Results: Our results showed that the augmented reality instruction method resulted in faster task completion times and lower levels of mental and temporal demand compared with paper instructions. When participants used the augmented reality instruction method before the paper instruction method, there was a transfer of training that improved a subsequent procedure using the paper instruction method. Conclusion: An off-the-shelf augmented reality head-mounted display (HoloLens) can enhance procedural work for simple tasks in an operational setting. Application: The ability of augmented reality to enhance procedural work for simple tasks in an operational setting can help in reducing costs and mitigating risks that could ultimately lead to accidents and critical failures.

[1]  Catherine M Arrington,et al.  PSYCHOLOGICAL SCIENCE Research Article The Cost of a Voluntary Task Switch , 2022 .

[2]  Ioannis Kazanidis,et al.  A Systematic Review of Augmented Reality Game-Based Applications in Primary Education , 2017 .

[3]  Christopher D. Wickens,et al.  Pilot Task Management : Testing an Attentional Expected Value Model of Visual Scanning , 2001 .

[4]  Anind K. Dey,et al.  Simulated augmented reality windshield display as a cognitive mapping aid for elder driver navigation , 2009, CHI.

[5]  Alexandru Dancu,et al.  The Ultimate Display , 2014 .

[6]  Immanuel Barshi,et al.  Evidence Report: Risk of Performance Errors Due to Training Deficiencies , 2016 .

[7]  Frank Biocca,et al.  Comparative effectiveness of augmented reality in object assembly , 2003, CHI '03.

[8]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[9]  Frank Biocca,et al.  Attention funnel: omnidirectional 3D cursor for mobile augmented reality platforms , 2006, CHI.

[10]  L. Frank . Auteur du texte Baum,et al.  The Master Key: An Electrical Fairy Tale Founded Upon the Mysteries of Electricity and the Optimism of Its Devotees. It Was Written for Boys, But Others May Read It , 2012 .

[11]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[12]  Paul Milgram,et al.  Perceptual issues in augmented reality , 1996, Electronic Imaging.

[13]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[14]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[15]  Paul Milgram,et al.  A taxonomy of (real and virtual world) display and control interactions , 2009, VRST '09.

[16]  K. Hendy,et al.  Measuring Subjective Workload: When Is One Scale Better Than Many? , 1993 .

[17]  Paul Milgram,et al.  A Taxonomy of Real and Virtual World Display Integration , 1999 .

[18]  Fumio Kishino,et al.  Augmented reality: a class of displays on the reality-virtuality continuum , 1995, Other Conferences.

[19]  Federico Manuri,et al.  Using handheld devices to sup port augmented reality-based maintenance and assembly tasks , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[20]  John Ahmet Erkoyuncu,et al.  A systematic review of augmented reality applications in maintenance , 2018 .

[21]  Ivan E. Sutherland,et al.  A head-mounted three dimensional display , 1968, AFIPS Fall Joint Computing Conference.

[22]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[23]  Steven K. Feiner,et al.  Augmented reality in the psychomotor phase of a procedural task , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[24]  Olaf Oehme,et al.  Augmented Reality (AR) for Assembly Processes Design and Experimental Evaluation , 2003, Int. J. Hum. Comput. Interact..

[25]  Christopher D. Wickens,et al.  Effects of Frame of Reference and Viewing Condition on Attentional Issues with Helmet Mounted Displays , 1998 .

[26]  Immanuel Barshi,et al.  ISS Training Best Practices and Lessons Learned , 2017 .

[27]  Peter E.D. Love,et al.  Using Animated Augmented Reality to Cognitively Guide Assembly , 2013, J. Comput. Civ. Eng..

[28]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[29]  David M. Hoffman,et al.  Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. , 2008, Journal of vision.

[30]  Douglas Lanman,et al.  Focal surface displays , 2017, ACM Trans. Graph..

[31]  Jun Okamoto,et al.  Assembly Assisted by Augmented Reality (A3R) , 2016 .

[32]  Kevin Michael Baird.  EVALUATING THE EFFECTIVENESS OF AUGMENTED REALITY AND WEARABLE COMPUTING FOR A MANUFACTURING ASSEMBLY TASK , 1999 .

[33]  Leonardo Bonanni,et al.  Attention-based design of augmented reality interfaces , 2005, CHI Extended Abstracts.

[34]  Jennifer Healey,et al.  Augmented Reality through Wearable Computing , 1997, Presence: Teleoperators & Virtual Environments.

[35]  Andrew Y. C. Nee,et al.  A comprehensive survey of augmented reality assembly research , 2016, Advances in Manufacturing.

[36]  Gregory Kramida,et al.  Resolving the Vergence-Accommodation Conflict in Head-Mounted Displays , 2016, IEEE Transactions on Visualization and Computer Graphics.

[37]  Shannon Melton,et al.  Diagnostic instrumentation aboard ISS: just-in-time training for non-physician crewmembers. , 2005, Aviation, space, and environmental medicine.

[38]  Ulrich Neumann,et al.  Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance , 1998, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[39]  Thomas E. Nygren,et al.  Psychometric Properties of Subjective Workload Measurement Techniques: Implications for Their Use in the Assessment of Perceived Mental Workload , 1991 .

[40]  G. D. Logan.  Task Switching , 2022 .