Using Virtual Reality for Training Maintenance Procedures

In light of rapid technology advances and budget declines, the Navy is exploring innovative training solutions though initiatives such as Sailor 2025 and High Velocity Learning, which call for more hands-on, learner-centric training. Consistent with these initiatives, virtual reality (VR) offers a low-cost alternative to traditional methods of training by offering Sailors interactive and immersive 3-D simulation environments to train critical skills. Indeed, theoretical research predicts that such immersive training will result in better learning outcomes for training a procedural task than traditional computer-based training, yet there are few systematic experiments examining how and why VR may be effective for training. We conducted an experiment to: 1) test whether VR is as effective for training a military-based task as desktop-based training, and 2) compare two different input methods for interacting within the VR environment. Eighty-three participants were trained on maintenance procedures for the E-28 arresting gear, a system that hooks aircraft and rapidly decelerates them as they land. Participants were assigned randomly to one of three training conditions: Desktop-based simulation, Gesture-based VR, or Voice-based VR. A written recall test served as our measure of learning outcome. We analyzed the errors that trainees made during training and found differences between the conditions that suggest that Desktop training may be less efficient than VR training: The Desktop group committed more procedure-based errors, while the VR-Gesture group committed more gesturerelated errors (indicating they understood the procedure but had issues with using the system). This experiment addresses a critical gap in VR research by examining characteristics that may contribute to VR training optimization. Furthermore, these results demonstrate the potential of VR to provide ready, relevant training to the Fleet.

[1]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[2]  Andy P. Field,et al.  Discovering Statistics Using Ibm Spss Statistics , 2017 .

[3]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[4]  Woodrow Barfield,et al.  A Review of Presence and Performance in Virtual Environments , 2000, Int. J. Hum. Comput. Interact..

[5]  Jonathan Stevens,et al.  The Relationship between Presence and Performance in Virtual Simulation Training , 2015 .

[6]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[7]  S. Goldin-Meadow,et al.  Gesturing makes learning last , 2008, Cognition.

[8]  Tassos A. Mikropoulos,et al.  Educational virtual environments: A ten-year review of empirical research (1999-2009) , 2011, Comput. Educ..

[9]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[10]  Franck Ganier,et al.  Evaluation of procedural learning transfer from a virtual environment to a real situation: a case study on tank maintenance training , 2014, Ergonomics.

[11]  Cheryl I. Johnson,et al.  Presence and Usability Do Not Directly Predict Procedural Recall in Virtual Reality Training , 2017, HCI.

[12]  Lars-Göran Nilsson,et al.  Recall of enacted and nonenacted instructions compared: forgetting functions , 1989 .

[13]  Mary Lou Padgett,et al.  Virtual Environments Standards and Terminology , 2014, Handbook of Virtual Environments, 2nd ed..

[14]  Christopher James Hamblin,et al.  Transfer of *training from virtual reality environments , 2005 .

[15]  R. T. Savely,et al.  Virtual Environments in Training : NASA ’ s Hubble Space Telescope Mission , 1994 .

[16]  Luca Chittaro,et al.  Effects of Different Types of Virtual Reality Display on Presence and Learning in a Safety Training Scenario , 2018, IEEE Transactions on Visualization and Computer Graphics.

[17]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[18]  Johannes Engelkamp,et al.  Lexical, conceptual and motor information in memory for action phrases: a multi-system account. , 2003, Acta psychologica.