CRAM it! A comparison of virtual, live-action and written training systems for preparing personnel to work in hazardous environments

In this paper we investigate the utility of an interactive, desktop-based virtual reality (VR) system for training personnel in hazardous working environments. Employing a novel software model, CRAM (Course Resource with Active Materials), we asked participants to learn a specific aircraft maintenance task. The evaluation sought to identify the type of familiarization training that would be most useful prior to hands on training, as well as after, as skill maintenance. We found that participants develop an increased awareness of hazards when training with stimulating technology — in particular (1) interactive, virtual simulations and (2) videos of an instructor demonstrating a task — versus simply studying (3) a set of written instructions. The results also indicate participants desire to train with these technologies over the standard written instructions. Finally, demographic data collected during the evaluation elucidates future directions for VR systems to develop a more robust and stimulating hazard training environment.

[1]  Wolfgang Friedrich,et al.  ARVIKA-augmented reality for development, production and service , 2002, Proceedings. International Symposium on Mixed and Augmented Reality.

[2]  Bruno Arnaldi,et al.  GVT: a platform to create virtual environments for procedural training , 2008, 2008 IEEE Virtual Reality Conference.

[3]  Andrew Y. C. Nee,et al.  Augmented reality applications in manufacturing: a survey , 2008 .

[4]  Michael D. Williams,et al.  A Comprehensive Review of Learner-Control: The Role of Learner Characteristics. , 1993 .

[5]  Hannes Kaufmann,et al.  Summary of Usability Evaluations of an Educational Augmented Reality Application , 2007, HCI.

[6]  Wayne L. Shebilske,et al.  Virtual Reality: An Instructional Medium for Visual-Spatial Tasks. , 1992 .

[7]  Mary Corbett,et al.  SUMI: the Software Usability Measurement Inventory , 1993, Br. J. Educ. Technol..

[8]  Sajay Sadasivan,et al.  A Haptic Virtual Borescope for Visual Engine Inspection Training , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[9]  Steven K. Feiner,et al.  Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[10]  Jerry Gosen,et al.  An Exploration of Game-Derived Learning in Total Enterprise Simulations , 2001 .

[11]  Ton de Jong,et al.  Discovery simulations and the assessment of intuitive knowledge , 2001, J. Comput. Assist. Learn..

[12]  Jakob Nielsen,et al.  Finding usability problems through heuristic evaluation , 1992, CHI.

[13]  Thomas S. Tullis,et al.  A Comparison of Questionnaires for Assessing Website Usability , 2004 .

[14]  Sabarish V. Babu,et al.  Can Immersive Virtual Humans Teach Social Conversational Protocols? , 2007, 2007 IEEE Virtual Reality Conference.

[15]  James N. Templeman,et al.  Pointman - A New Control for Simulating Tactical Infantry Movements , 2007, 2007 IEEE Virtual Reality Conference.

[16]  D. Stipek.  Motivation and instruction. , 1996 .

[17]  Wayne L. Shebilske,et al.  A preliminary empirical evaluation of virtual reality as an instructional medium for visual-spatial tasks , 1993 .

[18]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[19]  Steve W. J. Kozlowski,et al.  Current issues and future directions in simulation-based training in North America , 2008 .

[20]  M. V. J. Veenman,et al.  Initial inductive learning in a complex computer simulated environment: the role of metacognitive skills and intellectual ability , 2002, Comput. Hum. Behav..

[21]  A. Raczynski,et al.  Services and training through augmented reality , 2004 .

[22]  Dino Piccione,et al.  Faa Human Factors Workbench: Integration between Research and System Development , 2004 .

[23]  Kennon M. Sheldon,et al.  Standards, Accountability, and School Reform: Perils and Pitfalls , 1998, Teachers College Record: The Voice of Scholarship in Education.

[24]  Wolfgang Wohlgemuth,et al.  ARVIKA: augmented reality for development, production and service , 2000, DARE '00.

[25]  Rex A. Thomas,et al.  Simulations: An Opportunity We Are Missing. , 1991 .

[26]  Jakob Nielsen,et al.  A mathematical model of the finding of usability problems , 1993, INTERCHI.

[27]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[28]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.