Application of Theory to the Development of an Adaptive Training System for a Submarine Electronic Warfare Task

Adaptive training (AT) can be an efficient option for providing individualized instruction tailored to trainees’ needs. Given promising research findings involving AT, we were challenged with developing an AT solution for Submarine Electronic Warfare (EW). Submarine EW is a complex task that involves classifying contacts, recognizing changes in the environment, and interpreting real-time displays. To train this task, we designed and developed the Submarine Electronic Warfare Adaptive Trainer (SEW-AT). We drew from multiple theoretical perspectives to drive our design decisions, including Multiple Resource Theory (MRT) and the Zone of Proximal Development (ZPD). Following the trainer’s development, we conducted a training effectiveness evaluation (TEE) to gauge initial performance improvements from SEW-AT. Using Submariners (n = 34) from 4 different Submarine Learning Centers across the United States, we found a 46% reduction in missed reports and a 49% improvement in report accuracy while using SEW-AT. As a next step, we plan to explore how the frequency of adaptation, or adaptation schedules, affect training performance and efficiency to determine if finer-grained adaptations produce greater learning gains.

[1]  Lael J. Schooler,et al.  The Disruptive Potential of Immediate Feedback , 2008 .

[2]  Gerald Matthews,et al.  Chapter 9 Extraversion, emotion and performance: A cognitive-adaptive model , 1997 .

[3]  Natalie B. Steinhauser,et al.  Evaluation of an Adaptive Training System for Submarine Periscope Operations , 2012 .

[4]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[5]  Ok-Choon Park,et al.  Adaptive Instructional Systems , 2007 .

[6]  Gabriele Wulf,et al.  Continuous Concurrent Feedback Degrades Skill Learning: Implications for Training and Simulation , 1997, Hum. Factors.

[7]  César Hervás-Martínez,et al.  Web-based adaptive training simulator system for cardiac life support , 2006, Artif. Intell. Medicine.

[8]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[9]  Gwendolyn E. Campbell,et al.  What to do or What Not to Do?: Identifying the Content of Effective Feedback , 2002 .

[10]  K. VanLehn The Relative Effectiveness of Human Tutoring, Intelligent Tutoring Systems, and Other Tutoring Systems , 2011 .

[11]  Natalie B. Steinhauser,et al.  Review of Adaptive Training System Techniques , 2012 .

[12]  C D Wickens,et al.  The effects of divided attention on information processing in manual tracking. , 1976, Journal of experimental psychology. Human perception and performance.

[13]  Louis Tijerina,et al.  Using Cellular Telephones in Vehicles: Safe or Unsafe? , 1999 .

[14]  R. Tennyson,et al.  Pretask and On-Task Adaptive Design Strategies for Selecting Number of Instances in Concept Acquisition. , 1977 .

[15]  Christopher D. Wickens,et al.  The Structure of Attentional Resources , 1980 .

[16]  Donald L. Kirkpatrick,et al.  Great Ideas Revisited. Techniques for Evaluating Training Programs. Revisiting Kirkpatrick's Four-Level Model. , 1996 .

[17]  Karin A. Orvis,et al.  Using Adaptive Difficulty to Optimize Videogame-Based Training Performance: The Moderating Role of Personality , 2012 .

[18]  D. Cook,et al.  Adapting Web-based Instruction to Residents’ Knowledge Improves Learning Efficiency , 2008, Journal of General Internal Medicine.