Fidelity and validity of simulator training

Through a case study, this article explores a number of theoretical issues related to the often taken for granted relationship between simulator fidelity and the quality and transferability of training in complex, dynamic, safety-critical settings. A counterexample based on mid-fidelity simulation is presented and the assumed coincidence of fidelity and validity is tested, that is the study tests the equation of constructed photorealism (built to mimic reality) and effective development of the competence that operators require to manage situations that involve underspecified problems, time pressure constraints and complex group interaction. The article concludes that such competence development cannot rely only on highly context-specific (photorealistic) environments. Further, it will be argued that lower-fidelity simulation, when appropriately designed, can provide competence development with pedagogical and economic advantages.

[1]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[2]  David Roberts,et al.  Virtual reality in engineering , 1993 .

[3]  Sidney Dekker,et al.  Ten Questions About Human Error : A New View of Human Factors and System Safety , 2004 .

[4]  Staffan Nählinder,et al.  Mental Workload in Aircraft and Simulator During Basic Civil Aviation Training , 2009 .

[5]  Arnold Barnett,et al.  PASSENGER-MORTALITY RISK ESTIMATES PROVIDE PERSPECTIVES ABOUT AIRLINE SAFETY. , 2000 .

[6]  Stanley Nelson Roscoe.  Simulator Qualification: Just as Phony as It Can Be , 1991 .

[7]  J. K. Caird,et al.  Persistent issues in the application of virtual environment systems to training , 1996, Proceedings Third Annual Symposium on Human Interaction with Complex Systems. HICS'96.

[8]  W. Barclay,et al.  Forgive and Remember: Managing Medical Failure , 1979 .

[9]  Tiauw Hiong Go,et al.  SIMULATOR FIDELITY CONSIDERATIONS FOR TRAINING AND EVALUATION OF TODAY'S AIRLINE PILOTS , 2001 .

[10]  Thomas R. Carretta,et al.  Transfer of Training Effectiveness in Flight Simulation: 1986 to 1997. , 1998 .

[11]  Dietrich Dörner,et al.  The Logic Of Failure: Recognizing And Avoiding Error In Complex Situations , 1997 .

[12]  K. WeiK..  The Collapse of Sensemaking in Organizations: The Mann Gulch Disaster , 2009, STUDI ORGANIZZATIVI.

[13]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[14]  Gene I. Rochlin,et al.  Safe operation as a social construct , 1999 .

[15]  Karlene H. Roberts,et al.  The Self-Designing High-Reliability Organization: Aircraft Carrier Flight Operations at Sea , 1987 .

[16]  Alfred T. Lee.  Flight Simulation: Virtual Environments in Aviation , 2005 .

[17]  Sidney Dekker,et al.  Introduction of Technically Advanced Aircraft in Ab-Initio Flight Training , 2006 .

[18]  Herbert H. Bell,et al.  Evaluating the Effectiveness of Flight Simulators for Training Combat Skills: A Review , 1998 .

[19]  Seymour Adler,et al.  The Optimal Use of Simulation. , 1973 .

[20]  William B. Rouse,et al.  Human-Computer Interaction in the Control of Dynamic Systems , 1981, CSUR.

[21]  Immanuel Barshi,et al.  Emergency and Abnormal Situations: a Review of Asrs Reports , 2003 .

[22]  Judith Bürki-Cohen,et al.  Simulator fidelity requirements : the case of platform motion , 1998 .

[23]  David Harris,et al.  Computer-Based Simulation as an Adjunct to Ab Initio Flight Training , 1998 .

[24]  Margareta Lützhöft,et al.  RULE- AND ROLE-RETREAT: AN EMPIRICAL STUDY OF PROCEDURES AND RESILIENCE , 2009 .

[25]  René Amalberti,et al.  The paradoxes of almost totally safe transportation systems , 2001 .

[26]  Eduardo Salas,et al.  Requirements for Future Research in Flight Simulation Training: Guidance Based on a Meta-Analytic Review , 1992 .

[27]  Stefan Strohschneider,et al.  MS ANTWERPEN: Emergency Management Training for Low-Risk Environments , 2004 .

[28]  J. Petraglia.  Reality by Design: The Rhetoric and Technology of Authenticity in Education , 1998 .

[29]  Eduardo Salas,et al.  Aviation Computer Games for Crew Resource Management Training , 1993 .

[30]  P. Jackson.  Applications of virtual reality in training simulation , 1993 .

[31]  R Key Dismukes,et al.  The Limits of Expertise: Rethinking Pilot Error and the Causes of Airline Accidents , 2007 .

[32]  Sidney Dekker.  Follow the procedure or survive , 2001 .

[33]  Gary Klein,et al.  Sources of Power: How People Make Decisions , 2017 .

[34]  E Salas,et al.  It is not how much you have but how you use it: toward a rational use of simulation to support aviation training. , 1998, The International journal of aviation psychology.

[35]  Robert L. Wears,et al.  Resilience Engineering: Concepts and Precepts , 2006, Quality and Safety in Health Care.