Simulator Fidelity and Validity in a Transfer-of-Training Context

The question of simulation fidelity and validity is of concern in many driving applications. This paper reviews the general issues associated with fidelity and validity. For training applications, fidelity and validity relate to training effectiveness. Training effectiveness is typically measured according to real-world driver behavior and performance. This paper describes a novice driver training experiment that used simulators with three levels of fidelity. Driver simulator performance was measured for complex driving scenarios containing repeated exposures to hazardous situations. The driving records of the participants were also analyzed for a period of 40 months after they were trained. Inferences about simulator fidelity and validity are drawn on the basis of the participants' simulator performance and real-world driving records. Confounding effects in the database due to several uncontrolled variables are also discussed. These confounding effects are relevant to the design of future transfer-of-training studies.

[1]  Brian N Fildes.  PERCEPTUAL COUNTERMEASURES: SIMULATOR VALIDATION STUDY. , 1997 .

[2]  Francesco Bella.  Validation of a Driving Simulator for Work Zone Design , 2005 .

[3]  Daniel J. Sheppard,et al.  Simulator Design Features for Helicopter Shipboard Landings , 1987 .

[4]  A. Neal,et al.  Using “War Stories” to Train for Adaptive Performance: Is it Better to Learn from Error or Success? , 2006 .

[5]  Jan Theeuwes,et al.  Driving Simulator Validity: Some Considerations , 1996 .

[6]  Arthur S. Blaiwes,et al.  Transfer of Training and the Measurement of Training Effectiveness , 1973 .

[7]  Jeffrey P. Chrstos,et al.  Validation of a non-linear vehicle dynamics simulation for limit handling , 2002 .

[8]  M L Cook,et al.  Automated Assessment and Training of Novice Drivers , 2006 .

[9]  Jeffrey R. Hogue,et al.  Validation of real-time man-in-the-loop simulation , 1991 .

[10]  K. Renner.  Must all tests be valid , 1962 .

[11]  Alain Berthoz,et al.  Sensorimotor integration in a driving simulator: contributions of motion cueing in elementary driving tasks , 2001 .

[12]  Michael G. Wade,et al.  SIMULATION VALIDATION: EVALUATING DRIVER PERFORMANCE IN SIMULATION AND THE REAL WORLD , 1998 .

[13]  TECHNICAL recommendations for psychological tests and diagnostic techniques. , 1954, Psychological bulletin.

[14]  Walter W. Wierwille,et al.  Human Performance Validation of Simulators: Theory and Experimental Verification , 1975 .

[15]  Daniel R Mayhew,et al.  Changes in collision rates among novice drivers during the first months of driving. , 2003, Accident; analysis and prevention.

[16]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[17]  Nancy L. Leech,et al.  The Meaning of Validity in the New Standards for Educational and Psychological Testing: , 2003 .

[18]  George D. Park,et al.  DEVELOPING DRIVING SCENARIOS FOR RESEARCH, TRAINING AND CLINICAL APPLICATIONS , 2004 .

[19]  Andrew M. Rose,et al.  Methodological Approaches For Simulator Evaluations , 1987 .

[20]  R W Allen,et al.  Experience with a low cost PC-based system for young driver training , 2003 .

[21]  Daniel P. Westra,et al.  Simulator Design Features for Helicopter Shipboard Landings. 2. Performance Experiments , 1987 .

[22]  Theodore J. Rosenthal,et al.  Training Effectiveness: How Does Driving Simulator Fidelity Influence Driver Performance? , 2005 .

[23]  Joseph Tiffin,et al.  Industrial psychology, 5th ed. , 1965 .

[24]  W K MCCOY,et al.  Problems of Validity of Measures Used in Investigating Man—Machine Systems , 1963, Human factors.

[25]  M L Cook,et al.  The Effect of Driving Simulator Fidelity on Training Effectiveness , 2007 .

[26]  L. Hearnshaw,et al.  What is industrial psychology? , 1949, Occupational psychology.

[27]  B Hesketh,et al.  Learning from errors in a driving simulation: effects on driving skill and self-confidence , 2000, Ergonomics.

[28]  Osman Balci,et al.  Verification, Validation And Accreditation Of Simulation Models , 1997, Winter Simulation Conference Proceedings,.

[29]  Theodore J. Rosenthal,et al.  Performance Measurement Paradigms for Driving Simulator Research , 2005 .