The validity of driving simulation for assessing differences between in-vehicle informational interfaces: A comparison with field testing

Data from on-road and simulation studies were compared to assess the validity of measures generated in the simulator. In the on-road study, driver interaction with three manual address entry methods (keypad, touch screen and rotational controller) was assessed in an instrumented vehicle to evaluate relative usability and safety implications. A separate group of participants drove a similar protocol in a medium fidelity, fixed-base driving simulator to assess the extent to which simulator measures mirrored those obtained in the field. Visual attention and task measures mapped very closely between the two environments. In general, however, driving performance measures did not differentiate among devices at the level of demand employed in this study. The findings obtained for visual attention and task engagement suggest that medium fidelity simulation provides a safe and effective means to evaluate the effects of in-vehicle information systems (IVIS) designs on these categories of driver behaviour. Statement of Relevance: Realistic evaluation of the user interface of IVIS has significant implications for both user acceptance and safety. This study addresses the validity of driving simulation for accurately modelling differences between interface methodologies by comparing results from the field with those from a medium fidelity, fixed-base simulator.

[1]  Matthew P. Reed,et al.  Comparison of driving performance on-road and in a low-cost simulator using a concurrent telephone dialling task , 1999 .

[2]  Hamish Jamson,et al.  More bang for your buck? A cross-cost simulator evaluation study , 2004 .

[3]  Bryan Reimer,et al.  Glance analysis of driver eye movements to evaluate distraction , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[4]  J. Dusek,et al.  Impact of Incremental Increases in Cognitive Workload on Physiological Arousal and Performance in Young Adult Drivers , 2009 .

[5]  Kenneth W. Gish,et al.  FEASIBILITY OF NEW SIMULATION TECHNOLOGY TO TRAIN NOVICE DRIVERS , 1996 .

[6]  Walter W. Wierwille,et al.  Validation of a Driving Simulation Facility for Instrument Panel Task Performance , 1990 .

[7]  Ying Wang,et al.  A Comparison of Three Manual Destination Entry Methods on their Impact on Visual Attention and Driving Performance: An On-Road Evaluation , 2009 .

[8]  P A Hancock,et al.  The distraction effects of phone use during a crucial driving maneuver. , 2003, Accident; analysis and prevention.

[9]  Evi Blana,et al.  DRIVING SIMULATOR VALIDATION STUDIES: A LITERATURE REVIEW , 1996 .

[10]  Moustafa El-Gindy,et al.  Technical report: Literature survey on driving simulator validation studies , 2006 .

[11]  Omer Tsimhoni,et al.  Address Entry While Driving: Speech Recognition Versus a Touch-Screen Keyboard , 2004, Hum. Factors.

[12]  Viola Cavallo,et al.  THE DEVELOPMENT OF DRIVING SIMULATORS : TOWARD A MULTISENSORY SOLUTION , 2008 .

[13]  C Spence,et al.  Multisensory interface design for drivers: past, present and future , 2008, Ergonomics.

[14]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[15]  Johan Engström,et al.  Sensitivity of eye-movement measures to in-vehicle task difficulty , 2005 .

[16]  Ming-Hui Wen,et al.  Comparison of head-up display (HUD) vs. head-down display (HDD): driving performance of commercial vehicle operators in Taiwan , 2004, Int. J. Hum. Comput. Stud..

[17]  Christopher D. Wickens,et al.  Examining the Impact of Cell Phone Conversations on Driving Using Meta-Analytic Techniques , 2006, Hum. Factors.

[18]  Gerard J. Blaauw,et al.  Driving Experience and Task Demands in Simulator and Instrumented Car: A Validation Study , 1982 .

[19]  Mikael B. Skov,et al.  Evaluating Driver Attention and Driving Behavior: Comparing Controlled Driving and Simulated Driving , 2008 .

[20]  Hans-Jörg Bullinger,et al.  Virtual prototyping and testing of in-vehicle interfaces , 2003, Ergonomics.

[21]  Bryan Reimer,et al.  An on-road assessment of the impact of cognitive workload on physiological arousal in young adult drivers , 2009, AutomotiveUI.

[22]  Bryan Reimer,et al.  Impact of Cognitive Task Complexity on Drivers’ Visual Tunneling , 2009 .

[23]  Duane T. McRuer,et al.  COMPARISON OF DRIVER DYNAMICS WITH ACTUAL AND SIMULATED VISUAL DISPLAYS , 1976 .

[24]  Kerrie L. Schattler,et al.  Driving Simulator Validation for Nighttime Construction Work Zone Devices , 2007 .

[25]  Michael A. Regan,et al.  The effects of text messaging on young novice driver performance , 2005 .

[26]  Andy H. Lee,et al.  Assessing the driving performance of older adult drivers: on-road versus simulated driving. , 2003, Accident; analysis and prevention.

[27]  Dennis A. Guenther,et al.  Validation Results from Using NADSdyna Vehicle Dynamics Simulation , 1997 .

[28]  Thomas J Triggs,et al.  Driving simulator validation for speed research. , 2002, Accident; analysis and prevention.

[29]  Mikael B. Skov,et al.  Evaluating driver attention and driving behaviour: comparing controlled driving and simulated driving , 2008, BCS HCI.

[30]  W. V. Winsum,et al.  Lane change manoeuvres and safety margins , 1999 .

[31]  Karel Brookhuis,et al.  The interaction between driving and in-vehicle information systems: comparison of results from laboratory, simulator and real-world studies , 2005 .

[32]  B. Reimer,et al.  Using self-reported data to assess the validity of driving simulation data , 2006, Behavior research methods.

[33]  W W Wierwille,et al.  AUTOMOTIVE ERGONOMICS. CHAPTER 14. VISUAL AND MANUAL DEMANDS OF IN- CAR CONTROLS AND DISPLAYS , 1993 .

[34]  Paul Green,et al.  Driver Distraction, Telematics Design, and Workload Managers: Safety Issues and Solutions , 2004 .

[35]  Jan Theeuwes,et al.  Driving Simulator Validity: Some Considerations , 1996 .

[36]  Paul Green,et al.  Potential Safety Impacts of Automotive Navigation Systems , 1997 .

[37]  William H. Levison,et al.  On-Road Versus Simulator Data in Driver Model Development Driver Performance Model Experience , 2002 .