The effects of driving with different levels of unreliable automation on self-reported workload and secondary task performance

Until automated cars function perfectly, drivers will have to take over control when automation fails or reaches its functional limits. Two simulator experiments (N = 24 and 27) were conducted, each testing four automation levels ranging from manual control (MC) to highly automated driving. In both experiments, participants about once every 3 min experienced an event that required intervention. Participants performed a secondary divided attention task while driving. Automation generally resulted in improved secondary task performance and reduced self-reported physical demand and effort as compared to MC. However, automated speed control was experienced as more frustrating than MC. Participants responded quickly to the events when the stimulus was salient (i.e., stop sign, crossing pedestrian, and braking lead car), but often failed to react to an automation failure when their vehicle was driving slowly. In conclusion, driving with imperfect automation can be frustrating, even though mental and physical demands are reduced.

[1]  Catherine Neubauer,et al.  Fatigue and Voluntary Utilization of Automation in Simulated Driving , 2012, Hum. Factors.

[2]  V J Storie,et al.  MALE AND FEMALE CAR DRIVERS: DIFFERENCES OBSERVED IN ACCIDENTS , 1977 .

[3]  Kaleb McDowell,et al.  Secure Mobility and the Autonomous Driver , 2008, IEEE Transactions on Robotics.

[4]  Natasha Merat,et al.  Driver Inattention During Vehicle Automation: How Does Driver Engagement Affect Resumption Of Control? , 2015 .

[5]  Miguel Leitão,et al.  Reaction to a Critical Situation during Driving with Adaptive Cruise Control for Users and Non-Users of the System , 2015 .

[6]  Karel Brookhuis,et al.  The interaction between driving and in-vehicle information systems: comparison of results from laboratory, simulator and real-world studies , 2005 .

[7]  Ruiqi Ma.  The Effects of In-vehicle Automation and Reliability on Driver Situation Awareness and Trust , 2005 .

[8]  Lena Nilsson,et al.  Evaluation of application 3 : Intelligent cruise control simulator experiment: Effects of different levels of automation on driver behaviour, workload and attitudes , 1996 .

[9]  A. Kemeny,et al.  Evaluating perception in driving simulation experiments , 2003, Trends in Cognitive Sciences.

[10]  K. A. Brookhuis,et al.  Comparing treatment effects of oral THC on simulated and on-the-road driving performance: testing the validity of driving simulator drug research , 2015, Psychopharmacology.

[11]  Joris C Verster,et al.  Standard operation procedures for conducting the on-the-road driving test, and measurement of the standard deviation of lateral position (SDLP) , 2011, International journal of general medicine.

[12]  H J Eysenck,et al.  Sensation seeking in England and America: cross-cultural, age, and sex comparisons. , 1978, Journal of consulting and clinical psychology.

[13]  D. Lubinski,et al.  Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. , 2009 .

[14]  Eugene I. Farber.  COMMENTS ON "DRIVER BEHAVIOR IN AN EMERGENCY SITUATION IN THE AUTOMATED HIGHWAY SYSTEM" , 1999 .

[15]  Markus Zimmermann,et al.  Vigilance, boredom proneness and detection time of a malfunction in partially automated driving , 2015, 2015 International Conference on Collaboration Technologies and Systems (CTS).

[16]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[17]  Christina M. Rudin-Brown,et al.  BEHAVIOURAL ADAPTATION TO ADAPTIVE CRUISE CONTROL (ACC): IMPLICATIONS FOR PREVENTIVE STRATEGIES , 2004 .

[18]  Katja Kircher,et al.  Tactical Driving Behavior With Different Levels of Automation , 2014, IEEE Transactions on Intelligent Transportation Systems.

[19]  Mark S. Young,et al.  Miles away: determining the extent of secondary task interference on simulated driving , 2007 .

[20]  Marika Hoedemaeker,et al.  Behavioural adaptation to driving with an adaptive cruise control (ACC) , 1998 .

[21]  Markus Lienkamp,et al.  Driving in an Increasingly Automated World – Approaches to Improve the Driver-automation Interaction , 2015 .

[22]  Naohisa Hashimoto,et al.  Measurement of Driver's Reaction Time to Failure of Steering Controller during Automatic Driving , 2005 .

[23]  Samantha L. Comte,et al.  Intelligent speed adaptation : evaluating the possible effects of an innovative speed management system on driver behaviour and road safety , 2001 .

[24]  Catherine Neubauer,et al.  Individual Differences and Automation Choice in Simulated Driving , 2011 .

[25]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[26]  Chiuhsiang Joe Lin,et al.  Evaluation of operators' performance for automation design in the fully digital control room of nuclear power plants , 2010 .

[27]  J. E. Rijnsdorp,et al.  Man's Role in Control Systems , 1975 .

[28]  Neville A Stanton,et al.  Back to the future: Brake reaction times for manual and automated vehicles , 2007, Ergonomics.

[29]  Guy H. Walker,et al.  Where Is Computing Driving Cars? , 2001, Int. J. Hum. Comput. Interact..

[30]  Klaus Bengler,et al.  Requirements for cooperative vehicle guidance , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[31]  Dario G. Liebermann,et al.  A FIELD STUDY ON BRAKING RESPONSES DURING DRIVING. I. TRIGGERING AND MODULATION , 1995 .

[32]  Edward M. Hitchcock,et al.  Active and passive fatigue in simulated driving: discriminating styles of workload regulation and their safety impacts. , 2013, Journal of experimental psychology. Applied.

[33]  Paul C. Schutte,et al.  Human automation interaction , 2018 .

[34]  N A Stanton,et al.  What's skill got to do with it? Vehicle automation and driver mental workload , 2007, Ergonomics.

[35]  Mark S. Young,et al.  Drive-by-wire: The case of driver workload and reclaiming control with adaptive cruise control , 1997 .

[36]  Neville A. Stanton,et al.  Human error taxonomies applied to driving: A generic driver error taxonomy and its implications for intelligent transport systems , 2009 .

[37]  Björn Peters,et al.  ADAPTATION EVALUATION : AN ADAPTIVE CRUISE CONTROL (ACC) SYSTEM USED BY DRIVERS WITH LOWER LIMB DISABILITIES , 2001 .

[38]  Heikki Summala,et al.  Brake reaction times and driver behavior analysis , 2000 .

[39]  Charles E. Billings,et al.  Toward a Human-Centered Aircraft Automation Philosophy , 1991 .

[40]  Steven E Shladover,et al.  Cooperative Adaptive Cruise Control: Driver Acceptance of Following Gap Settings Less than One Second , 2010 .

[41]  Charles A. Green,et al.  Human Factors Issues Associated with Limited Ability Autonomous Driving Systems: Drivers’ Allocation of Visual Attention to the Forward Roadway , 2017 .

[42]  Niklas Strand,et al.  Semi-automated versus highly automated driving in critical situations caused by automation failures , 2014 .

[43]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004, Hum. Factors.

[44]  Peter A. Hancock,et al.  Hours of Boredom, Moments of Terror: Temporal Desynchrony in Military and Security Force Operations , 2012 .

[45]  J R Treat,et al.  TRI-LEVEL STUDY OF THE CAUSES OF TRAFFIC ACCIDENTS. EXECUTIVE SUMMARY , 1979 .

[46]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[47]  P. Tsang,et al.  Diagnosticity and multidimensional subjective workload ratings. , 1996, Ergonomics.

[48]  Olivier Pietquin,et al.  Automation Effects on Driver's Behaviour When Integrating a PADAS and a Distraction Classifier , 2011, HCI.

[49]  Lisanne Bainbridge,et al.  Ironies of automation , 1982, Autom..

[50]  Terje Moen,et al.  Comparison of driving simulator performance with real driving after alcohol intake: a randomised, single blind, placebo-controlled, cross-over trial. , 2013, Accident; analysis and prevention.

[51]  Lena Nilsson.  Safety effects of adaptive cruise controls in critical traffic situations , 1995 .

[52]  P. A. Hancock.  Automobility: the coming use of fully-automated on-road vehicles , 2015, 2015 IEEE International Multi-Disciplinary Conference on Cognitive Methods in Situation Awareness and Decision.

[53]  Samantha L Comte.  New systems: new behaviour? , 2000 .

[54]  Neville A Stanton,et al.  Taking the load off: investigations of how adaptive cruise control affects mental workload , 2004, Ergonomics.

[55]  Neville A. Stanton,et al.  Detection of new in-path targets by drivers using Stop & Go Adaptive Cruise Control. , 2011, Applied ergonomics.

[56]  C. Wickens,et al.  Dissociation of Performance and Subjective Measures of Workload , 1988 .

[57]  Dietrich Manzey,et al.  Misuse of automated decision aids: Complacency, automation bias and the impact of training experience , 2008, Int. J. Hum. Comput. Stud..

[58]  Motoyuki Akamatsu,et al.  Automotive Technology and Human Factors Research: Past, Present, and Future , 2013 .

[59]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[60]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[61]  Dietrich Manzey,et al.  Automation in Surgery: The Impact of Navigated-Control Assistance on the Performance, Workload and Situation Awareness of Surgeons , 2010 .

[62]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[63]  Frank Flemisch,et al.  Cooperative Control and Active Interfaces for Vehicle Assitsance and Automation , 2008 .

[64]  C. B. Colby.  The weirdest people in the world , 1973 .

[65]  Randolph W. Hall,et al.  Automated Highway Systems Operating Strategies and Events: A Driver’s Perspective , 1997 .

[66]  Paul Milgram,et al.  The Development of a Time-Related Measure to Describe Driving Strategy , 1984 .

[67]  Dot Hs.  The Impact of Driver Inattention On Near-Crash/Crash Risk: , 2006 .

[68]  David Sharek,et al.  A Useable, Online NASA-TLX Tool , 2011 .

[69]  James L. Szalma,et al.  Effects of Sensory Modality and Task Duration on Performance, Workload, and Stress in Sustained Attention , 2004, Hum. Factors.

[70]  J. Trnros,et al.  EFFECTS OF ACC ON DRIVER BEHAVIOUR, WORKLOAD AND ACCEPTANCE IN RELATION TO MINIMUM TIME HEADWAY , 2002 .

[71]  Erik Hollnagel,et al.  Joint Cognitive Systems: Foundations of Cognitive Systems Engineering , 2005 .

[72]  N L Schweitzer,et al.  A FIELD STUDY ON BRAKING RESPONSES DURING DRIVING (II). , 1995 .

[73]  Mark S. Young,et al.  Driving automation: Learning from aviation about design philosophies , 2007 .

[74]  Marika Hoedemaeker,et al.  Driver behavior in an emergency situation in the Automated Highway System , 1999 .

[75]  Catherine Neubauer,et al.  Simulator Methodologies for Investigating Fatigue and Stress in the Automated Vehicle , 2010 .

[76]  Guy H. Walker,et al.  AUTOMATING THE DRIVER'S CONTROL TASKS , 2001 .

[77]  Joel S. Warm,et al.  The Rate of Gain of Perceived Workload in Sustained Attention , 1993 .