Driver Vigilance in Automated Vehicles: Hazard Detection Failures Are a Matter of Time

Objective: The primary aim of the current study was to determine whether monitoring the roadway for hazards during automated driving results in a vigilance decrement. Background: Although automated vehicles are relatively novel, the nature of human-automation interaction within them has the classic hallmarks of a vigilance task. Drivers must maintain attention for prolonged periods of time to detect and respond to rare and unpredictable events, for example, roadway hazards that automation may be ill equipped to detect. Given the similarity with traditional vigilance tasks, we predicted that drivers of a simulated automated vehicle would demonstrate a vigilance decrement in hazard detection performance. Method: Participants “drove” a simulated automated vehicle for 40 minutes. During that time, their task was to monitor the roadway for roadway hazards. Results: As predicted, hazard detection rate declined precipitously, and reaction times slowed as the drive progressed. Further, subjective ratings of workload and task-related stress indicated that sustained monitoring is demanding and distressing and it is a challenge to maintain task engagement. Conclusion: Monitoring the roadway for potential hazards during automated driving results in workload, stress, and performance decrements similar to those observed in traditional vigilance tasks. Application: To the degree that vigilance is required of automated vehicle drivers, performance errors and associated safety risks are likely to occur as a function of time on task. Vigilance should be a focal safety concern in the development of vehicle automation.

[1]  W. N. Dember,et al.  Training for vigilance: the effect of knowledge of results format and dispositional optimism and pessimism on performance and stress. , 2006, British journal of psychology.

[2]  Riender Happee,et al.  From Mackworth’s clock to the open road: A literature review on driver vigilance task operationalization , 2016 .

[3]  G. Matthews,et al.  Task-induced fatigue states and simulated driving performance , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[4]  P A Hancock,et al.  Vigilance on the move: video game-based measurement of sustained attention , 2014, Ergonomics.

[5]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[6]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.

[7]  Oren Musicant,et al.  Associating Vehicles Automation With Drivers Functional State Assessment Systems: A Challenge for Road Safety in the Future , 2019, Front. Hum. Neurosci..

[8]  K. Bengler,et al.  Vigilance Decrement and Passive Fatigue Caused by Monotony in Automated Driving , 2015 .

[9]  Edward M. Hitchcock,et al.  Active and passive fatigue in simulated driving: discriminating styles of workload regulation and their safety impacts. , 2013, Journal of experimental psychology. Applied.

[10]  Neville A Stanton,et al.  Back to the future: Brake reaction times for manual and automated vehicles , 2007, Ergonomics.

[11]  Joel S. Warm,et al.  The Cambridge Handbook of Applied Perception Research: Vigilance: A Perceptual Challenge , 2015 .

[12]  Amanda K. Emo,et al.  Vehicle automation: A remedy for driver stress? , 2007, Ergonomics.

[13]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[14]  Colin G. Drury,et al.  Sustained Attention in Operational Settings , 2015 .

[15]  Jeffrey Bellone,et al.  Benefits Estimation Framework for Automated Vehicle Operations , 2015 .

[16]  R. Downey,et al.  Missing data in Likert ratings: A comparison of replacement methods. , 1998, The Journal of general psychology.

[17]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[18]  Mark W. Scerbo,et al.  Adaptive Automation , 2006, Neuroergonomics.

[19]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[20]  William S. Helton,et al.  Rest Is Still Best , 2017, Hum. Factors.

[21]  P. Nestor,et al.  Attention and Driving Skills in Aging and Alzheimer's Disease , 1991, Human factors.

[22]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[23]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[24]  Thomas Loveday,et al.  Cue-Based Processing Capacity, Cognitive Load and the Completion of Simulated Short-Duration Vigilance Tasks in Power Transmission Control , 2014 .

[25]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[26]  P. Hancock,et al.  In search of vigilance: the problem of iatrogenically created psychological phenomena. , 2013, The American psychologist.

[27]  Joel S. Warm,et al.  Effects of Stereoscopic Depth on Vigilance Performance and Cerebral Hemodynamics , 2015, Hum. Factors.

[28]  Eric T. Greenlee,et al.  Augmenting Cyber Defender Performance and Workload through Sonified Displays , 2015 .

[29]  Joel S. Warm,et al.  Viewing the Workload of Vigilance Through the Lenses of the NASA-TLX and the MRQ , 2013, Hum. Factors.

[30]  Alex M. Andrew,et al.  Humans and Automation: System Design and Research Issues , 2003 .

[31]  Markus Zimmermann,et al.  Vigilance, boredom proneness and detection time of a malfunction in partially automated driving , 2015, 2015 International Conference on Collaboration Technologies and Systems (CTS).

[32]  Mark S. Young,et al.  Automotive automation: Investigating the impact on drivers' mental workload , 1997 .

[33]  D. Besner,et al.  A Resource-Control Account of Sustained Attention , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[34]  W H Teichner,et al.  The Detection of a Simple Visual Signal as a Function of Time of Watch , 1974, Human factors.

[35]  William S. Helton,et al.  Validation of a Short Stress State Questionnaire , 2004 .

[36]  W. Helton,et al.  The Impact of Breaks on Sustained Attention in a Simulated, Semi‐Automated Train Control Task , 2017 .

[37]  Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles , 2022 .

[38]  Raja Parasuraman,et al.  Monitoring an Automated System for a Single Failure: Vigilance and Task Complexity Effects , 1996, Hum. Factors.

[39]  Joel S. Warm,et al.  Effect of Active and Passive Fatigue on Performance Using a Driving Simulator , 2008 .

[40]  Peter A. Hancock,et al.  On the Nature of Vigilance , 2017, Hum. Factors.

[41]  P. Hancock,et al.  The Cambridge handbook of applied perception research , 2015 .

[42]  Joel S. Warm,et al.  Stress and Workload Profiles of Network Analysis: Not All Tasks Are Created Equal , 2016 .