Coming back into the loop: Drivers' perceptual-motor performance in critical events after automated driving.

This driving simulator study, conducted as part of the EU AdaptIVe project, investigated drivers' performance in critical traffic events, during the resumption of control from an automated driving system. Prior to the critical events, using a between-participant design, 75 drivers were exposed to various screen manipulations that varied the amount of available visual information from the road environment and automation state, which aimed to take them progressively further 'out-of-the-loop' (OoTL). The current paper presents an analysis of the timing, type, and rate of drivers' collision avoidance response, also investigating how these were influenced by the criticality of the unfolding situation. Results showed that the amount of visual information available to drivers during automation impacted on how quickly they resumed manual control, with less information associated with slower take-over times, however, this did not influence the timing of when drivers began a collision avoidance manoeuvre. Instead, the observed behaviour is in line with recent accounts emphasising the role of scenario kinematics in the timing of driver avoidance response. When considering collision incidents in particular, avoidance manoeuvres were initiated when the situation criticality exceeded an Inverse Time To Collision value of ≈0.3s-1. Our results suggest that take-over time and timing and quality of avoidance response appear to be largely independent, and while long take-over time did not predict collision outcome, kinematically late initiation of avoidance did. Hence, system design should focus on achieving kinematically early avoidance initiation, rather than short take-over times.

[1]  Klaus Bengler,et al.  Take-over again: Investigating multimodal and directional TORs to get the driver back into the loop. , 2017, Applied ergonomics.

[2]  Dirk Helbing,et al.  Adaptive cruise control design for active congestion avoidance , 2008 .

[3]  Brett R Fajen,et al.  Perceptual learning and the visual control of braking , 2008, Perception & psychophysics.

[4]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[5]  Daniel Lechner,et al.  Emergency Manuever Experimentation Using a Driving Simulator , 1991 .

[6]  Natasha Merat,et al.  Driver Inattention During Vehicle Automation: How Does Driver Engagement Affect Resumption Of Control? , 2015 .

[7]  Natasha Merat,et al.  How do Drivers Behave in a Highly Automated Car , 2017 .

[8]  Mascha C. van der Voort,et al.  The influence of time-criticality on Situation Awareness when retrieving human control after automated driving , 2013, ITSC.

[9]  Neville A. Stanton,et al.  Takeover Time in Highly Automated Vehicles: Noncritical Transitions to and From Manual Control , 2017, Hum. Factors.

[10]  Wolfgang Kiesewetter,et al.  THE NEW BRAKE ASSIST OF MERCEDES-BENZ : ACTIVE DRIVER SUPPORT IN EMERGENCY BRAKING SITUATIONS , 1999 .

[11]  Klaus Bengler,et al.  Influence of Automated Brake Application on Take-Over Situations in Highly Automated Driving Scenarios , 2014 .

[12]  Daniel V. McGehee,et al.  Collision Warning Timing, Driver Distraction, and Driver Response to Imminent Rear-End Collisions in a High-Fidelity Driving Simulator , 2002, Hum. Factors.

[13]  R S Rice,et al.  An Experimental Study of Automobile Driver Characteristics and Capabilities. , 1974 .

[14]  Klaus Bengler,et al.  Ubernahmezeiten beim hochautomatisierten Autofahren , 2012 .

[15]  Karl Heinz Hoffmann,et al.  A mathematical model for predicting lane changes using the steering wheel angle. , 2014, Journal of safety research.

[16]  Louis Tijerina,et al.  Driver brake vs. steer response to sudden forward collision scenario in manual and automated driving modes , 2017 .

[17]  Markos Papageorgiou,et al.  On Microscopic Modelling of Adaptive Cruise Control Systems , 2015 .

[18]  Natasha Merat,et al.  Are you in the loop? Using gaze dispersion to understand driver visual attention during vehicle automation , 2017 .

[19]  Johan Engström,et al.  Effects of Working Memory Load and Repeated Scenario Exposure on Emergency Braking Performance , 2010, Hum. Factors.

[20]  Klaus Bengler,et al.  How Traffic Situations and Non-Driving Related Tasks Affect the Take-Over Quality in Highly Automated Driving , 2014 .

[21]  Ola Benderius,et al.  Comparing and validating models of driver steering behaviour in collision avoidance and vehicle stabilisation , 2014 .

[22]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[23]  Natasha Merat,et al.  Engaging with Highly Automated Driving: To be or Not to be in the Loop? , 2017 .

[24]  Kathrin Zeeb,et al.  Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. , 2016, Accident; analysis and prevention.

[25]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[26]  Masashi Ohta,et al.  Development of the brake assist system , 1998 .

[27]  D. C. Howell Statistical Methods for Psychology , 1987 .

[28]  Natasha Merat,et al.  Highly Automated Driving, Secondary Task Performance, and Driver State , 2012, Hum. Factors.

[29]  Allison M. Okamura,et al.  Motor learning affects car-to-driver handover in automated vehicles , 2016, Science Robotics.

[30]  Kunio Takahashi,et al.  A study on the effect of brake assist systems (BAS) , 2008 .

[31]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[32]  H Summala,et al.  Driving experience and perception of the lead car's braking when looking at in-car targets. , 1998, Accident; analysis and prevention.

[33]  Takayuki Kondoh,et al.  Identification of Visual Cues and Quantification of Drivers' Perception of Proximity Risk to the Lead Vehicle in Car-Following Situations , 2008 .

[34]  Marco Dozza,et al.  Analysis of Naturalistic Driving Study Data: Safer Glances, Driver Inattention, and Crash Risk , 2014 .

[35]  Alexandra Neukum,et al.  The effect of urgency of take-over requests during highly automated driving under distraction conditions , 2014 .

[36]  Gustav Markkula,et al.  A farewell to brake reaction times? Kinematics-dependent brake response in naturalistic rear-end emergencies. , 2016, Accident; analysis and prevention.

[37]  Krister Wolff,et al.  Driver behaviour in unexpected critical events and in repeated exposures – a comparison , 2014 .

[38]  Kurt W. Ising,et al.  Driver-Related Delay in Emergency Braking Response to a Laterally Incurring Hazard , 2012 .

[39]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[40]  Neville A. Stanton,et al.  Take-Over Time in Highly Automated Vehicles , 2018, Driver Reactions to Automated Vehicles.

[41]  Nidhi Kalra,et al.  Autonomous Vehicle Technology: A Guide for Policymakers , 2014 .

[42]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[43]  Raymond J Kiefer,et al.  Developing an inverse time-to-collision crash alert timing approach based on drivers' last-second braking and steering judgments. , 2005, Accident; analysis and prevention.

[44]  Josef F. Krems,et al.  Keep Your Scanners Peeled , 2016, Hum. Factors.

[45]  Natasha Merat,et al.  The effect of varying levels of vehicle automation on drivers’ lane changing behaviour , 2018, PloS one.

[46]  Catherine Neubauer,et al.  The Effects of Cell Phone Use and Automation on Driver Performance and Subjective State in Simulated Driving , 2012 .

[47]  David N. Lee,et al.  A Theory of Visual Control of Braking Based on Information about Time-to-Collision , 1976, Perception.

[48]  Daniel J. Fagnant,et al.  Preparing a Nation for Autonomous Vehicles: Opportunities, Barriers and Policy Recommendations , 2015 .

[49]  Michael A. Shulman,et al.  Refining the CAMP Crash Alert Timing Approach by Examining "Last Second" Braking and Lane Change Maneuvers under Various Kinematic Conditions , 2003 .

[50]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[51]  Mohamed Kassaagi,et al.  ACTIVE SAFETY EXPERIMENTS WITH COMMON DRIVERS FOR THE SPECIFICATION OF ACTIVE SAFETY SYSTEMS , 2001 .

[52]  Natasha Merat,et al.  Were they in the loop during automated driving? Links between visual attention and crash potential , 2016, Injury Prevention.

[53]  B. Ripley,et al.  Random and Mixed Effects , 2002 .

[54]  Klaus Bengler,et al.  Vibrotactile Displays: A Survey With a View on Highly Automated Driving , 2016, IEEE Transactions on Intelligent Transportation Systems.

[55]  M. Shipp Understanding Driving: Applying Cognitive Psychology to a Complex Everyday Task , 2001 .

[56]  Charles C. MacAdam,et al.  Understanding and Modeling the Human Driver , 2003 .

[57]  Brett R Fajen,et al.  Learning to control collisions: the role of perceptual attunement and action boundaries. , 2006, Journal of experimental psychology. Human perception and performance.