How much time do drivers need to obtain situation awareness? A laboratory-based study of automated driving.

Drivers of automated cars may occasionally need to take back manual control after a period of inattentiveness. At present, it is unknown how long it takes to build up situation awareness of a traffic situation. In this study, 34 participants were presented with animated video clips of traffic situations on a three-lane road, from an egocentric viewpoint on a monitor equipped with eye tracker. Each participant viewed 24 videos of different durations (1, 3, 7, 9, 12, or 20 s). After each video, participants reproduced the end of the video by placing cars in a top-down view, and indicated the relative speeds of the placed cars with respect to the ego-vehicle. Results showed that the longer the video length, the lower the absolute error of the number of placed cars, the lower the total distance error between the placed cars and actual cars, and the lower the geometric difference between the placed cars and the actual cars. These effects appeared to be saturated at video lengths of 7-12 s. The total speed error between placed and actual cars also reduced with video length, but showed no saturation up to 20 s. Glance frequencies to the mirrors decreased with observation time, which is consistent with the notion that participants first estimated the spatial pattern of cars after which they directed their attention to individual cars. In conclusion, observers are able to reproduce the layout of a situation quickly, but the assessment of relative speeds takes 20 s or more.

[1]  Mica R. Endsley Situation awareness: operationally necessary and scientifically grounded , 2015, Cognition, Technology & Work.

[2]  Neville A. Stanton,et al.  Effects of adaptive cruise control and highly automated driving on workload and situation awareness: A review of the empirical evidence , 2014 .

[3]  J. Henderson Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[4]  Jing Feng,et al.  Semi-Autonomous Vehicles , 2015 .

[5]  Donald L. Fisher,et al.  Can Novice Drivers Recognize Foreshadowing Risks as Easily as Experienced Drivers , 2017 .

[6]  Catherine Neubauer,et al.  Fatigue in the Automated Vehicle , 2014 .

[7]  Wendy Ju,et al.  DAZE: a real-time situation awareness measurement tool for driving , 2015, AutomotiveUI.

[8]  Neville Stanton,et al.  Situation awareness measurement: a review of applicability for C4i environments. , 2006, Applied ergonomics.

[9]  K. Rayner The 35th Sir Frederick Bartlett Lecture: Eye movements and attention in reading, scene perception, and visual search , 2009, Quarterly journal of experimental psychology.

[10]  Donald L. Fisher,et al.  Minimum Time to Situation Awareness in Scenarios Involving Transfer of Control from an Automated Driving Suite , 2016 .

[11]  Riender Happee,et al.  Human factors of transitions in automated driving: A general framework and literature survey , 2016 .

[12]  Klaus Bengler,et al.  “Take over!” How long does it take to get the driver back into the loop? , 2013 .

[13]  Boris M. Velichkovsky,et al.  Towards an express-diagnostics for level of processing and hazard perception , 2002 .

[14]  D. E. Irwin,et al.  Eye movements and scene perception: Memory for things observed , 2002, Perception & psychophysics.

[15]  Karl R Gegenfurtner,et al.  Effects of Viewing Time, Fixations, and Viewing Strategies on Visual Memory for Briefly Presented Natural Objects , 2010, Quarterly journal of experimental psychology.

[16]  Frederik Diederichs,et al.  Take-Over Requests for Automated Driving , 2015 .

[17]  Denis Fize,et al.  Speed of processing in the human visual system , 1996, Nature.

[18]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[19]  R. Gottsdanker,et al.  Identifying the acceleration of visual targets. , 1961, British journal of psychology.

[20]  Danko Nikolić,et al.  Expertise and chess: A pilot study comparing situation awareness methodologies , 1995 .

[21]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[22]  C. Erkelens,et al.  Coarse-to-fine eye movement strategy in visual search , 2007, Vision Research.

[23]  Thomas Franke,et al.  The effect of experience, relevance, and interruption duration on drivers’ mental representation of a traffic situation , 2008 .

[24]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Stephen M. Casner,et al.  The challenges of partially automated driving , 2016, Commun. ACM.

[26]  Anne-Marie Brouwer,et al.  Perception of acceleration with short presentation times: Can acceleration be used in interception? , 2001, Perception & psychophysics.

[27]  David Crundall,et al.  What happens next? Predicting other road users' behaviour as a function of driving experience and processing time , 2009, Ergonomics.

[28]  D. Lubinski,et al.  Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. , 2009 .

[29]  Julie M. Harris,et al.  Eye movements and hazard perception in active and passive driving , 2015, Visual cognition.

[30]  Moritz Körber,et al.  Prediction of take-over time in highly automated driving by two psychometric tests , 2015 .

[31]  Mascha C. van der Voort,et al.  The influence of time-criticality on Situation Awareness when retrieving human control after automated driving , 2013, ITSC.

[32]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[33]  R. Iman,et al.  Rank Transformations as a Bridge between Parametric and Nonparametric Statistics , 1981 .

[34]  Kathrin Zeeb,et al.  Is take-over time all that matters? The impact of visual-cognitive load on driver take-over quality after conditionally automated driving. , 2016, Accident; analysis and prevention.

[35]  David Crundall,et al.  VISUAL SEARCH WHILE DRIVING: SKILL AND AWARENESS DURING INSPECTION OF THE SCENE , 2002 .

[36]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[37]  Guy H. Walker,et al.  Let the Reader Decide , 2015 .

[38]  Mica R. Endsley,et al.  Experimental Analysis and Measurement of Situation Awareness , 1995 .

[39]  Bilge Mutlu,et al.  Situation Awareness, Scenarios, and Secondary Tasks: Measuring Driver Performance and Safety Margins in Highly Automated Vehicles , 2016 .

[40]  Peter A. Hancock,et al.  Fatigue and Automation-Induced Impairments in Simulated Driving Performance , 1998 .

[41]  Donald A. Norman,et al.  The Human Side of Automation , 2015 .

[42]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.

[43]  Mica R. Endsley,et al.  Direct Measurement of Situation Awareness: Validity and Use of SAGAT , 2000 .

[44]  Andrew R. Dattel,et al.  Does Situation Awareness Add to the Validity of Cognitive Tests? , 2006, Hum. Factors.

[45]  Guy H. Walker,et al.  Measuring Situation Awareness in complex systems: Comparison of measures study , 2009 .

[46]  David Crundall,et al.  Driving simulator validation with hazard perception , 2011 .

[47]  T. Salthouse When does age-related cognitive decline begin? , 2009, Neurobiology of Aging.

[48]  F. McKenna,et al.  Drivers' hazard perception ability: Situation awareness on the road , 2004 .

[49]  Leo Gugerty,et al.  Development of a Novel Measure of Situation Awareness: The Case for Eye Movement Analysis , 2010 .

[50]  B. Velichkovsky,et al.  Time course of information processing during scene perception: The relationship between saccade amplitude and fixation duration , 2005 .

[51]  Nadja Schömig,et al.  The Interaction Between Highly Automated Driving and the Development of Drowsiness , 2015 .

[52]  Shayne Loft,et al.  Using the situation present assessment method to measure situation awareness in simulated submarine track management , 2013 .

[53]  Eric T. Greenlee,et al.  Which Eye Tracker Is Right for Your Research? Performance Evaluation of Several Cost Variant Eye Trackers , 2016 .

[54]  Russell S. Pierce,et al.  The Effect of SPAM Administration During a Dynamic Simulation , 2012, Hum. Factors.

[55]  Klaus Bengler,et al.  Taking Over Control From Highly Automated Vehicles in Complex Traffic Situations , 2016, Hum. Factors.

[56]  Riender Happee,et al.  Public opinion on automated driving: results of an international questionnaire among 5000 respondents , 2015 .

[57]  Jean Underwood,et al.  Driving Experience and Situation Awareness in Hazard Detection , 2013 .

[58]  Leo Gugerty Situational Awareness in Driving , 2011 .

[59]  Leo Gugerty Evidence from a Partial Report Task for Forgetting in Dynamic Spatial Memory , 1998, Hum. Factors.

[60]  L. Gugerty Situation Awareness During Driving: Explicit and Implicit Knowledge in Dynamic Spatial Memory , 1997 .

[61]  Shayne Loft,et al.  Situation Awareness Measures for Simulated Submarine Track Management , 2015, Hum. Factors.

[62]  G. Underwood,et al.  Eye movements and hazard perception in police pursuit and emergency response driving. , 2003, Journal of experimental psychology. Applied.

[63]  J W Oestmann,et al.  Lung lesions: correlation between viewing time and detection. , 1988, Radiology.

[64]  Aimee K. Gardner,et al.  Examining the feasibility and predictive validity of the SAGAT tool to assess situational awareness among surgical trainees , 2015 .

[65]  Donald L. Fisher,et al.  Experienced drivers are quicker to achieve situation awareness than inexperienced drivers in situations of transfer of control within a Level 3 autonomous environment , 2016 .

[66]  Klaus Bengler,et al.  A transforming steering wheel for highly automated cars , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[67]  Wendy Ju,et al.  Emergency, Automation Off: Unstructured Transition Timing for Distracted Drivers of Automated Vehicles , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[68]  X. A. Coster A Method for Determining How Much Time People Need to Understand Traffic Situations , 2015 .

[69]  Simon G Hosking,et al.  The visual search patterns and hazard responses of experienced and inexperienced motorcycle riders. , 2010, Accident; analysis and prevention.

[70]  Klaus Bengler,et al.  The influence of age on the take-over of vehicle control in highly automated driving , 2016 .

[71]  Benjamin A. Clegg,et al.  The Role of Working Memory in Levels of Situation Awareness , 2013 .