The effect of motor control requirements on drivers' eye-gaze pattern during automated driving.

This driving simulator study compared drivers' eye movements during a series of lane-changes, which required different levels of motor control for their execution. Participants completed 12 lane-changing manoeuvres in three drives, categorised by degree of manual engagement with the driving task: Fully Manual Drive, Manual Intervention Required, Fully Automated Drive (Manual drive, Partial automation, Full automation). For Partial automation, drivers resumed control from the automated system and changed lane manually. For Full automation, the automated system managed the lane change, but participants initiated the manoeuvre by pulling the indicator lever. Results were compared to the Manual drive condition, where drivers controlled the vehicle at all times. For each driving condition, lane changing was initiated by drivers, at their discretion, in response to a slow-moving lead vehicle, which entered their lane. Failure to change lane did not result in a collision. To understand how different motor control requirements affected driver visual attention, eye movements to the road centre, and drivers' vertical and horizontal gaze dispersion were compared during different stages of the lane change manoeuvre, for the three drives. Results showed that drivers' attention to the road centre was generally lower for drives with less motor control requirements, especially when they were not engaged in the lane change process. However, as drivers moved closer to the lead vehicle, and prepared to change lane, the pattern of eye movements to the road centre converged, regardless of whether drivers were responsible for the manual control of the lane change. While there were no significant differences in horizontal gaze dispersion between the three drives, vertical dispersion for the two levels of automation was quite different, with higher dispersion during Partial automation, which was due to a higher reliance on the HMI placed in the centre console.

[1]  Natasha Merat,et al.  Driver Inattention During Vehicle Automation: How Does Driver Engagement Affect Resumption Of Control? , 2015 .

[2]  M. Sivak.  The Information That Drivers Use: Is it Indeed 90% Visual? , 1996, Perception.

[3]  Dana H. Ballard,et al.  Eye Movements for Reward Maximization , 2003, NIPS.

[4]  Natasha Merat,et al.  Transition to manual: driver behaviour when resuming control from a highly automated vehicle , 2014 .

[5]  Nikolaos Gkikas.  - IVIS, ADAS, OODA: Joining the Loops , 2016 .

[6]  Andrew Liu,et al.  CONTROL AND MONITORING DURING LANE CHANGES , 2001 .

[7]  Gustav Markkula,et al.  Getting Back Into the Loop: The Perceptual-Motor Determinants of Successful Transitions out of Automated Driving , 2019, Hum. Factors.

[8]  M. Land.  Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[9]  Kathrin Zeeb,et al.  What determines the take-over time? An integrated model approach of driver take-over after automated driving. , 2015, Accident; analysis and prevention.

[10]  T. Victor.  Keeping Eye and Mind on the Road , 2005 .

[11]  Julie M. Harris,et al.  Eye movements and hazard perception in active and passive driving , 2015, Visual cognition.

[12]  Natasha Merat,et al.  Were they in the loop during automated driving? Links between visual attention and crash potential , 2016, Injury Prevention.

[13]  J. Gregory Trafton,et al.  Situation Awareness Recovery , 2014, Hum. Factors.

[14]  Natasha Merat,et al.  The effect of varying levels of vehicle automation on drivers’ lane changing behaviour , 2018, PloS one.

[15]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[16]  Klaus Bengler,et al.  Requirements for cooperative vehicle guidance , 2013, 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013).

[17]  M. Carrasco.  Visual attention: The past 25 years , 2011, Vision Research.

[18]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  D. Ballard,et al.  The role of uncertainty and reward on eye movements in a virtual driving task. , 2012, Journal of vision.

[20]  Richard M Wilkie,et al.  Eye-movements aid the control of locomotion. , 2003, Journal of vision.

[21]  B. Tabachnick,et al.  Using Multivariate Statistics , 1983 .

[22]  Natasha Merat,et al.  Engaging in NDRTs affects drivers’ responses and glance patterns after silent automation failures , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[23]  Natasha Merat,et al.  Are you in the loop? Using gaze dispersion to understand driver visual attention during vehicle automation , 2017 .

[24]  G. Underwood,et al.  Eye movements and hazard perception in police pursuit and emergency response driving. , 2003, Journal of experimental psychology. Applied.

[25]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[26]  P. G. Gipps,et al.  A MODEL FOR THE STRUCTURE OF LANE-CHANGING DECISIONS , 1986 .

[27]  W. J. Conover,et al.  Practical Nonparametric Statistics , 1972 .

[28]  Dario D. Salvucci,et al.  The time course of a lane change: Driver control and eye-movement behavior , 2002 .

[29]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[30]  Nikolaos Gkikas,et al.  Digital Human Modelling (DHM) in the Automotive Industry , 2016 .

[31]  Natasha Merat,et al.  Where you look during automation influences where you steer after take-over , 2019 .

[32]  Mohan M. Trivedi,et al.  On the Roles of Eye Gaze and Head Dynamics in Predicting Driver's Intent to Change Lanes , 2009, IEEE Transactions on Intelligent Transportation Systems.

[33]  Natasha Merat,et al.  Control Task Substitution in Semiautomated Driving , 2012, Hum. Factors.

[34]  Louis Tijerina,et al.  Eye Glance Behavior of van and Passenger Car Drivers during Lane Change Decision Phase , 2005 .

[35]  P. Chapman,et al.  Visual Search of Driving Situations: Danger and Experience , 1998, Perception.

[36]  Jordan Navarro,et al.  Obstacle avoidance under automated steering: Impact on driving and gaze behaviours , 2016 .