Investigating the relationships between gaze patterns, dynamic vehicle surround analysis, and driver intentions

Recent advances in driver behavior analysis for Active Safety have led to the ability to reliably predict certain driver intentions. Specifically, researchers have developed Advanced Driver Assistance Systems that produce an estimate of a driver's intention to change lanes, make an intersection turn, or brake, several seconds before the act itself. One integral feature in these systems is the analysis of driver visual search prior to a maneuver, using head pose and eye gaze as a proxy to determine focus of attention. However it is not clear whether visual distractions during a goal-oriented visual search could change the driver's behavior and thereby cause a degradation in the performance of the behavior analysis systems. In this paper we aim to determine whether it is feasible to use computer vision to determine whether a driver's visual search was affected by an external stimulus. A holistic ethnographic driving dataset is used as a basis to generate a motion-based visual saliency map of the scene. This map is correlated with predetermined eye gaze data in situations where a driver intends to change lanes. Results demonstrate the capability of this methodology to improve driver attention and behavior estimation, as well as intent prediction.

[1]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[2]  Mohan M. Trivedi,et al.  Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles , 2007, Proceedings of the IEEE.

[3]  SAVE-IT SAfety VEhicles using adaptive Interface Technology ( Task 8 ) : A Literature Review of Intent Inference , 2004 .

[4]  Mary Hayhoe,et al.  Control of attention and gaze in complex environments. , 2006, Journal of vision.

[5]  Louis Tijerina,et al.  Eye Glance Behavior of van and Passenger Car Drivers during Lane Change Decision Phase , 2005 .

[6]  S. Yantis Control of visual attention. , 1998 .

[7]  Suzanne E. Lee,et al.  A COMPREHENSIVE EXAMINATION OF NATURALISTIC LANE-CHANGES , 2004 .

[8]  Tarak Gandhi,et al.  Driver's view and vehicle surround estimation using omnidirectional video stream , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[9]  G H Robinson,et al.  Visual Search by Automobile Drivers , 1972, Human factors.

[10]  L. Itti,et al.  Modeling the influence of task on attention , 2005, Vision Research.

[11]  Mohan M. Trivedi,et al.  Simultaneous Eye Tracking and Blink Detection with Interactive Particle Filters , 2008, EURASIP J. Adv. Signal Process..

[12]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[13]  Mary M Hayhoe,et al.  Task and context determine where you look. , 2016, Journal of vision.

[14]  L. Itti Author address: , 1999 .

[15]  Mohan M. Trivedi,et al.  Turn-Intent Analysis Using Body Pose for Intelligent Driver Assistance , 2006, IEEE Pervasive Computing.

[16]  Mohan M. Trivedi,et al.  Lane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning , 2005, IEEE Transactions on Intelligent Transportation Systems.

[17]  Youding Zhu,et al.  Head pose estimation for driver monitoring , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[18]  Mohan M. Trivedi,et al.  Holistic Sensing and Active Displays for Intelligent Driver Support Systems , 2007, Computer.

[19]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000 .

[20]  R. J. Donohue,et al.  Mirror Sampling Characteristics of Drivers , 1974 .

[21]  Fengliang Xu,et al.  Real-time eye detection and tracking for driver observation under various light conditions , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[22]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000, Journal of experimental psychology. Applied.

[23]  Tarak Gandhi,et al.  Parametric ego-motion estimation for vehicle surround analysis using an omnidirectional camera , 2005, Machine Vision and Applications.

[24]  H. Pashler,et al.  Central Interference in Driving , 2006, Psychological science.

[25]  Thomas A. Dingus,et al.  A Field Evaluation of Safety Issues in Local/short Haul Trucking , 2000 .

[26]  M.M. Trivedi,et al.  Video Based Surround Vehicle Detection, Classification and Logging from Moving Platforms: Issues and Approaches , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[27]  Matthew Rizzo,et al.  Eyes, brains, and autos. , 2004, Archives of ophthalmology.

[28]  Michael F. Land,et al.  Predictable eye-head coordination during driving , 1992, Nature.

[29]  A. Doshi,et al.  A comparative exploration of eye gaze and head motion cues for lane change intent prediction , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[30]  Simon Baker Real-time non-rigid driver head tracking for driver mental state estimation , 2004 .

[31]  Louis Tijerina,et al.  Driver Workload Metrics Task 2 Final Report , 2006 .

[32]  Jorge Batista,et al.  A Real-Time Driver Visual Attention Monitoring System , 2005, IbPRIA.

[33]  Tarak Gandhi,et al.  Vehicle Surround Capture: Survey of Techniques and a Novel Omni-Video-Based Approach for Dynamic Panoramic Surround Maps , 2006, IEEE Transactions on Intelligent Transportation Systems.

[34]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[35]  Mohan M. Trivedi,et al.  Multi-spectral and multi-perspective video arrays for driver body tracking and activity analysis , 2007, Comput. Vis. Image Underst..

[36]  Tarak Gandhi,et al.  Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety , 2007, IEEE Transactions on Intelligent Transportation Systems.

[37]  Mohan M. Trivedi,et al.  Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[38]  Wei Zhang,et al.  The Role of Top-down and Bottom-up Processes in Guiding Eye Movements during Visual Search , 2005, NIPS.

[39]  Laurent Itti,et al.  Beyond bottom-up: Incorporating task-dependent influences into a computational model of spatial attention , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.