A comparative exploration of eye gaze and head motion cues for lane change intent prediction

Driver behavioral cues may present a rich source of information and feedback for future intelligent driver assistance systems (IDAS). Two of the most useful cues might be eye gaze and head motion. Eye gaze provides a more accurate proxy than head motion for determining driver attention, whereas the measurement of head motion head motion as a derivative of pose is less cumbersome and more reliable in harsh driving conditions. With the design of a simple and robust IDAS in mind, we are interested in determining the most important driver cues for distinguishing driver intent. We use a lane change intent prediction system [1] to determine the relative usefulness of each cue for determining intent. Various combinations of input data are presented to a discriminative classifier, which is trained to output a prediction of probable lane change maneuver at a particular point in the future. Quantitative results using real-world data are presented and show that head motion, when combined with lane position and vehicle dynamics, is a reliable cue for lane change intent prediction. The addition of eye gaze does not improve performance as much as simpler head pose-based cues.

[1]  George M. Troell,et al.  DRIVER HEAD MOVEMENTS IN LEFT OUTSIDE MIRROR VIEWING , 1981 .

[2]  Mohan M. Trivedi,et al.  Driver Behavior and Situation Aware Brake Assistance for Intelligent Vehicles , 2007, Proceedings of the IEEE.

[3]  Mohan M. Trivedi,et al.  Turn-Intent Analysis Using Body Pose for Intelligent Driver Assistance , 2006, IEEE Pervasive Computing.

[4]  Jorge Batista,et al.  A Real-Time Driver Visual Attention Monitoring System , 2005, IbPRIA.

[5]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevance Vector Machine , 2001 .

[6]  Thomas A. Dingus,et al.  A Field Evaluation of Safety Issues in Local/short Haul Trucking , 2000 .

[7]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[8]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[9]  Alex Pentland,et al.  Graphical models for driver behavior recognition in a SmartCar , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[10]  Tomohiro Yamamura,et al.  A Driver Behavior Recognition Method Based on a Driver Model Framework , 2000 .

[11]  Mohan M. Trivedi,et al.  Holistic Sensing and Active Displays for Intelligent Driver Support Systems , 2007, Computer.

[12]  R. J. Donohue,et al.  Mirror Sampling Characteristics of Drivers , 1974 .

[13]  Mohan M. Trivedi,et al.  Lane Change Intent Analysis Using Robust Operators and Sparse Bayesian Learning , 2005, IEEE Transactions on Intelligent Transportation Systems.

[14]  Youding Zhu,et al.  Head pose estimation for driver monitoring , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[15]  Louis Tijerina,et al.  Eye Glance Behavior of van and Passenger Car Drivers during Lane Change Decision Phase , 2005 .

[16]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[18]  Tomohiro Yamamura,et al.  Lane-Change Detection Using a Computational Driver Model , 2007, Hum. Factors.

[19]  Dario D. Salvucci,et al.  The time course of a lane change: Driver control and eye-movement behavior , 2002 .

[20]  Mohan M. Trivedi,et al.  Multi-spectral and multi-perspective video arrays for driver body tracking and activity analysis , 2007, Comput. Vis. Image Underst..

[21]  Suzanne E. Lee,et al.  Eye Glance Behavior during Lane Changes and Straight-Ahead Driving , 2005 .

[22]  Simon Baker.  Real-time non-rigid driver head tracking for driver mental state estimation , 2004 .

[23]  Louis Tijerina,et al.  Driver Workload Metrics Task 2 Final Report , 2006 .

[24]  Tarak Gandhi,et al.  Looking-In and Looking-Out of a Vehicle: Computer-Vision-Based Enhanced Vehicle Safety , 2007, IEEE Transactions on Intelligent Transportation Systems.

[25]  Mohan M. Trivedi,et al.  Head Pose Estimation for Driver Assistance Systems: A Robust Algorithm and Experimental Evaluation , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[26]  Suzanne E. Lee,et al.  A COMPREHENSIVE EXAMINATION OF NATURALISTIC LANE-CHANGES , 2004 .

[27]  Fengliang Xu,et al.  Real-time eye detection and tracking for driver observation under various light conditions , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[28]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[29]  SAVE-IT SAfety VEhicles using adaptive Interface Technology ( Task 8 ) : A Literature Review of Intent Inference , 2004 .

[30]  Luis M. Bergasa,et al.  Real-time system for monitoring driver vigilance , 2005, ISIE 2005.

[31]  G H Robinson,et al.  Visual Search by Automobile Drivers , 1972, Human factors.

[32]  Mohan M. Trivedi,et al.  Simultaneous Eye Tracking and Blink Detection with Interactive Particle Filters , 2008, EURASIP J. Adv. Signal Process..

[33]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000 .

[34]  Michael E. Tipping,et al.  Fast Marginal Likelihood Maximisation for Sparse Bayesian Models , 2003 .