Driver Inattention Detection based on Eye Gaze—Road Event Correlation

Current road safety initiatives are approaching the limit of their effectiveness in developed countries. A paradigm shift is needed to address the preventable deaths of thousands on our roads. Previous systems have focused on one or two aspects of driving: environmental sensing, vehicle dynamics or driver monitoring. Our approach is to consider the driver and the vehicle as part of a combined system, operating within the road environment. A driver assistance system is implemented that is not only responsive to the road environment and the driver's actions but also designed to correlate the driver's eye gaze with road events to determine the driver's observations. Driver observation monitoring enables an immediate in-vehicle system able to detect and act on driver inattentiveness, providing the precious seconds for an inattentive human driver to react. We present a prototype system capable of estimating the driver's observations and detecting driver inattentiveness. Due to the “look but not see” case it is not possible to prove that a road event has been observed by the driver. We show, however, that it is possible to detect missed road events and warn the driver appropriately.

[1]  Chung-Lin Huang,et al.  Road sign detection and recognition using matching pursuit method , 2001, Image Vis. Comput..

[2]  Oliver Carsten,et al.  INTELLIGENT SPEED ADAPTATION: THE BEST COLLISION AVOIDANCE SYSTEM? , 2001 .

[3]  T J Triggs,et al.  DRIVER FATIGUE: CONCEPTS, MEASUREMENT AND CRASH COUNTERMEASURES , 1988 .

[4]  T. Victor.  Keeping Eye and Mind on the Road , 2005 .

[5]  Massimo Bertozzi,et al.  Vision-based intelligent vehicles: State of the art and perspectives , 2000, Robotics Auton. Syst..

[6]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[7]  Heikki Summala,et al.  Maintaining Lane Position with Peripheral Vision during In-Vehicle Tasks , 1996, Hum. Factors.

[8]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[9]  Alexander Zelinsky,et al.  Vision In and Out of Vehicles: Integrated Driver and Road Scene Monitoring , 2002, ISER.

[10]  J. Stephenson.  World health report. , 2004, Lancet.

[11]  A. Hasan,et al.  Organisation for Economic Co-operation and Development , 2007 .

[12]  Volker Graefe,et al.  Dynamic monocular machine vision , 1988, Machine Vision and Applications.

[13]  S. Heinrich,et al.  Fast obstacle detection for urban traffic situations , 2002, IEEE Trans. Intell. Transp. Syst..

[14]  Luke Fletcher,et al.  Correlating driver gaze with the road scene for driver assistance systems , 2005, Robotics Auton. Syst..

[15]  Dariu Gavrila,et al.  The Issues , 2011 .

[16]  Thomas A. Dingus,et al.  An overview of the 100-car naturalistic study and findings , 2005 .

[17]  A. Polychronopoulos,et al.  System architecture for integrated adaptive HMI solutions , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[18]  A. Zelinsky,et al.  3D vision sensing for improved pedestrian safety , 2004, IEEE Intelligent Vehicles Symposium, 2004.

[19]  Iain Matthews,et al.  Passive Driver Gaze Tracking with Active Appearance Models (特集 センシング技術) , 2004 .

[20]  J R Treat,et al.  TRI-LEVEL STUDY OF THE CAUSES OF TRAFFIC ACCIDENTS: FINAL REPORT , 1979 .

[21]  Paul A. Viola,et al.  Detecting Pedestrians Using Patterns of Motion and Appearance , 2005, International Journal of Computer Vision.

[22]  Jean-Philippe Tarel,et al.  Real time obstacle detection in stereovision on non flat road geometry through "v-disparity" representation , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[23]  J. Christian Gerdes,et al.  A Unified Approach to Driver Assistance Systems Based on Artificial Potential Fields , 1999, Dynamic Systems and Control.

[24]  Volker Graefe,et al.  Applications of dynamic monocular machine vision , 1988, Machine Vision and Applications.

[25]  Jacques Bergeron,et al.  Monotony of road environment and driver fatigue: a simulator study. , 2003, Accident; analysis and prevention.

[26]  L. Petersson,et al.  Road scene monotony detection in a fatigue management driver assistance system , 2005, IEEE Proceedings. Intelligent Vehicles Symposium, 2005..

[27]  David Shinar,et al.  Imperfect In-Vehicle Collision Avoidance Warning Systems Can Aid Drivers , 2004, Hum. Factors.

[28]  Yoshio Matsumoto,et al.  Drive Monitoring System Based on Non-Contact Measurement System of Driver's Focus of Visual Attention , 2005 .

[29]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[30]  Roland Siegwart,et al.  Introduction of a full redundant architecture into a vehicle by integration of a virtual driver , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[31]  L. Petersson,et al.  Response Binning: Improved Weak Classifiers for Boosting , 2006, 2006 IEEE Intelligent Vehicles Symposium.

[32]  W. H. Mac Williams.  Keynote address , 2006, AIEE-IRE '51.

[33]  Eric Rodgman,et al.  The role of driver distraction in traffic crashes , 2001 .

[34]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[35]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Frank Lindner,et al.  Autonomous Driving approaches Downtown , 1999 .

[37]  M.M. Trivedi,et al.  Looking-in and looking-out of a vehicle: selected investigations in computer vision based enhanced vehicle safety , 2005, IEEE International Conference on Vehicular Electronics and Safety, 2005..