Simultaneous analysis of driver behaviour and road condition for driver distraction detection

The design of intelligent driver assistance systems is of increasing importance for the vehicle-producing industry and road-safety solutions. This article starts with a review of road-situation monitoring and driver's behaviour analysis. This article also discusses lane tracking using vision (or other) sensors, and the strength or weakness of different methods of driver behaviour analysis (e.g. iris or pupil status monitoring, and EEG spectrum analysis). This article focuses then on image analysis techniques and develops a multi-faceted approach in order to analyse driver's face and eye status via implementing a real-time AdaBoost cascade classifier with Haar-like features. The proposed method is tested in a research vehicle for driver distraction detection using a binocular camera. The developed algorithm is robust in detecting different types of driver distraction such as drowsiness, fatigue, drunk driving or the performance of secondary tasks.

[1]  Wang Rongben,et al.  Monitoring mouth movement for driver fatigue or distraction with one camera , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[2]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[3]  A. Fasih,et al.  A Hybrid Method in Driver and Multisensor Data Fusion, Using a Fuzzy Logic Supervisor for Vehicle Intelligence , 2007, 2007 International Conference on Sensor Technologies and Applications (SENSORCOMM 2007).

[4]  K. Oguri,et al.  Driver’s cognitive distraction detection using AdaBoost on pattern recognition basis , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[5]  Suhong Ko,et al.  Road Lane Departure Warning using Optimal Path Finding of the Dynamic Programming , 2006, 2006 SICE-ICASE International Joint Conference.

[6]  L. Guvenc,et al.  Laser Scanners for Driver-Assistance Systems in Intelligent Vehicles [Applications of Control] , 2009, IEEE Control Systems.

[7]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[8]  Tarak Gandhi,et al.  Vehicle Surround Capture: Survey of Techniques and a Novel Omni-Video-Based Approach for Dynamic Panoramic Surround Maps , 2006, IEEE Transactions on Intelligent Transportation Systems.

[9]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[10]  Zahra Bahram,et al.  Driver Assistance System for Curvy Roads Using Fuzzy logic , 2009, IC-AI.

[11]  K. Dietmayer,et al.  DATA SYNCHRONIZATION STRATEGIES FOR MULTI-SENSOR FUSION , 2003 .

[12]  Reinhard Klette,et al.  Current Challenges in Vision-Based Driver Assistance , 2009, IWCIA Special Track on Applications.

[13]  Shigang Wang,et al.  New Lane Model and Distance Transform for Lane Detection and Tracking , 2009, CAIP.

[14]  Reza Sabzevari,et al.  Introducing a Sensor Network for Advanced Driver Assistance Systems Using Fuzzy Logic and Sensor Data Fusion Techniques , 2009, Ad Hoc Sens. Wirel. Networks.

[15]  Jorge Batista,et al.  A Drowsiness and Point of Attention Monitoring System for Driver Vigilance , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[16]  Reza Sabzevari,et al.  Multisensor Data Fusion Strategies for Advanced Driver Assistance Systems , 2009 .

[17]  P. R. Davidson,et al.  Frequent lapses of responsiveness during an extended visuomotor tracking task in non‐sleep‐deprived subjects , 2006, Journal of sleep research.

[18]  Nicos Maglaveras,et al.  On-road experiment for collecting driving behavioural data of sleepy drivers , 2007 .

[19]  Mahdi Rezaei,et al.  Toward next generation of driver assistance systems: A multimodal sensor-based platform , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[20]  Jenny McCune.  THE FACE OF TOMORROW , 1995 .

[21]  Yong Zhou,et al.  A robust lane detection and tracking method based on computer vision , 2006 .

[22]  Mohan M. Trivedi,et al.  Head and gaze dynamics in visual attention and context learning , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[23]  Richard Bishop,et al.  Intelligent Vehicle Technology and Trends , 2005 .

[24]  Gerd Wanielik,et al.  Vehicle tracking with lane assignment by camera and lidar sensor fusion , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[25]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[26]  P. R. Davidson,et al.  Detecting Behavioral Microsleeps from EEG Power Spectra , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[27]  Sergiu Nedevschi,et al.  Probabilistic Lane Tracking in Difficult Road Scenarios Using Stereovision , 2009, IEEE Transactions on Intelligent Transportation Systems.

[28]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[29]  David M. Bevly,et al.  A Low-Cost Solution for an Integrated Multisensor Lane Departure Warning System , 2009, IEEE Transactions on Intelligent Transportation Systems.

[30]  W. Sardha Wijesoma,et al.  Road-boundary detection and tracking using ladar sensing , 2004, IEEE Transactions on Robotics and Automation.

[31]  Haruki Kawanaka,et al.  Effect of pattern recognition features on detection for driver's cognitive distraction , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[32]  Mohamad Hoseyn Sigari.  Driver Hypo-vigilance Detection Based on Eyelid Behavior , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[33]  A. Baharav,et al.  Early detection of falling asleep at the wheel: A Heart Rate Variability approach , 2008, 2008 Computers in Cardiology.

[34]  R. Granit.  THE HEART ( Extract from “ Principles and Applications of Bioelectric and Biomagnetic Fields , 2005 .