Driver drowsiness detection system under infrared illumination for an intelligent vehicle

Statistics on traffic accidents reveal that human error is the main cause of deaths and injuries on roads worldwide every day. In order to reduce the amount of such fatalities, a module for an advanced driver assistance system, which caters for automatic driver drowsiness detection and also driver distraction, is presented. Artificial intelligence algorithms are used to process the visual information in order to locate, track and analyse both the driver's face and eyes to compute the drowsiness and distraction indexes. This real-time system works during nocturnal conditions as a result of a near-infrared lighting system. Finally, examples of different driver images taken in a real vehicle at nighttime are shown to validate the proposed algorithms.

[1]  Xiaojuan Wu,et al.  Fatigue detection based on the distance of eyelid , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..

[2]  Andry Rakotonirainy,et al.  Affordable visual driver monitoring system for fatigue and monotony , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[3]  Takeshi Shakunaga,et al.  Multiple target tracking by appearance-based condensation tracker using structure information , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  R. Durrett.  Probability: Theory and Examples , 1993 .

[5]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[6]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[7]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[8]  Alexander Zelinsky,et al.  Fast Radial Symmetry for Detecting Points of Interest , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  D. Dinges,et al.  EVALUATION OF TECHNIQUES FOR OCULAR MEASUREMENT AS AN INDEX OF FATIGUE AND THE BASIS FOR ALERTNESS MANAGEMENT , 1998 .

[10]  Chengjun Liu,et al.  Gabor-based kernel PCA with fractional power polynomial models for face recognition , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[12]  A.B. Albu,et al.  A computer vision-based system for real-time detection of sleep onset in fatigued drivers , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[13]  Masoud Nikravesh,et al.  Feature Extraction: Foundations and Applications (Studies in Fuzziness and Soft Computing) , 2006 .

[14]  Jingyu Yang,et al.  Driver Fatigue Detection: A Survey , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[15]  Lorenz Hagenmeyer,et al.  Development of a multimodal, universal human-machine-interface for hypovigilance-management-systems , 2007 .

[16]  James R. Parker,et al.  Practical Computer Vision Using C , 1993 .

[17]  Peter Gejgus,et al.  Face tracking in color video sequences , 2003, SCCG '03.

[18]  Bin Yang,et al.  Camera-based drowsiness reference for driver state classification under real driving conditions , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[19]  Wen-Bing Horng,et al.  Driver fatigue detection based on eye tracking and dynamk, template matching , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[20]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  José Manuel Pastor,et al.  IVVI: Intelligent vehicle based on visual information , 2007, Robotics Auton. Syst..

[22]  Lars Petersson,et al.  Driver assistance systems based on vision in and out of vehicles , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[23]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.