A driver face monitoring system for fatigue and distraction detection

Driver face monitoring system is a real-time system that can detect driver fatigue and distraction using machine vision approaches. In this paper, a new approach is introduced for driver hypovigilance (fatigue and distraction) detection based on the symptoms related to face and eye regions. In this method, face template matching and horizontal projection of top-half segment of face image are used to extract hypovigilance symptoms from face and eye, respectively. Head rotation is a symptom to detect distraction that is extracted from face region. The extracted symptoms from eye region are (1) percentage of eye closure, (2) eyelid distance changes with respect to the normal eyelid distance, and (3) eye closure rate. The first and second symptoms related to eye region are used for fatigue detection; the last one is used for distraction detection. In the proposed system, a fuzzy expert system combines the symptoms to estimate level of driver hypo-vigilance. There are three main contributions in the introduced method: (1) simple and efficient head rotation detection based on face template matching, (2) adaptive symptom extraction from eye region without explicit eye detection, and (3) normalizing and personalizing the extracted symptoms using a short training phase. These three contributions lead to develop an adaptive driver eye/face monitoring. Experiments show that the proposed system is relatively efficient for estimating the driver fatigue and distraction.

[1]  Pengfei Shi,et al.  Yawning detection for determining driver drowsiness , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..

[2]  Wen-Bing Horng,et al.  Driver fatigue detection based on eye tracking and dynamk, template matching , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[3]  Reza Aghaeizadeh Zoroofi,et al.  Drowsiness Detection Based on Brightness and Numeral Features of Eye Image , 2009, 2009 Fifth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[4]  Ying Zheng,et al.  Robust and precise eye detection based on locally selective projection , 2008, 2008 19th International Conference on Pattern Recognition.

[5]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[6]  Yong Du,et al.  Driver Fatigue Detection based on Eye State Analysis , 2008 .

[7]  Robert Zobel,et al.  Don't Sleep and Drive - VW's Fatigue Detection Technology , 2005 .

[8]  H. Cai,et al.  An Experiment to Non-Intrusively Collect Physiological Parameters towards Driver State Detection , 2007 .

[9]  Shervin Shirmohammadi,et al.  Driver drowsiness monitoring based on yawning detection , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[10]  Andry Rakotonirainy,et al.  Affordable visual driver monitoring system for fatigue and monotony , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[11]  José María Armingol,et al.  Driver drowsiness detection system under infrared illumination for an intelligent vehicle , 2011 .

[12]  Tzyy-Ping Jung,et al.  Adaptive EEG-Based Alertness Estimation System by Using ICA-Based Fuzzy Neural Networks , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[14]  Arturo de la Escalera,et al.  Driver Drowsiness Warning System Using Visual Information for Both Diurnal and Nocturnal Illumination Conditions , 2010, EURASIP J. Adv. Signal Process..

[15]  M. Sigari,et al.  Fuzzy Running Average and Fuzzy Background Subtraction: Concepts and Application , 2008 .

[16]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Jing Han,et al.  Driver fatigue detection based on fuzzy fusion , 2008, 2008 Chinese Control and Decision Conference.

[18]  Brian N. Fildes,et al.  Review of crash effectiveness of intelligent transport systems , 2007 .

[19]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[20]  T J Triggs,et al.  DRIVER FATIGUE: CONCEPTS, MEASUREMENT AND CRASH COUNTERMEASURES , 1988 .

[21]  Mohan M. Trivedi,et al.  Facial Action Coding Using Multiple Visual Cues and a Hierarchy of Particle Filters , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[22]  中川 剛,et al.  Drowsiness detection using spectrum analysis of eye movements and effective stimuli to keep drivers awake (特集 安全技術) , 2007 .

[23]  B. Carnahan,et al.  A drowsy driver detection system for heavy vehicles , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[24]  Jiashu Zhang,et al.  Driver Fatigue Detection Based Intelligent Vehicle Control , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[25]  Jorge Batista,et al.  A Drowsiness and Point of Attention Monitoring System for Driver Vigilance , 2007, 2007 IEEE Intelligent Transportation Systems Conference.

[26]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[27]  Yong Zhao,et al.  A practical driver fatigue detection algorithm based on eye state , 2010, 2010 Asia Pacific Conference on Postgraduate Research in Microelectronics and Electronics (PrimeAsia).

[28]  Xiaojuan Wu,et al.  Fatigue detection based on the distance of eyelid , 2005, Proceedings of 2005 IEEE International Workshop on VLSI Design and Video Technology, 2005..