A Drowsiness and Point of Attention Monitoring System for Driver Vigilance

This paper presents a framework that combines a robust facial features location with an elliptical face modelling to measure driver's vigilance level. The proposed solution deals with the computation of eyelid movement parameters and head (face) point of attention. The most important facial feature points are automatically detected using a statistically anthropometric face model. After observing the structural symmetry of the human face and performing some anthropometric measurements, the system is able to build a model that can be used in isolating the most important facial feature areas: mouth, eyes and eyebrows. Combination of different image processing techniques are applied within the selected regions for detecting the most important facial feature points. A model based approach is used to estimate the 3D orientation of the human face. The shape of the face is modelled as an ellipse assuming that the human face aspect ratio (ratio of the major to minor axes of the 3D face ellipse) is known. The elliptical fitting of the face at the image level is constrained by the location of the eyes which considerable increase the performance of the system. The system is fully automatic and classifies rotation in all-view direction, detects eye blinking and eye closure and recovers the principal facial features points over a wide range of human head rotations. Experimental results using real images sequences demonstrates the accuracy and robustness of the proposed solution.

[1]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  B. Carnahan,et al.  A drowsy driver detection system for heavy vehicles , 1998, 17th DASC. AIAA/IEEE/SAE. Digital Avionics Systems Conference. Proceedings (Cat. No.98CH36267).

[3]  Shinn-Ying Ho,et al.  An analytic solution for the pose determination of human faces from a monocular image , 1998, Pattern Recognit. Lett..

[4]  Roberto Cipolla,et al.  Determining the gaze of faces in images , 1994, Image Vis. Comput..

[5]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[6]  Mubarak Shah,et al.  Determining driver visual attention with one camera , 2003, IEEE Trans. Intell. Transp. Syst..

[7]  C. Cacou.  Anthropometry of the head and face , 1995 .

[8]  Xu Yanjun,et al.  Locating facial features with color information , 1998, ICSP '98. 1998 Fourth International Conference on Signal Processing (Cat. No.98TH8344).

[9]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[10]  Ioannis Pitas,et al.  Facial Feature Extraction and Determination of Pose , 1998, NMBIA.

[11]  Jian-Gang Wang,et al.  Study on eye gaze estimation , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[12]  P Sherry.  FATIGUE COUNTERMEASURES IN THE RAILROAD INDUSTRY: PAST AND CURRENT DEVELOPMENTS , 2000 .

[13]  Suphakant Phimoltares,et al.  Locating essential facial features using neural visual model , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[14]  Larry S. Davis,et al.  Computing 3-D head orientation from a monocular image sequence , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[15]  Qiang Ji,et al.  3D Face pose estimation and tracking from a monocular camera , 2002, Image Vis. Comput..

[16]  Stanley T. Birchfield,et al.  Elliptical head tracking using intensity gradients and color histograms , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[17]  Alexander Zelinsky,et al.  An algorithm for real-time stereo vision implementation of head pose and gaze direction measurement , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[18]  Pong C. Yuen,et al.  Variance projection function and its application to eye detection for human face recognition , 1998, Pattern Recognit. Lett..

[19]  Paul Kuo,et al.  An improved eye feature extraction algorithm based on deformable templates , 2005, IEEE International Conference on Image Processing 2005.

[20]  Vladimir Vezhnevets,et al.  Robust and Accurate Eye Contour Extraction , 2003 .

[21]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[22]  Hongbin Zha,et al.  A new method of detecting human eyelids based on deformable templates , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[23]  Hiroshi Ueno,et al.  DEVELOPMENT OF A DROWSINESS WARNING SYSTEM , 1995 .

[24]  Mubarak Shah,et al.  Automatic Feature Detection and Pose Recovery for Faces , 2002 .

[25]  Richard Grace,et al.  Application of a Heavy Vehicle Drowsy Driver Detection System , 1999 .