Robust eyelid tracking for fatigue detection

We develop a non-intrusive system for monitoring fatigue by tracking eyelids with a single web camera. Tracking slow eyelid closures is one of the most reliable ways to monitor fatigue during critical performance tasks. The challenges come from arbitrary head movement, occlusion, reflection of glasses, motion blurs, etc. We model the shape of eyes using a pair of parameterized parabolic curves, and fit the model in each frame to maximize the total likelihood of the eye regions. Our system is able to track face movement and fit eyelids reliably in real time. We test our system with videos captured from both alert and drowsy subjects. The experiment results prove the effectiveness of our system.

[1]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[2]  Jiri Matas,et al.  Feature-based affine-invariant localization of faces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Lin Sun,et al.  Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[5]  Azriel Rosenfeld,et al.  A method of detecting and tracking irises and eyelids in video , 2002, Pattern Recognit..

[6]  Horst Bischof,et al.  Eye Blink Based Fatigue Detection for Prevention of Computer Vision Syndrome , 2009, MVA.

[7]  Zhi-Hua Zhou,et al.  Enhanced Pictorial Structures for precise eye localization under incontrolled conditions , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Zhi-Hua Zhou,et al.  Enhanced Pictorial Structures for precise eye localization under incontrolled conditions , 2009, CVPR.

[9]  Fei Yang,et al.  Eye localization through multiscale sparse dictionaries , 2011, Face and Gesture 2011.

[10]  Margrit Betke,et al.  Real Time Eye Tracking and Blink Detection with USB Cameras , 2005 .

[11]  Zhi-Hua Zhou,et al.  EnhancedPictorial Structures for Precise Eye Localization Under Uncontrolled Conditions , 2009 .

[12]  D. Dinges,et al.  EVALUATION OF TECHNIQUES FOR OCULAR MEASUREMENT AS AN INDEX OF FATIGUE AND THE BASIS FOR ALERTNESS MANAGEMENT , 1998 .

[13]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[15]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[17]  Paul Blenkhorn,et al.  Blink detection for real-time eye tracking , 2002, J. Netw. Comput. Appl..