A fatigue detection system with eyeglasses removal

A fatigue detection system is designed to alert the driver and thus prevent the possible accidents. The detection is mainly based on the result of the face/eye detection or the pupil of the eyeball to determine whether the driver in the fatigue condition or not. Most of the previous studies assume that the driver does not wear the eyeglasses. However, the eye detection is easily influenced by the eyeglasses and thus decreases the correct detection ratio. In order to overcome the influence of the eyeglasses, a fatigue detection method with eyeglass removal is proposed in this paper. Firstly, the face area is detected by using the functions in the OpenCV library. Then, the eyeglasses are removed by using the morphological operations. After eyeglasses removal, the eye areas are detected by using the functions in the OpenCV library and tracking by using a template matching method. The binarization result of the eye area is performed the horizontal projection and Kalman filter. Then, the open/close state of eyes is determined, and then fatigue is determined based on the series state of eyes. Four testing videos are used to evaluate the performance of the proposed method. The average correct detection ratio of the eye state is 88.5% and the fatigue detection can reach 100%. The preliminary results show that the proposed method is feasible.

[1]  Arturo de la Escalera,et al.  Driver Drowsiness Warning System Using Visual Information for Both Diurnal and Nocturnal Illumination Conditions , 2010, EURASIP J. Adv. Signal Process..

[2]  Guangda Su,et al.  Eyeglasses removal from facial images , 2005, Pattern Recognit. Lett..

[3]  Pong C. Yuen,et al.  Human Face Image Searching System Using Sketches , 2007, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[4]  Sei-Wang Chen,et al.  Real-Time Vision-Based Driver Drowsiness/Fatigue Detection System , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[5]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Mei Xie,et al.  A method of driving fatigue detection based on eye location , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[7]  Driss Aboutajdine,et al.  Driver's Fatigue and Drowsiness Detection to Reduce Traffic Accidents on Road , 2011, CAIP.

[8]  Sang Chul Ahn,et al.  Glasses removal from facial image using recursive error compensation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Wen-Bing Horng,et al.  Driver fatigue detection based on eye tracking and dynamk, template matching , 2004, IEEE International Conference on Networking, Sensing and Control, 2004.

[10]  Noelia Hernández,et al.  Vision-based drowsiness detector for a realistic driving simulator , 2010, 13th International IEEE Conference on Intelligent Transportation Systems.

[11]  R.A. Zoroofi,et al.  Open/Closed Eye Analysis for Drowsiness Detection , 2008, 2008 First Workshops on Image Processing Theory, Tools and Applications.

[12]  Mei Xie,et al.  Real-time driver fatigue detection based on simplified landmarks of AAM , 2010, The 2010 International Conference on Apperceiving Computing and Intelligence Analysis Proceeding.

[13]  Yanfeng Sun,et al.  Local Gabor Binary Pattern Random Subspace Method for eyeglasses-face recognition , 2010, 2010 3rd International Congress on Image and Signal Processing.

[14]  V. K. Banga,et al.  Development of a drowsiness warning system based on the fuzzy logic , 2010 .

[15]  Harry Shum,et al.  Automatic eyeglasses removal from face images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Atif Bin Mansoor,et al.  Real Time Eyes Tracking and Classification for Driver Fatigue Detection , 2008, ICIAR.

[17]  Peng Sun,et al.  Drowsiness Detection Based on Eyelid Movement , 2010, 2010 Second International Workshop on Education Technology and Computer Science.