Driver’s eye blinking detection using novel color and texture segmentation algorithms

In this paper we propose a system that measures eye blinking rate and eye closure duration. The system consists of skin-color segmentation, facial features segmentation, iris positioning and blink detection. The proposed skin-segmentation procedure is based on a neural network approximation of a RGB skin-color histogram. This method is robust and adaptive to any skin-color training set. The largest remaining skin-color region among skin-color segmentation results is further segmented into open/closed eyes, lips, nose, eyebrows, and the remaining facial regions using a novel texture segmentation algorithm. The segmentation algorithm classifies pixels according to the highest probability among the estimated facial feature class probability density functions (PDFs). The segmented eye regions are analyzed with the Circular Hough transform with the purpose of finding iris candidates. The finial iris position is selected according to the location of the maximum correlation value obtained from correlation with a predefined mask. The positions of irises and eye states are monitored through time to estimate eye blinking frequency and eye closure duration. The method of the driver drowsiness detection using these parameters is illustrated. The proposed system is tested on CCD and CMOS cameras under different environmental conditions and the experimental results show high system performance.

[1]  Zhi-Hua Zhou,et al.  Projection functions for eye detection , 2004, Pattern Recognit..

[2]  Frederick C. Harris,et al.  Eye Detection using Wavelets and ANN , 2004 .

[3]  Yu Song,et al.  Multiresolution eye location from image , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[4]  Vijayan K. Asari,et al.  Neural network based skin color model for face detection , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[5]  Shuyan Zhao,et al.  Robust Eye Detection under Active Infrared Illumination , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[6]  H. Jamal,et al.  Face detection in color images, a robust and fast statistical approach , 2004, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[7]  A. Hamdy,et al.  Face detection using PCA and skin-tone extraction for drowsy driver application , 2007, 2007 ITI 5th International Conference on Information and Communications Technology.

[8]  J. Horne,et al.  Sleep related vehicle accidents , 1995, BMJ.

[9]  Artem Lenskiy,et al.  Detecting Eyes and Lips Using Neural Networks and SURF Features , 2012 .

[10]  Daw-Tung Lin,et al.  Real-time eye detection using face-circle fitting and dark-pixel filtering , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[11]  Jong-Soo Lee,et al.  Terrain images segmentation in infra-red spectrum for autonomous robot navigation , 2010, International Forum on Strategic Technology 2010.

[12]  Tim Horberry,et al.  REVIEW OF FATIGUE DETECTION AND PREDICTION TECHNOLOGIES , 2000 .

[13]  James L. Crowley,et al.  Facial features detection robust to pose, illumination and identity , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[14]  Chu Jiang-wei,et al.  A monitoring method of driver fatigue behavior based on machine vision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[15]  Mohamed A. Deriche,et al.  Robust human face detection in complex color images , 2005, IEEE International Conference on Image Processing 2005.

[16]  Lenskiy Artem,et al.  Face and Iris Detection Algorithm based on SURF and circular Hough Transform , 2010 .

[17]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[18]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Kang-Hyun Jo,et al.  Vehicle license plate tilt correction based on the straight line fitting method and minimizing variance of coordinates of projection points , 2010 .

[20]  P. Caffier,et al.  Experimental evaluation of eye-blink parameters as a drowsiness measure , 2003, European Journal of Applied Physiology.

[21]  Jong-Soo Lee,et al.  Rugged terrain segmentation based on salient features , 2010, ICCAS 2010.

[22]  Orlando J. Hernandez,et al.  Face recognition using multispectral random field texture models, color content, and biometric features , 2005, 34th Applied Imagery and Pattern Recognition Workshop (AIPR'05).

[23]  Robert Grover Brown,et al.  Introduction to random signals and applied Kalman filtering : with MATLAB exercises and solutions , 1996 .

[24]  Kyunghee Lee,et al.  Eye and face detection using SVM , 2004, Proceedings of the 2004 Intelligent Sensors, Sensor Networks and Information Processing Conference, 2004..

[25]  Sridha Sridharan,et al.  Chromatic colour spaces for skin detection using GMMS , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[27]  J.M. Armingol,et al.  Real-time drowsiness detection system for an intelligent vehicle , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[28]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[29]  Jorge Batista,et al.  A Real-Time Driver Visual Attention Monitoring System , 2005, IbPRIA.

[30]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[31]  C. Chen,et al.  Detection of human faces in colour images , 1997 .

[32]  David Zhang,et al.  A study of aggregated 2D Gabor features on appearance-based face recognition , 2004, Third International Conference on Image and Graphics (ICIG'04).

[33]  Cataldo Guaragnella,et al.  A visual approach for driver inattention detection , 2007, Pattern Recognit..

[34]  Hichem Sahbi,et al.  From coarse to fine skin and face detection , 2000, ACM Multimedia.

[35]  Whoi-Yul Kim,et al.  Eye Detection in Facial Images Using Zernike Moments with SVM , 2008 .

[36]  Riad I. Hammoud,et al.  On Driver Eye Closure Recognition for Commercial Vehicles , 2008 .