Detecting Eyes and Lips Using Neural Networks and SURF Features

In this chapter, the authors elaborate on the facial image segmentation and the detection of eyes and lips using two neural networks. The first neural network is applied to segment skin-colors and the second to detect facial features. As for input vectors, for the second network the authors apply speed-up robust features (SURF) that are not subject to scale and brightness variations. The authors carried out the detection of eyes and lips on two well-known facial feature databases, Caltech. and PICS. Caltech gave a success rate of 92.4% and 92.2% for left and right eyes and 85% for lips, whereas the PCIS database gave 96.9% and 95.3% for left and right eyes and 97.3% for lips. Using videos captured in real environment, among all videos, the authors achieved an average detection rate of 94.7% for the right eye and 95.5% for the left eye with a 86.9% rate for the lips DOI: 10.4018/978-1-61350-429-1.ch018

[1]  Richard H. Middleton,et al.  Game Theory: A Potential Tool for the Design and Analysis of Patient-Robot Interaction Strategies , 2011, Int. J. Ambient Comput. Intell..

[2]  Jane Campbell Mazzagatti.  KStore: A Dynamic Meta-Knowledge Repository for Intelligent BI , 2009, Int. J. Intell. Inf. Technol..

[3]  H. Jamal,et al.  Face detection in color images, a robust and fast statistical approach , 2004, 8th International Multitopic Conference, 2004. Proceedings of INMIC 2004..

[4]  Ioannis Vlahavas,et al.  Artificial Intelligence for Advanced Problem Solving Techniques , 2008 .

[5]  Kyunghee Lee,et al.  Eye and face detection using SVM , 2004, Proceedings of the 2004 Intelligent Sensors, Sensor Networks and Information Processing Conference, 2004..

[6]  Hichem Sahbi,et al.  From coarse to fine skin and face detection , 2000, ACM Multimedia.

[7]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[8]  Riad I. Hammoud,et al.  On Driver Eye Closure Recognition for Commercial Vehicles , 2008 .

[9]  Sridha Sridharan,et al.  Chromatic colour spaces for skin detection using GMMS , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[11]  Frederick C. Harris,et al.  Eye Detection using Wavelets and ANN , 2004 .

[12]  A. Hamdy,et al.  Face detection using PCA and skin-tone extraction for drowsy driver application , 2007, 2007 ITI 5th International Conference on Information and Communications Technology.

[13]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[14]  Daw-Tung Lin,et al.  Real-time eye detection using face-circle fitting and dark-pixel filtering , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[15]  Jorge Batista,et al.  A Real-Time Driver Visual Attention Monitoring System , 2005, IbPRIA.

[16]  Lenskiy Artem,et al.  Face and Iris Detection Algorithm based on SURF and circular Hough Transform , 2010 .

[17]  C. Chen,et al.  Detection of human faces in colour images , 1997 .

[18]  Donghoon Kim,et al.  Face Components Detection Using SURF Descriptors and SVMs , 2008, 2008 International Machine Vision and Image Processing Conference.

[19]  Yibin Li,et al.  Face detection and recognition with SURF for human-robot interaction , 2009, 2009 IEEE International Conference on Automation and Logistics.

[20]  Zhi-Hua Zhou,et al.  Projection functions for eye detection , 2004, Pattern Recognit..

[21]  Yu Song,et al.  Multiresolution eye location from image , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[22]  Vijayan K. Asari,et al.  Neural network based skin color model for face detection , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[23]  Shuyan Zhao,et al.  Robust Eye Detection under Active Infrared Illumination , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[24]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[25]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  David Zhang,et al.  A study of aggregated 2D Gabor features on appearance-based face recognition , 2004, Third International Conference on Image and Graphics (ICIG'04).

[27]  Whoi-Yul Kim,et al.  Eye Detection in Facial Images Using Zernike Moments with SVM , 2008 .

[28]  Mohamed A. Deriche,et al.  Robust human face detection in complex color images , 2005, IEEE International Conference on Image Processing 2005.

[29]  Orlando J. Hernandez,et al.  Face recognition using multispectral random field texture models, color content, and biometric features , 2005, 34th Applied Imagery and Pattern Recognition Workshop (AIPR'05).

[30]  James L. Crowley,et al.  Facial features detection robust to pose, illumination and identity , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[31]  Chu Jiang-wei,et al.  A monitoring method of driver fatigue behavior based on machine vision , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[32]  V. Sugumaran.  The Inaugural Issue of the International Journal of Intelligent Information Technologies , 2005 .

[33]  Héctor Oscar Nigro,et al.  Symbolic Data Analysis: A Paradigm for Complex Data Mining? , 2014, Int. J. Signs Semiot. Syst..