Facial feature detection using distance vector fields

A novel method for eye and mouth detection and eye center and mouth corner localization, based on geometrical information is presented in this paper. First, a face detector is applied to detect the facial region, and the edge map of this region is calculated. The distance vector field of the face is extracted by assigning to every facial image pixel a vector pointing to the closest edge pixel. The x and y components of these vectors are used to detect the eyes and mouth regions. Luminance information is used for eye center localization, after removing unwanted effects, such as specular highlights, whereas the hue channel of the lip area is used for the detection of the mouth corners. The proposed method has been tested on the XM2VTS and BioID databases, with very good results.

[1]  Gabriel Zachmann,et al.  Geometric data structures for computer graphics , 2002, Eurographics.

[2]  Zhi-Hua Zhou,et al.  Projection functions for eye detection , 2004, Pattern Recognit..

[3]  Frank Y. Shih,et al.  Automatic extraction of head and face boundaries and facial features , 2004, Inf. Sci..

[4]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[5]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[6]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  K. Mardia.  Statistics of Directional Data , 1972 .

[8]  Chin-Chuan Han,et al.  Fast face detection via morphology-based pre-processing , 1997, Pattern Recognit..

[9]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[10]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[11]  James L. Crowley,et al.  Facial features detection robust to pose, illumination and identity , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[12]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[13]  Vytautas Perlibakas.  Automatical detection of face features and exact face contour , 2003, Pattern Recognit. Lett..

[14]  Haruki Ueno,et al.  Face Detection and Facial Feature Localization for Human-machine Interface , 2003 .

[15]  P. Danielsson.  Euclidean distance mapping , 1980 .

[16]  Chin-Chuan Han,et al.  Fast face detection via morphology-based pre-processing , 2000, Pattern Recognit..

[17]  Jiri Matas,et al.  XM2VTSDB: The Extended M2VTS Database , 1999 .

[18]  Paul H. Lewis,et al.  A Pre-filter Enabling Fast Frontal Face Detection , 1999, VISUAL.

[19]  Mark W. Jones,et al.  Vector-City Vector Distance Transform , 2001, Comput. Vis. Image Underst..

[20]  Ioannis Pitas,et al.  A novel eye detection algorithm utilizing edge-related geometrical information , 2006, 2006 14th European Signal Processing Conference.

[21]  Jianxin Wu,et al.  Efficient face candidates selector for face detection , 2003, Pattern Recognit..