Exploiting Voronoi diagram properties in face segmentation and feature extraction

Segmentation of human faces from still images is a research field of rapidly increasing interest. Although the field encounters several challenges, this paper seeks to present a novel face segmentation and facial feature extraction algorithm for gray intensity images (each containing a single face object). Face location and extraction must first be performed to obtain the approximate, if not exact, representation of a given face in an image. The proposed approach is based on the Voronoi diagram (VD), a well-known technique in computational geometry, which generates clusters of intensity values using information from the vertices of the external boundary of Delaunay triangulation (DT). In this way, it is possible to produce segmented image regions. A greedy search algorithm looks for a particular face candidate by focusing its action in elliptical-like regions. VD is presently employed in many fields, but researchers primarily focus on its use in skeletonization and for generating Euclidean distances; this work exploits the triangulations (i.e., Delaunay) generated by the VD for use in this field. A distance transformation is applied to segment face features. We used the BioID face database to test our algorithm. We obtained promising results: 95.14% of faces were correctly segmented; 90.2% of eyes were detected and a 98.03% detection rate was obtained for mouth and nose.

[1]  Karim Faez,et al.  An efficient method for recognition of human faces using higher orders Pseudo Zernike Moment Invariant , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[2]  Tsuyoshi Kawaguchi,et al.  Automatic eye detection using intensity and edge information , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[3]  Kin-Man Lam,et al.  Face recognition using elastic local reconstruction based on a single face image , 2008, Pattern Recognit..

[4]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[5]  Lawrence O'Gorman,et al.  Practical Algorithms for Image Analysis: Description, Examples and Code , 2000 .

[6]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[8]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[9]  Nikolaos G. Bourbakis,et al.  A Local-Global Graph Approach for Facial Expression Recognition , 2006, 2006 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'06).

[10]  Jing Li Wang,et al.  Color image segmentation: advances and prospects , 2001, Pattern Recognit..

[11]  Shih-Fu Chang,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997, IEEE Trans. Circuits Syst. Video Technol..

[12]  Kin-Man Lam,et al.  An efficient algorithm for human face detection and facial feature extraction under different conditions , 2001 .

[13]  M. Burge,et al.  Ear Biometrics , 1998 .

[14]  Chin-Chuan Han,et al.  Fast face detection via morphology-based pre-processing , 1997, Pattern Recognit..

[15]  Tieniu Tan,et al.  A new face detection method based on shape information , 2000, Pattern Recognit. Lett..

[16]  Anna Esposito,et al.  Fundamentals of verbal and nonverbal communication and the biometric issue , 2007 .

[17]  Thomas S. Huang,et al.  Facial feature extraction from color images , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[18]  Azriel Rosenfeld,et al.  Eye detection in a face image using linear and nonlinear filters , 2001, Pattern Recognit..

[19]  Vytautas Perlibakas Automatical detection of face features and exact face contour , 2003, Pattern Recognit. Lett..

[20]  Bogdan Kwolek Face tracking system based on color, stereovision and elliptical shape features , 2003, Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2003..

[21]  Marina L. Gavrilova,et al.  3D Facial Model Synthesis using Voronoi Approach , 2006, 2006 3rd International Symposium on Voronoi Diagrams in Science and Engineering.

[22]  Zheru Chi,et al.  A robust eye detection method using combined binary edge and intensity information , 2006, Pattern Recognit..

[23]  Yee-Hong Yang,et al.  Region-based face detection , 2002, Pattern Recognit..

[24]  Kevin Curran,et al.  Biometric Inspired Digital Image Steganography , 2008, 15th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ecbs 2008).

[25]  Kevin W. Bowyer,et al.  Face recognition technology: security versus privacy , 2004, IEEE Technology and Society Magazine.

[26]  Hao Zhang,et al.  Expression-Invariant Face Recognition with Expression Classification , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[27]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Saeid Nahavandi,et al.  A morphing technique for facial image representation , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[29]  Ioannis Pitas,et al.  Face localization and facial feature extraction based on shape and color information , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[30]  Chin-Chuan Han,et al.  Fast face detection via morphology-based pre-processing , 2000, Pattern Recognit..

[31]  Ioannis Pitas,et al.  Extraction of facial regions and features using color and shape information , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[32]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Lei Huang,et al.  Eye Location using Hierarchical Classifier , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[34]  Olac Fuentes,et al.  Face detection using combinations of classifiers , 2005, The 2nd Canadian Conference on Computer and Robot Vision (CRV'05).

[35]  Narendra Ahuja,et al.  Dot Pattern Processing Using Voronoi Neighborhoods , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  John S. Zelek,et al.  Local Graph Matching for Face Recognition , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[37]  Frank Y. Shih,et al.  Automatic extraction of head and face boundaries and facial features , 2004, Inf. Sci..

[38]  Hong Yan,et al.  Facial Feature Location with Delaunay Triangulation/Voronoi Diagram Calculation , 2001, VIP.

[39]  Ahmet M. Kondoz,et al.  Automatic scalable face model design for 2D model-based video coding , 2004, Signal Process. Image Commun..

[40]  Mohammad S. Obaidat,et al.  Content-based image segmentation , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[41]  Hong Yan,et al.  Face Boundary Extraction , 2003, DICTA.

[42]  Eli Saber,et al.  Frontal-view face detection and facial feature extraction using color, shape and symmetry based cost functions , 1998, Pattern Recognit. Lett..

[43]  Michael G. Strintzis,et al.  Face localization and authentication using color and depth images , 2005, IEEE Transactions on Image Processing.

[44]  Pong C. Yuen,et al.  Multi-cues eye detection on gray intensity image , 2001, Pattern Recognit..

[45]  ChangShih-Fu,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997 .

[46]  Ioannis T. Pavlidis,et al.  Face Detection in the Near-IR Spectrum , 2003, Image Vis. Comput..

[47]  Luciano da Fontoura Costa,et al.  Shape Analysis and Classification: Theory and Practice , 2000 .

[48]  Jiri Matas,et al.  Feature-based affine-invariant localization of faces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Harry Shum,et al.  Image segmentation by data driven Markov chain Monte Carlo , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.