Automatic 3D facial segmentation and landmark detection

This paper presents our methodology for face and facial features detection to improve 3D face recognition in a presence of facial expression variation. Our goal was to develop an automatic process to be embedded in a face recognition system, using only range images as input. To do that, our approach combines traditional image segmentation techniques for face segmentation and detect facial features by combining an adapted method for 2D facial features extraction with the surface curvature information. The experiments were performed in a large, well-known face image database available on the Biometric Experimentation Environment (BEE), including 4,950 images. The results confirms that our method is efficient for the proposed application.

[1]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[2]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[3]  Paulo F. U. Gotardo,et al.  Range image segmentation into planar and quadric surfaces using an improved robust estimator and genetic algorithm , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  O.R.P. Bellon,et al.  New improvements to range image segmentation by edge detection , 2002, IEEE Signal Processing Letters.

[6]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[7]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[8]  Luciano Silva,et al.  3D Face Image Registration for Face Matching Guided by the Surface Interpenetration Measure , 2006, 2006 International Conference on Image Processing.

[9]  Qiang Ji,et al.  A new efficient ellipse detection method , 2002, Object recognition supported by user interaction for service robots.

[10]  Patrick J. Flynn,et al.  Adaptive Rigid Multi-region Selection for Handling Expression Variation in 3D Face Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[11]  Michael G. Strintzis,et al.  Face localization and authentication using color and depth images , 2005, IEEE Transactions on Image Processing.

[12]  Linda G. Shapiro,et al.  Computer Vision , 2001 .