Improved detection of landmarks on 3D human face data

Craniofacial researchers make heavy use of established facial landmarks in their morphometric analyses. For studies on very large facial image datasets, the standard approach of manual landmarking is very labor intensive. With the goal of producing 20 established landmarks, we have developed a geometric methodology that can automatically locate 10 established landmark points and 7 other supporting points on human 3D facial scans. Then, to improve accuracy and produce all 20 landmarks, a deformable matching procedure establishes a dense correspondence from a template 3D mesh with a full set of 20 landmarks to each individual 3D mesh. The 17 geometrically-determined points on the individual 3D mesh are used for the initial correspondence required by the deformable matching. The method is evaluated on 115 3D facial meshes of normal adults, and results are compared to landmarks manually identified by medical experts. Our results show a marked improvement to prior results in the recent literature.

[1]  Anil K. Jain,et al.  Detection of Anchor Points for 3D Face Veri.cation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[2]  Andrea Cavallaro,et al.  3-D Face Detection, Landmark Localization, and Registration Using a Point Distribution Model , 2009, IEEE Transactions on Multimedia.

[3]  Ioannis A. Kakadiaris,et al.  3D Facial Landmark Detection & Face Registration A 3D Facial Landmark Model & 3D Local Shape Descriptors Approach , 2010 .

[4]  Tieniu Tan,et al.  Combining local features for robust nose location in 3D facial data , 2006, Pattern Recognit. Lett..

[5]  Gary F. Rogers,et al.  Validity and Reliability of Craniofacial Anthropometric Measurement of 3D Digital Photogrammetric Images , 2008, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[6]  Harry Hochheiser,et al.  The FaceBase Consortium: a comprehensive program to facilitate craniofacial research. , 2011, Developmental biology.

[7]  Linda G. Shapiro,et al.  Classification of 3D face shape in 22q11.2 deletion syndrome , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  Jacqueline R Starr,et al.  Picture Perfect? Reliability of Craniofacial Anthropometry Using Three-Dimensional Digital Stereophotogrammetry , 2009, Plastic and reconstructive surgery.

[9]  Anil K. Jain,et al.  Automatic feature extraction for multiview 3D face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[10]  Tsz-Ho Yu,et al.  A Novel Genetic Algorithm for 3D Facial Landmark Localization , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[11]  Zoran Popovic,et al.  The space of human body shapes: reconstruction and parameterization from range scans , 2003, ACM Trans. Graph..

[12]  Linda G. Shapiro,et al.  Head and neck lymph node region delineation with 3-D CT image registration , 2002, AMIA.

[13]  Nick Pears,et al.  Facial Landmark Localisation by Matching Simple Descriptors , 2008 .

[14]  W. C. Chen,et al.  3D face authentication by mutual coupled 3D and 2D feature extraction , 2006, ACM-SE 44.