Shape-based Classification of 3d Facial Data to Support 22q11.2ds Craniofacial Research

Abstract3D imaging systems are used to construct high-resolution meshes of patient’s heads that can be analyzed by computer algorithms. Our work starts with such 3D head meshes and produces both global and local descriptors of 3D shape. Since these descriptors are numeric feature vectors, they can be used in both classification and quantification of various different abnormalities. In this paper, we define these descriptors, describe our methodology for constructing them from 3D head meshes, and show through a set of classification experiments involving cases and controls for a genetic disorder called 22q11.2 deletion syndrome that they are suitable for use in craniofacial research studies. The main contributions of this work include: automatic generation of novel global and local data representations, robust automatic placement of anthropometric landmarks, generation of local descriptors for nasal and oral facial features from landmarks, use of local descriptors for predicting various local facial features, and use of global features for 22q11.2DS classification, showing their potential use as descriptors in craniofacial research.

[1]  Linda G. Shapiro,et al.  A Symbolic Shape-based Retrieval of Skull Images , 2005, AMIA.

[2]  Volker Blanz,et al.  A Learning-Based High-Level Human Computer Interface for Face Modeling and Animation , 2007, Artifical Intelligence for Human Computing.

[3]  L Guyot,et al.  Craniofacial anthropometric analysis in patients with 22q11 microdeletion. , 2001, American journal of medical genetics.

[4]  Harry Hochheiser,et al.  The FaceBase Consortium: a comprehensive program to facilitate craniofacial research. , 2011, Developmental biology.

[5]  Linda G. Shapiro,et al.  Classification of 3D face shape in 22q11.2 deletion syndrome , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[6]  Peter Hammond,et al.  The use of 3D face shape modelling in dysmorphology , 2007, Archives of Disease in Childhood.

[7]  Sami Romdhani,et al.  3D Probabilistic Feature Point Model for Object Detection and Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Sen Wang,et al.  Conformal Geometry and Its Applications on 3D Shape Matching, Recognition, and Stitching , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[10]  Patrick J. Flynn,et al.  A Survey Of 3D and Multi-Modal 3D+2D Face Recognition , 2004 .

[11]  R. Shprintzen Velo-cardio-facial syndrome: 30 Years of study. , 2008, Developmental disabilities research reviews.

[12]  A. Karmiloff-Smith,et al.  Discriminating power of localized three-dimensional facial morphology. , 2005, American journal of human genetics.

[13]  William E. Lorensen,et al.  The design and implementation of an object-oriented toolkit for 3D graphics and visualization , 1996, Proceedings of Seventh Annual IEEE Visualization '96.

[14]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[15]  Robin J. Hennessy,et al.  Three-Dimensional Laser Surface Imaging and Geometric Morphometrics Resolve Frontonasal Dysmorphology in Schizophrenia , 2007, Biological Psychiatry.

[16]  Jacqueline R Starr,et al.  Picture Perfect? Reliability of Craniofacial Anthropometry Using Three-Dimensional Digital Stereophotogrammetry , 2009, Plastic and reconstructive surgery.

[17]  R. Shprintzen,et al.  Velocardiofacial syndrome. , 2000, Otolaryngologic clinics of North America.

[18]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  L. Shapiro,et al.  Automatic analysis of local nasal features in 22q11.2DS affected individuals , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  George C. Stockman,et al.  Canonical Face Depth Map: A Robust 3D Representation for Face Verification , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Jae-Chang Shim,et al.  3D Facial Image Recognition Using a Nose Volume and Curvature Based Eigenface , 2006, GMP.

[22]  Pedro M. Domingos,et al.  On the Optimality of the Simple Bayesian Classifier under Zero-One Loss , 1997, Machine Learning.

[23]  R. Gur,et al.  Automated video-based facial expression analysis of neuropsychiatric disorders , 2008, Journal of Neuroscience Methods.

[24]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  R. Veltkamp,et al.  Landmark Detection on 3 D Face Scans by Facial Model Registration , 2006 .

[26]  Ashwin B. Dalal,et al.  Morphometric analysis of face in dysmorphology , 2007, Comput. Methods Programs Biomed..

[27]  B. Collett,et al.  Reading in children with orofacial clefts versus controls. , 2010, Journal of pediatric psychology.

[28]  S. Clarren,et al.  Measuring the facial phenotype of individuals with prenatal alcohol exposure: correlations with brain dysfunction. , 2001, Alcohol and alcoholism.

[29]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Ilkay Ulusoy,et al.  3D Object Representation Using Transform and Scale Invariant 3D Features , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[31]  R. Hennekam,et al.  3D analysis of facial morphology , 2004, American journal of medical genetics. Part A.

[32]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[33]  Sami Romdhani,et al.  Estimating 3D shape and texture using pixel intensity, edges, specular highlights, texture constraints and a prior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[34]  I. Jolliffe Principal Component Analysis , 2002 .

[35]  L G Shapiro,et al.  Three-Dimensional Head Shape Quantification for Infants with and without Deformational Plagiocephaly , 2009, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[36]  Linda G. Shapiro,et al.  Symbolic signatures for deformable shapes , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Tobias Vollmar,et al.  Syndrome identification based on 2D analysis software , 2006, European Journal of Human Genetics.

[38]  Anuj Srivastava,et al.  Three-Dimensional Face Recognition Using Shapes of Facial Curves , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.