Registration of 3-dimensional facial photographs for clinical use.

PURPOSE To objectively evaluate treatment outcomes in oral and maxillofacial surgery, pre- and post-treatment 3-dimensional (3D) photographs of the patient's face can be registered. For clinical use, it is of great importance that this registration process is accurate (< 1 mm). The purpose of this study was to determine the accuracy of different registration procedures. MATERIALS AND METHODS Fifteen volunteers (7 males, 8 females; mean age, 23.6 years; range, 21 to 26 years) were invited to participate in this study. Three-dimensional photographs were captured at 3 different times: baseline (T(0)), after 1 minute (T(1)), and 3 weeks later (T(2)). Furthermore, a 3D photograph of the volunteer laughing (T(L)) was acquired to investigate the effect of facial expression. Two different registration methods were used to register the photographs acquired at all different times: surface-based registration and reference-based registration. Within the surface-based registration, 2 different software packages (Maxilim [Medicim NV, Mechelen, Belgium] and 3dMD Patient [3dMD LLC, Atlanta, GA]) were used to register the 3D photographs acquired at the various times. The surface-based registration process was repeated with the preprocessed photographs. Reference-based registration (Maxilim) was performed twice by 2 observers investigating the inter- and intraobserver error. RESULTS The mean registration errors are small for the 3D photographs at rest (0.39 mm for T(0)-T(1) and 0.52 mm for T(0)-T(2)). The mean registration error increased to 1.2 mm for the registration between the 3D photographs acquired at T(0) and T(L). The mean registration error for the reference-based method was 1.0 mm for T(0)-T(1), 1.1 mm for T(0)-T(2), and 1.5 mm for T(0) and T(L). The mean registration errors for the preprocessed photographs were even smaller (0.30 mm for T(0)-T(1), 0.42 mm for T(0)-T(2), and 1.2 mm for T(0) and T(L)). Furthermore, a strong correlation between the results of both software packages used for surface-based registration was found. The intra- and interobserver error for the reference-based registration method was found to be 1.2 and 1.0 mm, respectively. CONCLUSION Surface-based registration is an accurate method to compare 3D photographs of the same individual at different times. When performing the registration procedure with the preprocessed photographs, the registration error decreases. No significant difference could be found between both software packages that were used to perform surface-based registration.

[1]  Kristina Aldridge,et al.  Precision and error of three‐dimensional phenotypic measures acquired from 3dMD photogrammetric images , 2005, American journal of medical genetics. Part A.

[2]  岡田 恵美,et al.  Three-dimensional facial simulations and measurements : Changes of facial contour and units associated with facial expression , 2001 .

[3]  Hyoung-Seon Baik,et al.  Facial soft-tissue analysis of Korean adults with normal occlusion using a 3-dimensional laser scanner. , 2007, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[4]  J. P. Moss,et al.  Three-dimensional assessment of treatment outcomes on the face. , 2003, Orthodontics & craniofacial research.

[5]  E M Bronkhorst,et al.  Evaluation of reproducibility and reliability of 3D soft tissue analysis using 3D stereophotogrammetry. , 2009, International journal of oral and maxillofacial surgery.

[6]  S. Richmond,et al.  Reliability of measuring facial morphology with a 3-dimensional laser scanning system. , 2005, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[7]  W R Fright,et al.  A three dimensional analysis of soft and hard tissue changes following bimaxillary orthognathic surgery in skeletal III patients. , 1992, The British journal of oral & maxillofacial surgery.

[8]  B Solow,et al.  Natural head position in standing subjects. , 1971, Acta odontologica Scandinavica.

[9]  S. C. Aung,et al.  Evaluation of the laser scanner as a surface measuring tool and its accuracy compared with direct facial anthropometric measurements. , 1995, British journal of plastic surgery.

[10]  Lili Ma,et al.  Validation of a three-dimensional facial scanning system based on structured light techniques , 2009, Comput. Methods Programs Biomed..

[11]  K F Moos,et al.  Three-dimensional modeling for modern diagnosis and planning in maxillofacial surgery. , 1996, The International journal of adult orthodontics and orthognathic surgery.

[12]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[13]  K Kimoto,et al.  Evaluation of a 3D digital photographic imaging system of the human face. , 2007, Journal of oral rehabilitation.

[14]  T. Coward,et al.  Laser scanning for the identification of repeatable landmarks of the ears and face. , 1997, British journal of plastic surgery.

[15]  Siegmar Reinert,et al.  Digital Surface Photogrammetry for Anthropometric Analysis of the Cleft Infant Face , 2006, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[16]  K F Moos,et al.  A vision-based three-dimensional capture system for maxillofacial assessment and surgical planning. , 1998, British Journal of Oral and Maxillofacial Surgery.

[17]  W. Mollemans,et al.  The accuracy of matching three-dimensional photographs with skin surfaces derived from cone-beam computed tomography. , 2008, International journal of oral and maxillofacial surgery.

[18]  F. Zhang,et al.  Assessment of facial tissue expansion with three-dimensional digitizer scanning. , 2002, The Journal of craniofacial surgery.

[19]  Tomohiro Yamada,et al.  Three-Dimensional Analysis of Facial Morphology in Normal Japanese Children as Control Data for Cleft Surgery , 2002 .

[20]  Alf D. Linney,et al.  Three-Dimensional Analysis Techniques—Part 3: Color-Coded System for Three-Dimensional Measurement of Bone and Ratio of Soft Tissue to Bone: The Analysis , 1997 .

[21]  Samson Lee,et al.  Three-dimensional photography and its application to facial plastic surgery. , 2004, Archives of facial plastic surgery.

[22]  M Krimmel,et al.  Bewertung von Präzision und Genauigkeit der digitalen Oberflächenphotogrammetrie mit dem DSP 400 System / Assessment of Precision and Accuracy of Digital Surface Photogrammetry with the DSP 400 System , 2005, Biomedizinische Technik. Biomedical engineering.

[23]  Mary L Marazita,et al.  Digital Three-Dimensional Photogrammetry: Evaluation of Anthropometric Precision and Accuracy Using a Genex 3D Camera System , 2004, The Cleft palate-craniofacial journal : official publication of the American Cleft Palate-Craniofacial Association.

[24]  Matthias Teschner,et al.  Verification of clinical precision after computer-aided reconstruction in craniomaxillofacial surgery. , 2007, Oral surgery, oral medicine, oral pathology, oral radiology, and endodontics.

[25]  R. Clark,et al.  Reproducibility of natural head position. , 1991, Journal of dentistry.

[26]  C. Moorrees,et al.  Natural head position and natural head orientation: basic considerations in cephalometric analysis and research. , 1995, European journal of orthodontics.

[27]  A. Coombes,et al.  A mathematical method for the comparison of three-dimensional changes in the facial surface. , 1991, European journal of orthodontics.

[28]  S. Weinberg,et al.  Three-dimensional surface imaging: limitations and considerations from the anthropometric perspective. , 2005, The Journal of craniofacial surgery.

[29]  Leopoldo Altamirano Robles,et al.  Towards an Illumination-Based 3D Active Appearance Model for Fast Face Alignment , 2008, CIARP.

[30]  B. Kusnoto,et al.  Reliability of a 3D surface laser scanner for orthodontic applications. , 2002, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[31]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Patrick J. Flynn,et al.  Accuracy of 3D scanning technologies in a face scanning scenario , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[33]  Sybill Naidoo,et al.  Anthropometric Precision and Accuracy of Digital Three-Dimensional Photogrammetry: Comparing the Genex and 3dMD Imaging Systems with One Another and with Direct Anthropometry , 2006, The Journal of craniofacial surgery.

[34]  M. Bock,et al.  Are Facial Expressions Reproducible? , 2003 .

[35]  C H Kau,et al.  The feasibility of measuring three-dimensional facial morphology in children. , 2004, Orthodontics & craniofacial research.

[36]  R. T. Lee,et al.  A prospective optical surface scanning and cephalometric assessment of the effect of functional appliances on the soft tissues. , 2001, European journal of orthodontics.

[37]  Xun Xu,et al.  Building Large Scale 3D Face Database for Face Analysis , 2007, MCAM.

[38]  J. P. Moss,et al.  Three-dimensional facial growth studied by optical surface scanning , 2000 .

[39]  Joachim Mühling,et al.  Laser-scan-based navigation in cranio-maxillofacial surgery. , 2003, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[40]  K. Bush,et al.  Three-dimensional facial anthropometry using a laser surface scanner: validation of the technique. , 1996, Plastic and reconstructive surgery.

[41]  R. Hennessy,et al.  Three-dimensional assessment of the effects of extraction and nonextraction orthodontic treatment on the face. , 2002, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[42]  Nikolaos A. Papadopulos,et al.  Accuracy and precision of the three-dimensional assessment of the facial surface using a 3-D laser scanner , 2006, IEEE Transactions on Medical Imaging.