Three-Dimensional Craniofacial Landmark Detection in Series of CT Slices Using Multi-Phased Regression Networks

Geometrical assessments of human skulls have been conducted based on anatomical landmarks. If developed, the automatic detection of these landmarks will yield both medical and anthropological benefits. In this study, an automated system with multi-phased deep learning networks was developed to predict the three-dimensional coordinate values of craniofacial landmarks. Computed tomography images of the craniofacial area were obtained from a publicly available database. They were digitally reconstructed into three-dimensional objects. Sixteen anatomical landmarks were plotted on each of the objects, and their coordinate values were recorded. Three-phased regression deep learning networks were trained using ninety training datasets. For the evaluation, 30 testing datasets were employed. The 3D error for the first phase, which tested 30 data, was 11.60 px on average (1 px = 500/512 mm). For the second phase, it was significantly improved to 4.66 px. For the third phase, it was further significantly reduced to 2.88. This was comparable to the gaps between the landmarks, as plotted by two experienced practitioners. Our proposed method of multi-phased prediction, which conducts coarse detection first and narrows down the detection area, may be a possible solution to prediction problems, taking into account the physical limitations of memory and computation.

[1]  M. Fraz,et al.  CEPHA29: Automatic Cephalometric Landmark Detection Challenge 2023 , 2022, ArXiv.

[2]  Anand Marya,et al.  Development, Application, and Performance of Artificial Intelligence in Cephalometric Landmark Identification and Diagnosis: A Systematic Review , 2022, Healthcare.

[3]  Chang Min Hyun,et al.  A semi-supervised learning approach for automated 3D cephalometric landmark identification using computed tomography , 2022, PloS one.

[4]  G. Dot,et al.  Automatic 3-Dimensional Cephalometric Landmarking via Deep Learning , 2022, Journal of dental research.

[5]  C. Schwahn,et al.  Cephalometric analyses for cleft patients: a statistical approach to compare the variables of Delaire’s craniofacial analysis to Bergen analysis , 2021, Clinical oral investigations.

[6]  Hyo-Won Ahn,et al.  Automatic Cephalometric Landmark Identification System Based on the Multi-Stage Convolutional Neural Networks with CBCT Combination Images , 2021, Sensors.

[7]  Youngsung Yu,et al.  How much deep learning is enough for automatic identification to be reliable? , 2020, The Angle orthodontist.

[8]  T. Fujiwara,et al.  Locating cephalometric landmarks with multi-phase deep learning , 2020, medRxiv.

[9]  Hannah Kim,et al.  Web-based fully automated cephalometric analysis by deep learning , 2020, Comput. Methods Programs Biomed..

[10]  Soh Nishimoto,et al.  Cephalometric Landmark Location with Multi-phase Deep Learning , 2020 .

[11]  P. Rouch,et al.  Accuracy and reliability of automatic three-dimensional cephalometric landmarking. , 2020, International journal of oral and maxillofacial surgery.

[12]  Jin Keun Seo,et al.  Learning-based local-to-global landmark annotation for automatic 3D cephalometry , 2020, Physics in medicine and biology.

[13]  Wenping Wang,et al.  Cephalometric Landmark Detection by AttentiveFeature Pyramid Fusion and Regression-Voting , 2019, MICCAI.

[14]  Christian Payer,et al.  Integrating spatial configuration into heatmap regression based CNNs for landmark localization , 2019, Medical Image Anal..

[15]  Jin Keun Seo,et al.  Automatic Three-Dimensional Cephalometric Annotation System Using Three-Dimensional Convolutional Neural Networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[16]  Ulas Bagci,et al.  Deep Geodesic Learning for Segmentation and Anatomical Landmarking , 2018, IEEE Transactions on Medical Imaging.

[17]  Marcelo Romero,et al.  Hybrid approach for automatic cephalometric landmark annotation on cone‐beam computed tomography volumes , 2018, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[18]  Manfred Kayser,et al.  Automated human skull landmarking with 2D Gabor wavelets , 2018, Physics in medicine and biology.

[19]  Alison Q. O'Neil,et al.  Attaining Human-Level Performance with Atlas Location Autocontext for Anatomical Landmark Detection in 3D CT Data , 2018, ECCV Workshops.

[20]  Marcelo Romero,et al.  Automatic 3‐dimensional cephalometric landmarking based on active shape models in related projections , 2018, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[21]  Rajiv Balachandran,et al.  Automatic localization of three-dimensional cephalometric landmarks on CBCT images by extracting symmetry features of the skull. , 2018, Dento maxillo facial radiology.

[22]  Dinggang Shen,et al.  Joint Craniomaxillofacial Bone Segmentation and Landmark Digitization by Context-Guided Fully Convolutional Networks , 2017, MICCAI.

[23]  Bulat Ibragimov,et al.  Fully automated quantitative cephalometry using convolutional neural networks , 2017, Journal of medical imaging.

[24]  Ching-Wei Wang,et al.  Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms , 2016, Scientific Reports.

[25]  Yaozong Gao,et al.  Automatic Craniomaxillofacial Landmark Digitization via Segmentation-Guided Partially-Joint Regression Forest Model and Multiscale Statistical Features , 2016, IEEE Transactions on Biomedical Engineering.

[26]  Timothy F. Cootes,et al.  A benchmark for comparison of dental radiography analysis algorithms , 2016, Medical Image Anal..

[27]  M. Hans,et al.  History of imaging in orthodontics from Broadbent to cone-beam computed tomography. , 2015, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[28]  Rajiv Balachandran,et al.  A knowledge-based algorithm for automatic detection of cephalometric landmarks on CBCT images , 2015, International Journal of Computer Assisted Radiology and Surgery.

[29]  Chengwen Chu,et al.  Evaluation and Comparison of Anatomical Landmark Detection Methods for Cephalometric X-Ray Images: A Grand Challenge , 2015, IEEE Transactions on Medical Imaging.

[30]  Ali Zamani,et al.  The accuracy of a designed software for automated localization of craniofacial landmarks on CBCT images , 2014, BMC Medical Imaging.

[31]  T. Uysal,et al.  Measurements from conventional, digital and CT-derived cephalograms: a comparative study. , 2012, Australian orthodontic journal.

[32]  S. Padmanabhan,et al.  Evaluation of the accuracy of linear measurements on spiral computed tomography-derived three-dimensional images and its comparison with digital cephalometric radiography. , 2010, Dento maxillo facial radiology.

[33]  Masakazu Yagi,et al.  Automated cephalometry: system performance reliability using landmark-dependent criteria. , 2009, The Angle orthodontist.

[34]  B. Holly Broadbent,et al.  A NEW X-RAY TECHNIQUE and ITS APPLICATION TO ORTHODONTIA , 2009 .

[35]  Concetto Spampinato,et al.  Automatic cephalometric analysis. , 2009, The Angle orthodontist.

[36]  Saeed Sadri,et al.  Discrimination of Bony Structures in Cephalograms for Automatic Landmark Detection , 2008, CSICC.

[37]  A. Björk Sutural growth of the upper face studied by the implant method. , 2007, Acta odontologica Scandinavica.

[38]  Mariano Alcañiz Raya,et al.  An Approach for the Automatic Cephalometric Landmark Detection Using Mathematical Morphology and Active Appearance Models , 2006, MICCAI.

[39]  Guoping Wang,et al.  Automated 2-D Cephalometric Analysis on X-ray Images by a Model-Based Approach , 2006, IEEE Transactions on Biomedical Engineering.

[40]  Fernando Antonio Gonçalves,et al.  Comparison of cephalometric measurements from three radiological clinics. , 2006, Brazilian oral research.

[41]  Daniela Giordano,et al.  Automatic Landmarking of Cephalograms by Cellular Neural Networks , 2005, AIME.

[42]  Alex Jacobson,et al.  The "Wits" appraisal of jaw disharmony. , 2003, American journal of orthodontics.

[43]  Y. Mori,et al.  An accurate three-dimensional cephalometric system: a solution for the correction of cephalic malpositioning. , 2001, Journal of orthodontics.

[44]  D N Davis,et al.  Assessment of an automated cephalometric analysis system. , 1996, European journal of orthodontics.

[45]  Maher A. Sid-Ahmed,et al.  An image processing system for locating craniofacial landmarks , 1994, IEEE Trans. Medical Imaging.

[46]  E V Staab,et al.  A method for three-dimensional image reformation for quantitative cephalometric analysis. , 1989, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[47]  S T Nugent,et al.  Automatic landmarking of cephalograms. , 1989, Computers and biomedical research, an international journal.

[48]  F L Bookstein,et al.  The three-dimensional cephalogram: theory, technique, and clinical application. , 1988, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[49]  John K. Tsotsos,et al.  Knowledge-based landmarking of cephalograms. , 1986, Computers and biomedical research, an international journal.

[50]  F Bookstein,et al.  Analysis of craniofacial asymmetry by multiplane cephalometry. , 1983, American journal of orthodontics.

[51]  L M Finlay,et al.  Craniometry and cephalometry: a history prior to the advent of radiography. , 1980, The Angle orthodontist.

[52]  C. Steiner Cephalometrics for you and me , 1953 .

[53]  A E Birmingham,et al.  The Topographical Anatomy of the Mastoid Region of the Skull; with Special Reference to Operation in this Region , 1890, British medical journal.

[54]  S. Nishimoto,et al.  Personal Computer-Based Cephalometric Landmark Detection With Deep Learning, Using Cephalograms on the Internet , 2019, The Journal of craniofacial surgery.

[55]  Giuseppe Baselli,et al.  Computer-aided cephalometric landmark annotation for CBCT data , 2016, International Journal of Computer Assisted Radiology and Surgery.

[56]  Rodrigo Hermont Cançado,et al.  Comparison among manual and computerized cephalometrics using the softwares dolphin imaging and dentofacial planner , 2016 .

[57]  Mestiri Makram,et al.  Reeb Graph for Automatic 3 D Cephalometry , 2014 .

[58]  K. Bütow,et al.  The use of triangle analysis for cephalometric analysis in three dimensions. , 1984, Journal of maxillofacial surgery.

[59]  A. Bjork SUTURAL GROWTH OF THE UPPER FACE STUDIED BY THE IMPLANT METHOD. , 1964, Report of the congress. European Orthodontic Society.

[60]  E. Ford,et al.  The growth of the foetal skull. , 1956, Journal of anatomy.

[61]  S R Scott,et al.  A New Method of Demonstrating the Topographical Anatomy of the Adult Human Skull. , 1906, Journal of anatomy and physiology.