Towards fully automated third molar development staging in panoramic radiographs

Staging third molar development is commonly used for age assessment in sub-adults. Current staging techniques are, at most, semi-automated and rely on manual interactions prone to operator variability. The aim of this study was to fully automate the staging process by employing the full potential of deep learning, using convolutional neural networks (CNNs) in every step of the procedure. The dataset used to train the CNNs consisted of 400 panoramic radiographs (OPGs), with 20 OPGs per developmental stage per sex, staged in consensus between three observers. The concepts of transfer learning, using pre-trained CNNs, and data augmentation were used to mitigate the issues when dealing with a limited dataset. In this work, a three-step procedure was proposed and the results were validated using fivefold cross-validation. First, a CNN localized the geometrical center of the lower left third molar, around which a square region of interest (ROI) was extracted. Second, another CNN segmented the third molar within the ROI. Third, a final CNN used both the ROI and the segmentation to classify the third molar into its developmental stage. The geometrical center of the third molar was found with an average Euclidean distance of 63 pixels. Third molars were segmented with an average Dice score of 93%. Finally, the developmental stages were classified with an accuracy of 54%, a mean absolute error of 0.69 stages, and a linear weighted Cohen’s kappa coefficient of 0.79. The entire automated workflow on average took 2.72 s to compute, which is substantially faster than manual staging starting from the OPG. Taking into account the limited dataset size, this pilot study shows that the proposed fully automated approach shows promising results compared with manual staging.

[1]  Thomas Maal,et al.  Automated detection of third molars and mandibular nerve by deep learning , 2019, Scientific Reports.

[2]  M. Maresh,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1950 .

[3]  Klaus H. Maier-Hein,et al.  No New-Net , 2018, 1809.10483.

[4]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Fuk-hay Tang,et al.  Accurate Age Determination for Adolescents Using Magnetic Resonance Imaging of the Hand and Wrist with an Artificial Neural Network-Based Approach , 2018, Journal of Digital Imaging.

[6]  Soo Young Kim,et al.  Comparison of the Greulich-Pyle and Tanner Whitehouse (TW3) Methods in Bone age Assessment , 2008 .

[7]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  C. Langlotz,et al.  Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs. , 2017, Radiology.

[10]  H. Liversidge Timing of human mandibular third molar formation , 2008, Annals of human biology.

[11]  J. Talairach,et al.  L??EXPLORATION CHIRURGICALE ST??R??OTAXIQUE DU LOBE TEMPORAL DANS L??EPILEPSIE TEMPORALE , 1959 .

[12]  Xiangrong Zhou,et al.  Classification of teeth in cone-beam CT using deep convolutional neural network , 2017, Comput. Biol. Medicine.

[13]  John D. Austin,et al.  Adaptive histogram equalization and its variations , 1987 .

[14]  Andreas Schmeling,et al.  Forensic Age Estimation. , 2016, Deutsches Arzteblatt international.

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Mohammad Hosntalab,et al.  Classification and numbering of teeth in multi-slice CT images using wavelet-Fourier descriptor , 2009, International Journal of Computer Assisted Radiology and Surgery.

[17]  Matthew B. Blaschko,et al.  Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory and Practice , 2019, MICCAI.

[18]  Andrew Zisserman,et al.  Smooth Loss Functions for Deep Top-k Classification , 2018, ICLR.

[19]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Christian Payer,et al.  Automatic Age Estimation and Majority Age Classification From Multi-Factorial MRI Data , 2019, IEEE Journal of Biomedical and Health Informatics.

[21]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.

[22]  H. H. Thodberg,et al.  The RSNA Pediatric Bone Age Machine Learning Challenge. , 2019, Radiology.

[23]  Guodong Guo,et al.  Age Estimation , 2015, Encyclopedia of Biometrics.

[24]  Christian Payer,et al.  Automated age estimation from MRI volumes of the hand , 2019, Medical Image Anal..

[25]  T. Riepert,et al.  Criteria for age estimation in living individuals , 2008, International Journal of Legal Medicine.

[26]  Sven Kreiborg,et al.  The BoneXpert Method for Automated Determination of Skeletal Maturity , 2009, IEEE Transactions on Medical Imaging.

[27]  Jenny Lee,et al.  Fully Automated Deep Learning System for Bone Age Assessment , 2017, Journal of Digital Imaging.

[28]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Dirk Vandermeulen,et al.  Effect of Lower Third Molar Segmentations on Automated Tooth Development Staging using a Convolutional Neural Network , 2020, Journal of forensic sciences.

[30]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[31]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[32]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  H. K. Huang,et al.  Bone age assessment of children using a digital hand atlas , 2007, Comput. Medical Imaging Graph..

[35]  J De Tobel,et al.  An automated technique to stage lower third molar development on panoramic radiographs for age estimation: a pilot study. , 2017, The Journal of forensic odonto-stomatology.

[36]  J M Tanner,et al.  A new system of dental age assessment. , 1973, Human biology.

[37]  Horst Bischof,et al.  Towards Automatic Bone Age Estimation from MRI: Localization of 3D Anatomical Landmarks , 2014, MICCAI.

[38]  Horst Bischof,et al.  Fully Automatic Bone Age Estimation from Left Hand MR Images , 2014, MICCAI.

[39]  Simone Palazzo,et al.  Deep learning for automated skeletal bone age assessment in X‐ray images , 2017, Medical Image Anal..

[40]  Alexander Rakhlin,et al.  Pediatric Bone Age Assessment Using Deep Convolutional Neural Networks , 2017, bioRxiv.

[41]  Martin Urschler,et al.  Automatic Third Molar Localization from 3D MRI using Random Regression Forests , 2015, MIUA.

[42]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .