Oral-3D: Reconstructing the 3D Structure of Oral Cavity from Panoramic X-ray

Panoramic X-ray (PX) provides a 2D picture of the patient’s mouth in a panoramic view to help dentists observe the invisible disease inside the gum. However, it provides limited 2D information compared with cone-beam computed tomography (CBCT), another dental imaging method that generates a 3D picture of the oral cavity but with more radiation dose and a higher price. Consequently, it is of great interest to reconstruct the 3D structure from a 2D X-ray image, which can greatly explore the application of X-ray imaging in dental surgeries. In this paper, we propose a framework, named Oral-3D, to reconstruct the 3D oral cavity from a single PX image and prior information of the dental arch. Specifically, we first train a generative model to learn the cross-dimension transformation from 2D to 3D. Then we restore the shape of the oral cavity with a deformation module with the dental arch curve, which can be obtained simply by taking a photo of the patient’s mouth. To be noted, Oral-3D can restore both the density of bony tissues and the curved mandible surface. Experimental results show that Oral-3D can efficiently and effectively reconstruct the 3D oral structure and show critical information in clinical applications, e.g., tooth pulling and dental implants. To the best of our knowledge, we are the first to explore this domain transformation problem between these two imaging methods.

[1]  Pedro Costa,et al.  Towards Adversarial Retinal Image Synthesis , 2017, ArXiv.

[2]  Kai Ma,et al.  X2CT-GAN: Reconstructing CT From Biplanar X-Rays With Generative Adversarial Networks , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Silvio Savarese,et al.  3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction , 2016, ECCV.

[5]  Daniel Cremers,et al.  Fast Joint Estimation of Silhouettes and Dense 3D Geometry from Multiple Images , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Kun Wang,et al.  X2Teeth: 3D Teeth Reconstruction from a Single Panoramic Radiograph , 2020, MICCAI.

[7]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[8]  R. Nagaraj,et al.  Classification of dental diseases using CNN and transfer learning , 2017, 2017 5th International Symposium on Computational and Business Intelligence (ISCBI).

[9]  Sultan Imangaliyev,et al.  Deep Learning for Classification of Dental Plaque Images , 2016, MOD.

[10]  Ann Wenzel,et al.  Image and surgery-related costs comparing cone beam CT and panoramic imaging before removal of impacted mandibular third molars. , 2014, Dento maxillo facial radiology.

[11]  Norihiko Okada,et al.  Diagnostic accuracy of cone-beam CT in the assessment of mandibular invasion of lower gingival carcinoma: comparison with conventional panoramic radiography. , 2009, European journal of radiology.

[12]  Qianjin Feng,et al.  Automatic reconstruction method for high-contrast panoramic image from dental cone-beam CT data , 2019, Comput. Methods Programs Biomed..

[13]  Lei He,et al.  OralCam: Enabling Self-Examination and Awareness of Oral Health Using a Smartphone Camera , 2020, CHI.

[14]  Simon Osindero,et al.  Conditional Generative Adversarial Nets , 2014, ArXiv.

[15]  Timo Ropinski,et al.  Single‐image Tomography: 3D Volumes from 2D Cranial X‐Rays , 2017, Comput. Graph. Forum.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Dong Soo Lee,et al.  Generation of Structural MR Images from Amyloid PET: Application to MR-Less Quantification , 2017, The Journal of Nuclear Medicine.

[18]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[19]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[20]  Zhiming Cui,et al.  ToothNet: Automatic Tooth Instance Segmentation and Identification From Cone Beam CT Images , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Jiajun Wu,et al.  Learning Shape Priors for Single-View 3D Completion and Reconstruction , 2018, ECCV.

[22]  Raymond Y. K. Lau,et al.  Least Squares Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  S Braun,et al.  The form of the human dental arch. , 2009, The Angle orthodontist.

[24]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Sharon L. Brooks,et al.  CBCT Dosimetry: Orthodontic Considerations , 2009 .

[26]  Serge J. Belongie,et al.  Learning Single-View 3D Reconstruction with Limited Pose Supervision , 2018, ECCV.