Deep learning based discrimination of soft tissue profiles requiring orthognathic surgery by facial photographs

Facial photographs of the subjects are often used in the diagnosis process of orthognathic surgery. The aim of this study was to determine whether convolutional neural networks (CNNs) can judge soft tissue profiles requiring orthognathic surgery using facial photographs alone. 822 subjects with dentofacial dysmorphosis and / or malocclusion were included. Facial photographs of front and right side were taken from all patients. Subjects who did not need orthognathic surgery were classified as Group I (411 subjects). Group II (411 subjects) was set up for cases requiring surgery. CNNs of VGG19 was used for machine learning. 366 of the total 410 data were correctly classified, yielding 89.3% accuracy. The values of accuracy, precision, recall, and F1 scores were 0.893, 0.912, 0.867, and 0.889, respectively. As a result of this study, it was found that CNNs can judge soft tissue profiles requiring orthognathic surgery relatively accurately with the photographs alone.

[1]  P. Corre,et al.  Three-dimensional architectural and structural analysis--a transition in concept and design from Delaire's cephalometric analysis. , 2014, International journal of oral and maxillofacial surgery.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Mariusz Bojarski,et al.  VisualBackProp: visualizing CNNs for autonomous driving , 2016, ArXiv.

[6]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Mariusz Bojarski,et al.  VisualBackProp: Efficient Visualization of CNNs for Autonomous Driving , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[8]  H. Lim,et al.  Rotation tendency of the posteriorly displaced proximal segment after vertical ramus osteotomy. , 2018, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[9]  I. Cha,et al.  Deep learning-based survival prediction of oral cancer patients , 2019, Scientific Reports.

[10]  Joachim Krois,et al.  Deep Learning for the Radiographic Detection of Periodontal Bone Loss , 2019, Scientific Reports.

[11]  H. Lim,et al.  Volumetric characteristics of prognathic mandible revealed by skeletal unit analysis. , 2019, Annals of anatomy = Anatomischer Anzeiger : official organ of the Anatomische Gesellschaft.

[12]  Jae-Hong Lee,et al.  Diagnosis of cystic lesions using panoramic and CBCT images based on deep learning neural network. , 2019, Oral diseases.

[13]  Raphael Stehrer,et al.  Machine learning based prediction of perioperative blood loss in orthognathic surgery. , 2019, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[14]  Won Hwa Kim,et al.  Automated Skeletal Classification with Lateral Cephalometry Based on Artificial Intelligence , 2020, Journal of dental research.