The validity of an artificial intelligence application for assessment of orthodontic treatment need from clinical images

Abstract Aim : To assess the validity of a Convolutional Neural Network (CNN) digital model to detect and localize orthodontic malocclusions from intraoral clinical images. Materials and methods : The sample of this study consisted of the intraoral images of 700 Subjects. All images were intraoral clinical images, in one of the following views: Left Occlusion, Right Occlusion, Front Occlusion, Upper Occlusal, and Lower Occlusal. The following malocclusion conditions were localized: crowding, spacing, increased overjet, cross bite, open bite, deep bite. The images annotations were repeated by the same investigator (S.T) with a one week interval (ICC ≥ 0.9). The CNN model used for this research study was the “You Only Look Once” model. This model can detect and localize multiple objects or multiple instances of the same object in each image. It is a fully convolutional deep neural network; 24 convolutional layers followed by 2 fully connected layers. This model was implemented using the TensorFlow framework freely available from Google. Results : The created CNN model was able to detect and localize the malocclusions with an accuracy of 99.99 %, precision of 99.79 %, and a recall of 100 %. Conclusions : The use of computational deep convolutional neural networks to identify and localize orthodontic problems from clinical images proved valid. The built AI engine accurately detected and localized malocclusion from different views of intra-oral clinical images.

[1]  Murshida Marizan Nor,et al.  Malocclusion and orthodontic treatment need evaluated among subjects with Down syndrome using the Dental Aesthetic Index (DAI). , 2014, The Angle orthodontist.

[2]  E. Uskun,et al.  Comparison of orthodontic treatment need by professionals and parents with different socio-demographic characteristics , 2011, BDJ.

[3]  Berkman Sahiner,et al.  Detection and diagnosis of colitis on computed tomography using deep convolutional neural networks , 2017, Medical physics.

[4]  T. Hodge,et al.  Who needs orthodontic treatment? Who gets it? And who wants it? , 2015, BDJ.

[5]  Digital images as an alternative to orthodontic casts in assessing malocclusion and orthodontic treatment need , 2007, Acta odontologica Scandinavica.

[6]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Zhengyang Zhou,et al.  Automated segmentation of the parotid gland based on atlas registration and machine learning: a longitudinal MRI study in head-and-neck radiation therapy. , 2014, International journal of radiation oncology, biology, physics.

[8]  Budi Kusnoto,et al.  Improving the accuracy of publicly available search engines in recognizing and classifying dental visual assets using convolutional neural networks. , 2020, International journal of computerized dentistry.

[9]  Stefan Wesarg,et al.  Automatic Teeth Segmentation in Panoramic X-Ray Images Using a Coupled Shape Model in Combination with a Neural Network , 2018, MICCAI.

[10]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[11]  P. Croskerry Achieving quality in clinical decision making: cognitive strategies and detection of bias. , 2002, Academic emergency medicine : official journal of the Society for Academic Emergency Medicine.

[12]  B. Subramanian,et al.  Impact of Malocclusions on the Oral Health-Related Quality of Life of Early Adolescents in Ndola, Zambia , 2018, International journal of dentistry.

[13]  Yen-Wei Chen,et al.  Semi-automatic Cephalometric Landmark Detection on X-ray Images Using Deep Learning Method , 2019, ICNC-FSKD.

[14]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[15]  A. de França Caldas,et al.  [Prevalence of malocclusion and its association with functional alterations of the stomatognathic system in schoolchildren]. , 2007, Cadernos de saude publica.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Budi Kusnoto,et al.  Accuracy of Dental Monitoring 3D digital dental models using photograph and video mode. , 2019, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[18]  I. Pordeus,et al.  Malocclusion: esthetic impact and quality of life among Brazilian schoolchildren. , 2006, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[19]  W. Gaissmaier,et al.  Smart strategies for doctors and doctors‐in‐training: heuristics in medicine , 2009, Medical education.

[20]  P. Croskerry The Importance of Cognitive Errors in Diagnosis and Strategies to Minimize Them , 2003, Academic medicine : journal of the Association of American Medical Colleges.

[21]  Mu-Chun Su,et al.  Cerebral Small Vessel Disease Biomarkers Detection on MRI-Sensor-Based Image and Deep Learning , 2019, Sensors.