Deep Learning Based Airway Segmentation Using Key Point Prediction

The purpose of this study was to investigate the accuracy of the airway volume measurement by a Regression Neural Network-based deep-learning model. A set of manually outlined airway data was set to build the algorithm for fully automatic segmentation of a deep learning process. Manual landmarks of the airway were determined by one examiner using a mid-sagittal plane of cone-beam computed tomography (CBCT) images of 315 patients. Clinical dataset-based training with data augmentation was conducted. Based on the annotated landmarks, the airway passage was measured and segmented. The accuracy of our model was confirmed by measuring the following between the examiner and the program: (1) a difference in volume of nasopharynx, oropharynx, and hypopharynx, and (2) the Euclidean distance. For the agreement analysis, 61 samples were extracted and compared. The correlation test showed a range of good to excellent reliability. A difference between volumes were analyzed using regression analysis. The slope of the two measurements was close to 1 and showed a linear regression correlation (r2 = 0.975, slope = 1.02, p < 0.001). These results indicate that fully automatic segmentation of the airway is possible by training via deep learning of artificial intelligence. Additionally, a high correlation between manual data and deep learning data was estimated.

[1]  T. Muto,et al.  The effect of head posture on the pharyngeal airway space (PAS). , 2002, International journal of oral and maxillofacial surgery.

[2]  J. Choi,et al.  Three-Dimensional Analysis of Airway Change After LeFort III Midface Advancement With Distraction , 2018, Annals of plastic surgery.

[3]  Maarten J Koudstaal,et al.  Measuring upper airway volume: accuracy and reliability of Dolphin 3D software compared to manual segmentation in craniosynostosis patients. , 2014, Journal of oral and maxillofacial surgery : official journal of the American Association of Oral and Maxillofacial Surgeons.

[4]  Hyung-Jin Kim,et al.  Automated measurement of hydrops ratio from MRI in patients with Ménière’s disease using CNN-based segmentation , 2020, Scientific Reports.

[5]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[6]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[7]  M. Packer,et al.  Three-dimensional reproducibility of natural head position. , 2013, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[8]  Issam El Naqa,et al.  Artificial Intelligence: reshaping the practice of radiological sciences in the 21st century. , 2020, The British journal of radiology.

[9]  C. Marchetti,et al.  Volumetric three-dimensional computed tomographic evaluation of the upper airway in patients with obstructive sleep apnoea syndrome treated by maxillomandibular advancement. , 2014, The British journal of oral & maxillofacial surgery.

[10]  R. Khonsari,et al.  Deep learning in medical image analysis: a third eye for doctors. , 2019, Journal of stomatology, oral and maxillofacial surgery.

[11]  Isaac S Kohane,et al.  Artificial Intelligence in Healthcare , 2019, Artificial Intelligence and Machine Learning for Business for Non-Engineers.

[12]  Christine Jacobsen,et al.  Cephalometric and three-dimensional assessment of the posterior airway space and imaging software reliability analysis before and after orthognathic surgery. , 2014, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[13]  Jason N. Zimmerman,et al.  Reliability of upper pharyngeal airway assessment using dental CBCT: a systematic review , 2016, European journal of orthodontics.

[14]  C. T. Mattos,et al.  Three-dimensional changes to the upper airway after maxillomandibular advancement with counterclockwise rotation: a systematic review and meta-analysis. , 2017, International journal of oral and maxillofacial surgery.

[15]  Koutaro Maki,et al.  Three-dimensional analysis of the airway with cone-beam computed tomography. , 2011, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[16]  Chung-Feng Jeffrey Kuo,et al.  Application of intelligent automatic segmentation and 3D reconstruction of inferior turbinate and maxillary sinus from computed tomography and analyze the relationship between volume and nasal lesion , 2020, Biomed. Signal Process. Control..

[17]  Hui Chen,et al.  Reliability and accuracy of three imaging software packages used for 3D analysis of the upper airway on cone beam computed tomography images. , 2017, Dento maxillo facial radiology.

[18]  P. Cattaneo,et al.  Three-dimensional analyses of short- and long-term effects of rapid maxillary expansion on nasal cavity and upper airway: a systematic review and meta-analysis. , 2020, Orthodontics & craniofacial research.

[19]  A. T. Tang,et al.  Three-Dimensional Pharyngeal Airway Changes After 2-Jaw Orthognathic Surgery With Segmentation in Dento-Skeletal Class III Patients. , 2019, The Journal of craniofacial surgery.

[20]  L. Franchi,et al.  Three-dimensional analysis of upper airway morphology in skeletal Class III patients with and without mandibular asymmetry. , 2017, The Angle orthodontist.

[21]  C Flores-Mir,et al.  Three-dimensional segmentation of the upper airway using cone beam CT: a systematic review. , 2012, Dento maxillo facial radiology.

[22]  Jongeun Choi,et al.  Automated cephalometric landmark detection with confidence regions using Bayesian convolutional neural networks , 2020, BMC Oral Health.

[23]  Reyes Enciso,et al.  Imaging software accuracy for 3-dimensional analysis of the upper airway. , 2012, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[24]  A. Katsumata,et al.  Positional changes of oropharyngeal structures due to gravity in the upright and supine positions. , 2008, Dento maxillo facial radiology.

[25]  J. Hoffmann,et al.  Relations between mandible-only advancement surgery, the extent of the posterior airway space, and the position of the hyoid bone in Class II patients: a three-dimensional analysis. , 2019, The British journal of oral & maxillofacial surgery.

[26]  Chuan Zhou,et al.  Deep Learning in Medical Image Analysis. , 2017, Advances in experimental medicine and biology.

[27]  J. Hoffmann,et al.  The relationship between bimaxillary orthognathic surgery and the extent of posterior airway space in class II and III patients – A retrospective three-dimensional cohort analysis , 2021 .

[28]  Jongrak Hong,et al.  Three-dimensional analysis of changes in airway space after bimaxillary orthognathic surgery with maxillomandibular setback and their association with obstructive sleep apnea , 2018, Maxillofacial plastic and reconstructive surgery.

[29]  C. Estrela,et al.  Reliability and validity of two software systems used to measure the pharyngeal airway space in three-dimensional analysis. , 2020, International journal of oral and maxillofacial surgery.

[30]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[31]  A. L. Ramos,et al.  Three-dimensional analysis of the pharyngeal airway space and hyoid bone position after orthognathic surgery. , 2017, Journal of cranio-maxillo-facial surgery : official publication of the European Association for Cranio-Maxillo-Facial Surgery.

[32]  Three-dimensional analysis of changes in pharyngeal airway space after mandibular setback surgery , 2017 .

[33]  Minho Lee,et al.  Improvement of fully automated airway segmentation on volumetric computed tomographic images using a 2.5 dimensional convolutional neural net☆ , 2019, Medical Image Anal..

[34]  Nilanjan Ray,et al.  New algorithm for semiautomatic segmentation of nasal cavity and pharyngeal airway in comparison with manual segmentation using cone-beam computed tomography. , 2016, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[35]  Syed Muhammad Anwar,et al.  Medical Image Analysis using Convolutional Neural Networks: A Review , 2017, Journal of Medical Systems.

[36]  G. Swennen,et al.  Cone-beam computerized tomography imaging and analysis of the upper airway: a systematic review of the literature. , 2011, International journal of oral and maxillofacial surgery.

[37]  Juan Martin Palomo,et al.  Measuring the airway in 3 dimensions: a reliability and accuracy study. , 2010, American journal of orthodontics and dentofacial orthopedics : official publication of the American Association of Orthodontists, its constituent societies, and the American Board of Orthodontics.

[38]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[39]  Jae-Yeol Lee,et al.  Effect of Maxillary Setback Movement on Upper Airway in Patients With Class III Skeletal Deformities: Cone Beam Computed Tomographic Evaluation , 2013, The Journal of craniofacial surgery.

[40]  C. T. Mattos,et al.  Upper airway dimensions in patients undergoing orthognathic surgery: a systematic review and meta-analysis. , 2016, International journal of oral and maxillofacial surgery.