Efficacy evaluation of 2D, 3D U-Net semantic segmentation and atlas-based segmentation of normal lungs excluding the trachea and main bronchi

ABSTRACT This study aimed to examine the efficacy of semantic segmentation implemented by deep learning and to confirm whether this method is more effective than a commercially dominant auto-segmentation tool with regards to delineating normal lung excluding the trachea and main bronchi. A total of 232 non-small-cell lung cancer cases were examined. The computed tomography (CT) images of these cases were converted from Digital Imaging and Communications in Medicine (DICOM) Radiation Therapy (RT) formats to arrays of 32 × 128 × 128 voxels and input into both 2D and 3D U-Net, which are deep learning networks for semantic segmentation. The number of training, validation and test sets were 160, 40 and 32, respectively. Dice similarity coefficients (DSCs) of the test set were evaluated employing Smart SegmentationⓇ Knowledge Based Contouring (Smart segmentation is an atlas-based segmentation tool), as well as the 2D and 3D U-Net. The mean DSCs of the test set were 0.964 [95% confidence interval (CI), 0.960–0.968], 0.990 (95% CI, 0.989–0.992) and 0.990 (95% CI, 0.989–0.991) with Smart segmentation, 2D and 3D U-Net, respectively. Compared with Smart segmentation, both U-Nets presented significantly higher DSCs by the Wilcoxon signed-rank test (P < 0.01). There was no difference in mean DSC between the 2D and 3D U-Net systems. The newly-devised 2D and 3D U-Net approaches were found to be more effective than a commercial auto-segmentation tool. Even the relatively shallow 2D U-Net which does not require high-performance computational resources was effective enough for the lung segmentation. Semantic segmentation using deep learning was useful in radiation treatment planning for lung cancers.

[1]  F. Maes,et al.  Benefits of deep learning for delineation of organs at risk in head and neck cancer. , 2019, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[2]  M. Martel,et al.  Radiation dose-volume effects in the lung. , 2010, International journal of radiation oncology, biology, physics.

[3]  Xiangrong Zhou,et al.  Deep learning of the sectional appearances of 3D CT images for anatomical structure segmentation based on an FCN voting method , 2017, Medical physics.

[4]  Blake Hannaford,et al.  Evaluation of segmentation methods on head and neck CT: Auto‐segmentation challenge 2015 , 2017, Medical physics.

[5]  Jean-François Daisne,et al.  Atlas-based automatic segmentation of head and neck organs at risk and nodal target volumes: a clinical validation , 2013, Radiation oncology.

[6]  Wolfgang A Tomé,et al.  Heterogeneity in head and neck IMRT target design and clinical practice. , 2012, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[7]  Iddo Wernick,et al.  Atlas-based segmentation improves consistency and decreases time required for contouring postoperative endometrial cancer nodal volumes. , 2011, International journal of radiation oncology, biology, physics.

[8]  Tian Liu,et al.  Automatic multiorgan segmentation in thorax CT images using U-net-GAN. , 2019, Medical physics.

[9]  Paul Aljabar,et al.  Autosegmentation for thoracic radiation treatment planning: A grand challenge at AAPM 2017 , 2018, Medical physics.

[10]  S. Kabus,et al.  The first patient treatment of computed tomography ventilation functional image-guided radiotherapy for lung cancer. , 2016, Radiotherapy and oncology : journal of the European Society for Therapeutic Radiology and Oncology.

[11]  Terry M. Peters,et al.  Medical Image Computing and Computer Assisted Intervention – MICCAI 2019: 22nd International Conference, Shenzhen, China, October 13–17, 2019, Proceedings, Part IV , 2019, MICCAI.

[12]  Joon Beom Seo,et al.  Fully Automated Lung Lobe Segmentation in Volumetric Chest CT with 3D U-Net: Validation with Intra- and Extra-Datasets , 2019, Journal of Digital Imaging.

[13]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[14]  Matthew P. Goetz,et al.  NCCN CLINICAL PRACTICE GUIDELINES IN ONCOLOGY , 2019 .

[15]  Y. Kanda,et al.  Investigation of the freely available easy-to-use software ‘EZR' for medical statistics , 2012, Bone Marrow Transplantation.

[16]  Tarek Mekhail,et al.  Durvalumab after Chemoradiotherapy in Stage III Non–Small‐Cell Lung Cancer , 2017, The New England journal of medicine.

[17]  W. Woodward,et al.  Variability of target and normal structure delineation for breast cancer radiotherapy: an RTOG Multi-Institutional and Multiobserver Study. , 2007, International journal of radiation oncology, biology, physics.

[18]  Martin J Blaser,et al.  Infection, cancer and prevention: report of the 19th International Symposium of the Foundation for Promotion of Cancer Research. , 2006, Japanese journal of clinical oncology.

[19]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).