Fully Automated Lung Lobe Segmentation in Volumetric Chest CT with 3D U-Net: Validation with Intra- and Extra-Datasets

Lung lobe segmentation in chest CT has been used for the analysis of lung functions and surgical planning. However, accurate lobe segmentation is difficult as 80% of patients have incomplete and/or fake fissures. Furthermore, lung diseases such as chronic obstructive pulmonary disease (COPD) can increase the difficulty of differentiating the lobar fissures. Lobar fissures have similar intensities to those of the vessels and airway wall, which could lead to segmentation error in automated segmentation. In this study, a fully automated lung lobe segmentation method with 3D U-Net was developed and validated with internal and external datasets. The volumetric chest CT scans of 196 normal and mild-to-moderate COPD patients from three centers were obtained. Each scan was segmented using a conventional image processing method and manually corrected by an expert thoracic radiologist to create gold standards. The lobe regions in the CT images were then segmented using a 3D U-Net architecture with a deep convolutional neural network (CNN) using separate training, validation, and test datasets. In addition, 40 independent external CT images were used to evaluate the model. The segmentation results for both the conventional and deep learning methods were compared quantitatively to the gold standards using four accuracy metrics including the Dice similarity coefficient (DSC), Jaccard similarity coefficient (JSC), mean surface distance (MSD), and Hausdorff surface distance (HSD). In internal validation, the segmentation method achieved high accuracy for the DSC, JSC, MSD, and HSD (0.97 ± 0.02, 0.94 ± 0.03, 0.69 ± 0.36, and 17.12 ± 11.07, respectively). In external validation, high accuracy was also obtained for the DSC, JSC, MSD, and HSD (0.96 ± 0.02, 0.92 ± 0.04, 1.31 ± 0.56, and 27.89 ± 7.50, respectively). This method took 6.49 ± 1.19 s and 8.61 ± 1.08 s for lobe segmentation of the left and right lungs, respectively. Although various automatic lung lobe segmentation methods have been developed, it is difficult to develop a robust segmentation method. However, the deep learning–based 3D U-Net method showed reasonable segmentation accuracy and computational time. In addition, this method could be adapted and applied to severe lung diseases in a clinical workflow.

[1]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[2]  Hanan Samet,et al.  A general approach to connected-component labeling for arbitrary image representations , 1992, JACM.

[3]  Paul J. Friedman,et al.  American Thoracic Society/European Respiratory Society International Multidisciplinary Consensus Classification of the Idiopathic Interstitial Pneumonias. This joint statement of the American Thoracic Society (ATS), and the European Respiratory Society (ERS) was adopted by the ATS board of directors , 2002, American journal of respiratory and critical care medicine.

[4]  Adam P. Harrison,et al.  Pathological Pulmonary Lobe Segmentation from CT Images Using Progressive Holistically Nested Neural Networks and Random Walker , 2017, DLMIA/ML-CDS@MICCAI.

[5]  Eric A. Hoffman,et al.  Atlas-driven lung lobe segmentation in volumetric X-ray CT images , 2006, IEEE Transactions on Medical Imaging.

[6]  S Meenakshi,et al.  Morphological variations of the lung fissures and lobes. , 2004, The Indian journal of chest diseases & allied sciences.

[7]  Joon Beom Seo,et al.  Thoracic cavity segmentation algorithm using multiorgan extraction and surface fitting in volumetric CT. , 2014, Medical physics.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  A. Leung Pulmonary tuberculosis: the essentials. , 1999, Radiology.

[10]  David Gavaghan,et al.  Review of automatic pulmonary lobe segmentation methods from CT , 2015, Comput. Medical Imaging Graph..

[11]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  David Gur,et al.  Automated lung segmentation in X-ray computed tomography: development and evaluation of a heuristic threshold-based scheme. , 2003, Academic radiology.

[13]  Heinz-Otto Peitgen,et al.  Lung lobe segmentation by anatomy-guided 3D watershed transform , 2003, SPIE Medical Imaging.

[14]  David Gur,et al.  Pulmonary Lobe Segmentation in CT Examinations Using Implicit Surface Fitting , 2009, IEEE Transactions on Medical Imaging.

[15]  H. Peitgen,et al.  Lung and Lung Lobe Segmentation Methods at Fraunhofer MEVIS , 2011 .

[16]  Heinz-Otto Peitgen,et al.  Automatic segmentation of lung lobes in ct images based on fissures, vessels, and bronchi , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[17]  E J Morgan,et al.  Silicosis and tuberculosis. , 1979, Chest.

[18]  Ronald M. Summers,et al.  Progressive and Multi-path Holistically Nested Neural Networks for Pathological Lung Segmentation from CT Images , 2017, MICCAI.

[19]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[20]  Eric A. Hoffman,et al.  Lung lobe segmentation by graph search with 3D shape constraints , 2001, SPIE Medical Imaging.

[21]  T. Sørensen,et al.  A method of establishing group of equal amplitude in plant sociobiology based on similarity of species content and its application to analyses of the vegetation on Danish commons , 1948 .

[22]  Minho Lee,et al.  Automatic Left and Right Lung Separation Using Free-Formed Surface Fitting on Volumetric CT , 2014, Journal of Digital Imaging.

[23]  R. Pauwels,et al.  Global strategy for the diagnosis, management, and prevention of chronic obstructive pulmonary disease. NHLBI/WHO Global Initiative for Chronic Obstructive Lung Disease (GOLD) Workshop summary. , 2001, American journal of respiratory and critical care medicine.

[24]  P. Jeffery,et al.  Structural and inflammatory changes in COPD: a comparison with asthma. , 1998, Thorax.