High Throughput Lung and Lobar Segmentation by 2D and 3D CNN on Chest CT with Diffuse Lung Disease

Deep learning methods have been widely and successfully applied to the medical imaging field. Specifically, fully convolutional neural networks have become the state-of-the-art supervised segmentation method in a variety of biomedical segmentation problems. Two fully convolutional networks were proposed to sequentially achieve accurate lobar segmentation. Firstly, a 2D ResNet-101 based network is proposed for lung segmentation and 575 chest CT scans from multicenter clinical trials were used with radiologist approved lung segmentation. Secondly, a 3D DenseNet based network is applied to segment the 5 lobes and a total of 1280 different CT scans were used with radiologist approved lobar segmentation as ground truth. The dataset includes various pathological lung diseases and stratified sampling was used to form training and test sets following a ratio of 4:1 to ensure a balanced number and type of abnormality present. A 3D CNN segmentation model was also built for lung segmentation to investigate the feasibility using current hardware. Using 5-fold cross validation a mean Dice coefficient of 0.988 ± 0.012 and Average Surface Distance of 0.562 ± 0.49 mm was achieved by the proposed 2D CNN on lung segmentation. 3D DenseNet on lobar segmentation achieved Dice score of 0.959 ± 0.087 and Average surface distance of 0.873 ± 0.61 mm.

[1]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Michael F. McNitt-Gray,et al.  Method for segmenting chest CT image data using an anatomical model: preliminary results , 1997, IEEE Transactions on Medical Imaging.

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  David Beymer,et al.  Automated volumetric lung segmentation of thoracic CT images using fully convolutional neural network , 2018, Medical Imaging.

[6]  Edward Kim,et al.  A deep semantic mobile application for thyroid cytopathology , 2016, SPIE Medical Imaging.

[7]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[8]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  A. Kalinovsky,et al.  Lung image Ssgmentation using deep learning methods and convolutional neural networks , 2016 .

[10]  Jayaram K. Udupa,et al.  A Generic Approach to Pathological Lung Segmentation , 2014, IEEE Transactions on Medical Imaging.

[11]  Ammi Reddy Pulagam,et al.  Automated Lung Segmentation from HRCT Scans with Diffuse Parenchymal Lung Diseases , 2016, Journal of Digital Imaging.

[12]  Dinggang Shen,et al.  Deep Learning-Based Feature Representation for AD/MCI Classification , 2013, MICCAI.

[13]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Joseph Antony,et al.  Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[15]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[16]  Adam P. Harrison,et al.  Pathological Pulmonary Lobe Segmentation from CT Images Using Progressive Holistically Nested Neural Networks and Random Walker , 2017, DLMIA/ML-CDS@MICCAI.

[17]  Ronald M. Summers,et al.  Progressive and Multi-path Holistically Nested Neural Networks for Pathological Lung Segmentation from CT Images , 2017, MICCAI.

[18]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[19]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[20]  Fereidoun Abtin,et al.  Automatic segmentation of lung parenchyma in the presence of diseases based on curvature of ribs. , 2008, Academic radiology.

[21]  Timo Kohlberger,et al.  Lung Segmentation from CT with Severe Pathologies Using Anatomical Constraints , 2014, MICCAI.

[22]  Fereidoun Abtin,et al.  Reproducibility of lung and lobar volume measurements using computed tomography. , 2010, Academic radiology.