FissureNet: A Deep Learning Approach For Pulmonary Fissure Detection in CT Images

Pulmonary fissure detection in computed tomography (CT) is a critical component for automatic lobar segmentation. The majority of fissure detection methods use feature descriptors that are hand-crafted, low-level, and have local spatial extent. The design of such feature detectors is typically targeted toward normal fissure anatomy, yielding low sensitivity to weak, and abnormal fissures that are common in clinical data sets. Furthermore, local features commonly suffer from low specificity, as the complex textures in the lung can be indistinguishable from the fissure when the global context is not considered. We propose a supervised discriminative learning framework for simultaneous feature extraction and classification. The proposed framework, called FissureNet, is a coarse-to-fine cascade of two convolutional neural networks. The coarse-to-fine strategy alleviates the challenges associated with training a network to segment a thin structure that represents a small fraction of the image voxels. FissureNet was evaluated on a cohort of 3706 subjects with inspiration and expiration 3DCT scans from the COPDGene clinical trial and a cohort of 20 subjects with 4DCT scans from a lung cancer clinical trial. On both data sets, FissureNet showed superior performance compared with a deep learning approach using the U-Net architecture and a Hessian-based fissure detection method in terms of area under the precision-recall curve (PR-AUC). The overall PR-AUC for FissureNet, U-Net, and Hessian on the COPDGene (lung cancer) data set was 0.980 (0.966), 0.963 (0.937), and 0.158 (0.182), respectively. On a subset of 30 COPDGene scans, FissureNet was compared with a recently proposed advanced fissure detection method called derivative of sticks (DoS) and showed superior performance with a PR-AUC of 0.991 compared with 0.668 for DoS.

[1]  Xiangrong Zhou,et al.  Automatic segmentation and recognition of anatomical lung structures from high-resolution chest CT images , 2006, Comput. Medical Imaging Graph..

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  A. Buist,et al.  Worldwide burden of COPD in high- and low-income countries. Part I. The burden of obstructive lung disease (BOLD) initiative. , 2008, The international journal of tuberculosis and lung disease : the official journal of the International Union against Tuberculosis and Lung Disease.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  H. Peitgen,et al.  Informatics in radiology (infoRAD): new tools for computer assistance in thoracic CT. Part 1. Functional analysis of lungs, lung lobes, and bronchopulmonary segments. , 2005, Radiographics : a review publication of the Radiological Society of North America, Inc.

[6]  Juan Wang,et al.  A derivative of stick filter for pulmonary fissure detection in CT images , 2013, Medical Imaging.

[7]  David Gavaghan,et al.  Review of automatic pulmonary lobe segmentation methods from CT , 2015, Comput. Medical Imaging Graph..

[8]  Lauge Sørensen,et al.  Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns , 2010, IEEE Transactions on Medical Imaging.

[9]  Gary E. Christensen,et al.  Current-and Varifold-Based Registration of Lung Vessel and Airway Trees , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[10]  Eric A. Hoffman,et al.  Atlas-driven lung lobe segmentation in volumetric X-ray CT images , 2006, IEEE Transactions on Medical Imaging.

[11]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Takaya Saito,et al.  The Precision-Recall Plot Is More Informative than the ROC Plot When Evaluating Binary Classifiers on Imbalanced Datasets , 2015, PloS one.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Edwin K Silverman,et al.  Epidemiology, genetics, and subtyping of preserved ratio impaired spirometry (PRISm) in COPDGene , 2014, Respiratory Research.

[15]  한보형,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015 .

[16]  Daniela Gompelmann,et al.  Endoscopic bronchial valve treatment: patient selection and special considerations , 2015, International journal of chronic obstructive pulmonary disease.

[17]  E. Regan,et al.  Genetic Epidemiology of COPD (COPDGene) Study Design , 2011, COPD.

[18]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[19]  Qiao Wei,et al.  Automatic recognition of major fissures in human lungs , 2011, International Journal of Computer Assisted Radiology and Surgery.

[20]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[21]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[22]  Joseph M. Reinhardt,et al.  Anatomy-Guided Lung Lobe Segmentation in X-Ray CT Images , 2009, IEEE Transactions on Medical Imaging.

[23]  Joan Serrat,et al.  Multilocal Creaseness Based on the Level-Set Extrinsic Curvature , 2000, Comput. Vis. Image Underst..

[24]  Colin Raffel,et al.  Lasagne: First release. , 2015 .

[25]  E. V. van Rikxoort,et al.  Predicting Lung Volume Reduction after Endobronchial Valve Therapy Is Maximized Using a Combination of Diagnostic Tools , 2016, Respiration.

[26]  Thomas Bülow,et al.  Unsupervised extraction of the pulmonary interlobar fissures from high resolution thoracic CT data , 2005 .

[27]  Jiantao Pu,et al.  Pulmonary Fissure Integrity and Collateral Ventilation in COPD Patients , 2014, PloS one.

[28]  Max A. Viergever,et al.  Automatic Segmentation of Pulmonary Lobes Robust Against Incomplete Fissures , 2010, IEEE Transactions on Medical Imaging.

[29]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[30]  Alice L. Sternberg,et al.  National Emphysema Treatment Trial , 2012 .

[31]  David Gur,et al.  Pulmonary Lobe Segmentation in CT Examinations Using Implicit Surface Fitting , 2009, IEEE Transactions on Medical Imaging.

[32]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[33]  Bram van Ginneken,et al.  Automatic Segmentation of the Pulmonary Lobes From Chest CT Scans Based on Fissures, Vessels, and Bronchi , 2013, IEEE Transactions on Medical Imaging.

[34]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[35]  Eric A. Hoffman,et al.  Registration-based estimates of local lung tissue expansion compared to xenon CT measures of specific ventilation , 2008, Medical Image Anal..

[36]  Eric A. Hoffman,et al.  Lobar Emphysema Distribution Is Associated With 5‐Year Radiological Disease Progression , 2018, Chest.

[37]  Changyan Xiao,et al.  Pulmonary Fissure Detection in CT Images Using a Derivative of Stick Filter , 2016, IEEE Transactions on Medical Imaging.

[38]  Arieh Eden,et al.  Patients at High Risk of Death After Lung-Volume-Reduction Surgery , 2002 .

[39]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[40]  Qiang Li,et al.  Selective enhancement filters for nodules, vessels, and airway walls in two- and three-dimensional CT scans. , 2003, Medical physics.

[41]  H. Coxson,et al.  Quantitative computed tomography assessment of airway wall dimensions: current status and potential applications for phenotyping chronic obstructive pulmonary disease. , 2008, Proceedings of the American Thoracic Society.

[42]  Tobias Klinder,et al.  Lobar fissure detection using line enhancing filters , 2013, Medical Imaging.

[43]  Bram van Ginneken,et al.  Supervised Enhancement Filters: Application to Fissure Detection in Chest CT Scans , 2008, IEEE Transactions on Medical Imaging.

[44]  João Manuel R. S. Tavares,et al.  Automatic 3D pulmonary nodule detection in CT images: A survey , 2016, Comput. Methods Programs Biomed..

[45]  X Marchandise,et al.  Diagnosis of pulmonary embolism with spiral CT: comparison with pulmonary angiography and scintigraphy. , 1996, Radiology.

[46]  D. Slebos,et al.  The fissure: interlobar collateral ventilation and implications for endoscopic therapy in emphysema , 2016, International journal of chronic obstructive pulmonary disease.