3D Convolutional Neural Networks with Graph Refinement for Airway Segmentation Using Incomplete Data Labels

Intrathoracic airway segmentation from computed tomography images is a frequent prerequisite for further quantitative lung analyses. Due to low contrast and noise, especially at peripheral branches, it is often challenging for automatic methods to strike a balance between extracting deeper airway branches and avoiding leakage to the surrounding parenchyma. Meanwhile, manual annotations are extremely time consuming for the airway tree, which inhibits automated methods requiring training data. To address this, we introduce a 3D deep learning-based workflow able to produce high-quality airway segmentation from incompletely labeled training data generated without manual intervention. We first train a 3D fully convolutional network (FCN) based on the fact that 3D spatial information is crucial for small highly anisotropic tubular structures such as airways. For training the 3D FCN, we develop a domain-specific sampling scheme that strategically uses incomplete labels from a previous highly specific segmentation method, aiming to retain similar specificity while boosting sensitivity. Finally, to address local discontinuities of the coarse 3D FCN output, we apply a graph-based refinement incorporating fuzzy connectedness segmentation and robust curve skeletonization. Evaluations on the EXACT’09 and LTRC datasets demonstrate considerable improvements in airway extraction while maintaining reasonable leakage compared with a state-of-art method and the dataset reference standard.

[1]  P. Paré,et al.  Small airways dimensions in asthma and in chronic obstructive pulmonary disease. , 1993, The American review of respiratory disease.

[2]  Richard A. Robb,et al.  Processing of CT images for analysis of diffuse lung disease in the lung tissue research consortium , 2008, SPIE Medical Imaging.

[3]  B. Ginneken,et al.  Automatic segmentation of the airway tree from thoracic CT scans using a multi-threshold approach , 2009 .

[4]  Marleen de Bruijne,et al.  Vessel-guided airway tree segmentation: A voxel classification approach , 2010, Medical Image Anal..

[5]  Eric A. Hoffman,et al.  Extraction of Airways From CT (EXACT'09) , 2012, IEEE Transactions on Medical Imaging.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Jayaram K. Udupa,et al.  A hybrid method for airway segmentation and automated measurement of bronchial wall thickness on CT , 2015, Medical Image Anal..

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  David J. Kriegman,et al.  Dense Volume-to-Volume Vascular Boundary Detection , 2016, MICCAI.

[11]  Eric A. Hoffman,et al.  A robust and efficient curve skeletonization algorithm for tree-like objects using minimum cost paths , 2016, Pattern Recognit. Lett..

[12]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[13]  Bram van Ginneken,et al.  Improving airway segmentation in computed tomography using leak detection with convolutional networks , 2017, Medical Image Anal..