Coarse-to-fine Airway Segmentation Using Multi information Fusion Network and CNN-based Region Growing

BACKGROUND AND OBJECTIVES Automatic airway segmentation from chest computed tomography (CT) scans plays an important role in pulmonary disease diagnosis and computer-assisted therapy. However, low contrast at peripheral branches and complex tree-like structures remain as two mainly challenges for airway segmentation. Recent research has illustrated that deep learning methods perform well in segmentation tasks. Motivated by these works, a coarse-to-fine segmentation framework is proposed to obtain a complete airway tree. METHODS Our framework segments the overall airway and small branches via the multi-information fusion convolution neural network (Mif-CNN) and the CNN-based region growing, respectively. In Mif-CNN, atrous spatial pyramid pooling (ASPP) is integrated into a u-shaped network, and it can expend the receptive field and capture multi-scale information. Meanwhile, boundary and location information are incorporated into semantic information. These information are fused to help Mif-CNN utilize additional context knowledge and useful features. To improve the performance of the segmentation result, the CNN-based region growing method is designed to focus on obtaining small branches. A voxel classification network (VCN), which can entirely capture the rich information around each voxel, is applied to classify the voxels into airway and non-airway. In addition, a shape reconstruction method is used to refine the airway tree. RESULTS We evaluate our method on a private dataset and a public dataset from EXACT09. Compared with the segmentation results from other methods, our method demonstrated promising accuracy in complete airway tree segmentation. In the private dataset, the Dice similarity coefficient (DSC), Intersection over Union (IoU), false positive rate (FPR), and sensitivity are 93.5%, 87.8%, 0.015%, and 90.8%, respectively. In the public dataset, the DSC, IoU, FPR, and sensitivity are 95.8%, 91.9%, 0.053% and 96.6%, respectively. CONCLUSION The proposed Mif-CNN and CNN-based region growing method segment the airway tree accurately and efficiently in CT scans. Experimental results also demonstrate that the framework is ready for application in computer-aided diagnosis systems for lung disease and other related works.

[1]  Françoise J. Prêteux,et al.  Pulmonary airways: 3-D reconstruction from multislice CT and clinical investigation , 2004, IEEE Transactions on Medical Imaging.

[2]  Marleen de Bruijne,et al.  Vessel-guided airway tree segmentation: A voxel classification approach , 2010, Medical Image Anal..

[3]  Marleen de Bruijne,et al.  Automatic Airway Segmentation in chest CT using Convolutional Neural Networks , 2018, RAMBO+BIA+TIA@MICCAI.

[4]  Milan Sonka,et al.  Segmentation of intrathoracic airway trees: a fuzzy logic approach , 1998, IEEE Transactions on Medical Imaging.

[5]  Saeid Nahavandi,et al.  Uncertainty quantification in skin cancer classification using three-way decision-based Bayesian deep learning , 2021, Comput. Biol. Medicine.

[6]  Dong Yang,et al.  3D Semi-Supervised Learning with Uncertainty-Aware Multi-View Co-Training , 2018, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Bram van Ginneken,et al.  Improving airway segmentation in computed tomography using leak detection with convolutional networks , 2017, Medical Image Anal..

[8]  Milan Sonka,et al.  Rule-based detection of intrathoracic airway trees , 1996, IEEE Trans. Medical Imaging.

[9]  Minho Lee,et al.  Improvement of fully automated airway segmentation on volumetric computed tomographic images using a 2.5 dimensional convolutional neural net☆ , 2019, Medical Image Anal..

[10]  Z Bian,et al.  Small airway segmentation in thoracic computed tomography scans: a machine learning approach , 2018, Physics in medicine and biology.

[11]  E. Weibel,et al.  Principles and methods for the morphometric study of the lung and other organs. , 1963, Laboratory investigation; a journal of technical methods and pathology.

[12]  Jiao Wang,et al.  Bronchus Segmentation and Classification by Neural Networks and Linear Programming , 2019, MICCAI.

[13]  Eric A. Hoffman,et al.  Extraction of Airways From CT (EXACT'09) , 2012, IEEE Transactions on Medical Imaging.

[14]  P. Berna,et al.  Three-dimensional CT angiography of anatomic variations in the pulmonary arterial tree , 2017, Surgical and Radiologic Anatomy.

[15]  Shigeo Wada,et al.  Automated segmentation and morphometric analysis of the human airway tree from multidetector CT images. , 2008, The journal of physiological sciences : JPS.

[16]  Lubrav: A New Framework For The Segmentation Of The Lung’s Tubular Structures , 2021, 2021 IEEE 18th International Symposium on Biomedical Imaging (ISBI).

[17]  Alejandro F. Frangi,et al.  Tubular Structure Segmentation Using Spatial Fully Connected Network with Radial Distance Loss for 3D Medical Images , 2019, MICCAI.

[18]  Jie Yang,et al.  AirwayNet-SE: A Simple-Yet-Effective Approach to Improve Airway Segmentation Using Context Scale Fusion , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[19]  Syed Ahmed Nadeem,et al.  A CT-Based Automated Algorithm for Airway Segmentation Using Freeze-and-Grow Propagation and Deep Learning , 2020, IEEE Transactions on Medical Imaging.

[20]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[21]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[22]  B. Ginneken,et al.  Automatic segmentation of the airway tree from thoracic CT scans using a multi-threshold approach , 2009 .

[23]  Guang-Zhong Yang,et al.  Alleviating Class-Wise Gradient Imbalance for Pulmonary Airway Segmentation , 2020, IEEE Transactions on Medical Imaging.

[24]  Wending Xiang,et al.  Segmentation of the Airway Tree From Chest CT Using Tiny Atrous Convolutional Network , 2021, IEEE Access.

[25]  Ming-Ming Cheng,et al.  EGNet: Edge Guidance Network for Salient Object Detection , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[26]  H. Coxson,et al.  Quantitative Computed Tomography of Chronic Obstructive Pulmonary Disease1 , 2005 .

[27]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[28]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[29]  Yongjian Xu,et al.  Prevalence and risk factors of chronic obstructive pulmonary disease in China (the China Pulmonary Health [CPH] study): a national cross-sectional study , 2018, The Lancet.

[30]  Hao Zheng,et al.  Learning Bronchiole-Sensitive Airway Segmentation CNNs by Feature Recalibration and Attention Distillation , 2020, MICCAI.

[31]  Weidong Cai,et al.  Automated 3D Neuron Tracing with Precise Branch Erasing and Confidence Controlled Back-Tracking , 2017, bioRxiv.

[32]  Guang-Zhong Yang,et al.  Pathological Airway Segmentation with Cascaded Neural Networks for Bronchoscopic Navigation , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[33]  Guang-Zhong Yang,et al.  Learning Tubule-Sensitive CNNs for Pulmonary Airway and Artery-Vein Segmentation in CT , 2020, IEEE Transactions on Medical Imaging.

[34]  Chi-Wing Fu,et al.  Uncertainty-aware Self-ensembling Model for Semi-supervised 3D Left Atrium Segmentation , 2019, MICCAI.

[35]  Guang-Zhong Yang,et al.  AirwayNet: A Voxel-Connectivity Aware Approach for Accurate Airway Segmentation Using Convolutional Neural Networks , 2019, MICCAI.

[36]  Holger Roth,et al.  Tracking and Segmentation of the Airways in Chest CT Using a Fully Convolutional Network , 2017, MICCAI.

[37]  Houjin Chen,et al.  Uncertainty Aware Temporal-Ensembling Model for Semi-Supervised ABUS Mass Segmentation , 2020, IEEE Transactions on Medical Imaging.

[38]  Adam P. Harrison,et al.  3D Convolutional Neural Networks with Graph Refinement for Airway Segmentation Using Incomplete Data Labels , 2017, MLMI@MICCAI.

[39]  Kensaku Mori,et al.  Recognition of bronchus in three-dimensional X-ray CT images with applications to virtualized bronchoscopy system , 1996, Proceedings of 13th International Conference on Pattern Recognition.