Automatic airway tree segmentation based on multi-scale context information

Airway tree segmentation plays a pivotal role in chest computed tomography (CT) analysis tasks such as lesion localization, surgical planning, and intra-operative guidance. The remaining challenge is to identify small bronchi correctly, which facilitates further segmentation of the pulmonary anatomies. A three-dimensional (3D) multi-scale feature aggregation network (MFA-Net) is proposed against the scale difference of substructures in airway tree segmentation. In this model, the multi-scale feature aggregation (MFA) block is used to capture the multi-scale context information, which improves the sensitivity of the small bronchi segmentation and addresses the local discontinuities. Meanwhile, the concept of airway tree partition is introduced to evaluate the segmentation performance at a more granular level. Experiments were conducted on a dataset of 250 CT scans, which were annotated by experienced clinical radiologists. Through the airway partition, we evaluated the segmentation results of the small bronchi compared with the state-of-the-art methods. Experiments show that MFA-Net achieves the best performance in the Dice similarity coefficient (DSC) in the intra-lobar airway and improves the true positive rate (TPR) by 7.59% on average. Besides, in the entire airway, the proposed method achieves the best results in DSC and TPR scores of 86.18% and 79.31%, respectively, with the consequence of higher false positives. The MFA-Net is competitive with the state-of-the-art methods. The experiment results indicate that the MFA block improves the performance of the network by utilizing multi-scale context information. More accurate segmentation results will be more helpful in further clinical analysis.

[1]  E. Hoffman,et al.  Assessment of the pulmonary structure-function relationship and clinical outcomes measures: quantitative volumetric CT of the lung. , 1997, Academic radiology.

[2]  Eric A. Hoffman,et al.  Accurate measurement of intrathoracic airways , 1997, IEEE Transactions on Medical Imaging.

[3]  K Ramaswamy,et al.  Virtual bronchoscopy for three--dimensional pulmonary image assessment: state of the art and future needs. , 1998, Radiographics : a review publication of the Radiological Society of North America, Inc.

[4]  D. Aykac,et al.  Segmentation and analysis of the human airway tree from three-dimensional X-ray CT images , 2003, IEEE Transactions on Medical Imaging.

[5]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[6]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[7]  Ulas Bagci,et al.  A hybrid multi-scale approach to automatic airway tree segmentation from CT scans , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[8]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Masahiro Oda,et al.  Automatic segmentation of airway tree based on local intensity filter and machine learning technique in 3D chest CT volume , 2017, International Journal of Computer Assisted Radiology and Surgery.

[11]  A. Jemal,et al.  Cancer statistics in China, 2015 , 2016, CA: a cancer journal for clinicians.

[12]  Adam P. Harrison,et al.  3D Convolutional Neural Networks with Graph Refinement for Airway Segmentation Using Incomplete Data Labels , 2017, MLMI@MICCAI.

[13]  Bram van Ginneken,et al.  Improving airway segmentation in computed tomography using leak detection with convolutional networks , 2017, Medical Image Anal..

[14]  Marleen de Bruijne,et al.  Automatic Airway Segmentation in chest CT using Convolutional Neural Networks , 2018, RAMBO+BIA+TIA@MICCAI.

[15]  Minho Lee,et al.  Hybrid Airway Segmentation Using Multi-Scale Tubular Structure Filters and Texture Analysis on 3D Chest CT Scans , 2018, Journal of Digital Imaging.

[16]  Guang-Zhong Yang,et al.  AirwayNet: A Voxel-Connectivity Aware Approach for Accurate Airway Segmentation Using Convolutional Neural Networks , 2019, MICCAI.

[17]  Zhang Yi,et al.  DeepLNAnno: a Web-Based Lung Nodules Annotating System for CT Images , 2019, Journal of Medical Systems.

[18]  Jiao Wang,et al.  Bronchus Segmentation and Classification by Neural Networks and Linear Programming , 2019, MICCAI.

[19]  Marleen de Bruijne,et al.  A joint 3D UNet-Graph Neural Network-based method for Airway Segmentation from chest CTs , 2019, MLMI@MICCAI.

[20]  Minho Lee,et al.  Improvement of fully automated airway segmentation on volumetric computed tomographic images using a 2.5 dimensional convolutional neural net☆ , 2019, Medical Image Anal..