CT image segmentation for inflamed and fibrotic lungs using a multi-resolution convolutional neural network

The purpose of this study was to develop a fully-automated segmentation algorithm, robust to various density enhancing lung abnormalities, to facilitate rapid quantitative analysis of computed tomography images. A polymorphic training approach is proposed, in which both specifically labeled left and right lungs of humans with COPD, and nonspecifically labeled lungs of animals with acute lung injury, were incorporated into training a single neural network. The resulting network is intended for predicting left and right lung regions in humans with or without diffuse opacification and consolidation. Performance of the proposed lung segmentation algorithm was extensively evaluated on CT scans of subjects with COPD, confirmed COVID-19, lung cancer, and IPF, despite no labeled training data of the latter three diseases. Lobar segmentations were obtained using the left and right lung segmentation as input to the LobeNet algorithm. Regional lobar analysis was performed using hierarchical clustering to identify radiographic subtypes of COVID-19. The proposed lung segmentation algorithm was quantitatively evaluated using semi-automated and manually-corrected segmentations in 87 COVID-19 CT images, achieving an average symmetric surface distance of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0.495\pm 0.309$$\end{document}0.495±0.309 mm and Dice coefficient of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$0.985\pm 0.011$$\end{document}0.985±0.011. Hierarchical clustering identified four radiographical phenotypes of COVID-19 based on lobar fractions of consolidated and poorly aerated tissue. Lower left and lower right lobes were consistently more afflicted with poor aeration and consolidation. However, the most severe cases demonstrated involvement of all lobes. The polymorphic training approach was able to accurately segment COVID-19 cases with diffuse consolidation without requiring COVID-19 cases for training.

[1]  Timo Kohlberger,et al.  Multi-stage Learning for Robust Lung Segmentation in Challenging CT Volumes , 2011, MICCAI.

[2]  E. Regan,et al.  Genetic Epidemiology of COPD (COPDGene) Study Design , 2011, COPD.

[3]  Reinhard Beichel,et al.  Automated 3-D Segmentation of Lungs With Lung Cancer in CT Data Using a Novel Robust Active Shape Model Approach , 2012, IEEE Transactions on Medical Imaging.

[4]  Joseph M. Reinhardt,et al.  Pulmonary Lobe Segmentation Using A Sequence of Convolutional Neural Networks For Marginal Learning , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[5]  C. Zheng,et al.  Time Course of Lung Changes at Chest CT during Recovery from Coronavirus Disease 2019 (COVID-19) , 2020 .

[6]  S. Inui,et al.  Chest CT Findings in Cases from the Cruise Ship Diamond Princess with Coronavirus Disease (COVID-19) , 2020, Radiology. Cardiothoracic imaging.

[7]  Xiangrong Zhou,et al.  Automatic segmentation and recognition of anatomical lung structures from high-resolution chest CT images , 2006, Comput. Medical Imaging Graph..

[8]  Dennis Andersson,et al.  A retrospective cohort study , 2018 .

[9]  Eric A. Hoffman,et al.  Automatic lung segmentation for accurate quantitation of volumetric X-ray CT images , 2001, IEEE Transactions on Medical Imaging.

[10]  J. Xiang,et al.  Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study , 2020, The Lancet.

[11]  Q. Tao,et al.  Serial Quantitative Chest CT Assessment of COVID-19: A Deep Learning Approach , 2020, Radiology. Cardiothoracic imaging.

[12]  B. van Ginneken,et al.  Automatic lung segmentation from thoracic computed tomography scans using a hybrid approach with error detection. , 2009, Medical physics.

[13]  David Gur,et al.  Pulmonary Lobe Segmentation in CT Examinations Using Implicit Surface Fitting , 2009, IEEE Transactions on Medical Imaging.

[14]  Adam P. Harrison,et al.  Pathological Pulmonary Lobe Segmentation from CT Images Using Progressive Holistically Nested Neural Networks and Random Walker , 2017, DLMIA/ML-CDS@MICCAI.

[15]  Eric A. Hoffman,et al.  Atlas-driven lung lobe segmentation in volumetric X-ray CT images , 2006, IEEE Transactions on Medical Imaging.

[16]  C. Zheng,et al.  Time Course of Lung Changes On Chest CT During Recovery From 2019 Novel Coronavirus (COVID-19) Pneumonia , 2020, Radiology.

[17]  E. Hoffman,et al.  Imaging of COVID-19 pneumonia: Patterns, pathogenesis, and advances , 2020, The British journal of radiology.

[18]  H. Peitgen,et al.  Informatics in radiology (infoRAD): new tools for computer assistance in thoracic CT. Part 1. Functional analysis of lungs, lung lobes, and bronchopulmonary segments. , 2005, Radiographics : a review publication of the Radiological Society of North America, Inc.

[19]  Bram van Ginneken,et al.  Automatic Segmentation of the Pulmonary Lobes From Chest CT Scans Based on Fissures, Vessels, and Bronchi , 2013, IEEE Transactions on Medical Imaging.

[20]  Max A. Viergever,et al.  Automatic Segmentation of Pulmonary Lobes Robust Against Incomplete Fissures , 2010, IEEE Transactions on Medical Imaging.

[21]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[22]  Myrna M. Khan,et al.  A retrospective cohort study: 10-year trend of disease-modifying antirheumatic drugs and biological agents use in patients with rheumatoid arthritis at Veteran Affairs Medical Centers , 2013, BMJ Open.

[23]  David W. Kaczka,et al.  Multi-resolution convolutional neural networks for fully automated segmentation of acutely injured lungs in multiple species , 2019, Medical Image Anal..

[24]  Gary E. Christensen,et al.  FissureNet: A Deep Learning Approach For Pulmonary Fissure Detection in CT Images , 2019, IEEE Transactions on Medical Imaging.

[25]  Bram van Ginneken,et al.  Toward automated segmentation of the pathological lung in CT , 2005, IEEE Transactions on Medical Imaging.

[26]  Nima Tajbakhsh,et al.  Automatic Segmentation of Pulmonary Lobes Using a Progressive Dense V-Network , 2018, DLMIA/ML-CDS@MICCAI.

[27]  Y. Hu,et al.  Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, The Lancet.