Segmentation of Pulmonary Opacification in Chest CT Scans of COVID-19 Patients

The Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) has rapidly spread into a global pandemic. A form of pneumonia, presenting as opacities with in a patient's lungs, is the most common presentation associated with this virus, and great attention has gone into how these changes relate to patient morbidity and mortality. In this work we provide open source models for the segmentation of patterns of pulmonary opacification on chest Computed Tomography (CT) scans which have been correlated with various stages and severities of infection. We have collected 663 chest CT scans of COVID-19 patients from healthcare centers around the world, and created pixel wise segmentation labels for nearly 25,000 slices that segment 6 different patterns of pulmonary opacification. We provide open source implementations and pre-trained weights for multiple segmentation models trained on our dataset. Our best model achieves an opacity Intersection-Over-Union score of 0.76 on our test set, demonstrates successful domain adaptation, and predicts the volume of opacification within 1.7\% of expert radiologists. Additionally, we present an analysis of the inter-observer variability inherent to this task, and propose methods for appropriate probabilistic approaches.

[1]  Zohreh Azimifar,et al.  Lung nodule segmentation and recognition using SVM classifier and active contour modeling: A complete intelligent system , 2013, Comput. Biol. Medicine.

[2]  N. Müller,et al.  Fleischner Society: glossary of terms for thoracic imaging. , 2008, Radiology.

[3]  Youngjin Yoo,et al.  Quantification of Tomographic Patterns associated with COVID-19 from Chest CT , 2020, ArXiv.

[4]  Wenyu Liu,et al.  Deep Learning-based Detection for COVID-19 from Chest CT using Weak Label , 2020, medRxiv.

[5]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Lina Yao,et al.  Residual Attention U-Net for Automated Multi-Class Segmentation of COVID-19 Chest CT Images , 2020, ArXiv.

[7]  Zhenyu Liu,et al.  Central focused convolutional neural networks: Developing a data-driven model for lung nodule segmentation , 2017, Medical Image Anal..

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Simon K. Warfield,et al.  Deep learning with noisy labels: exploring techniques and remedies in medical image analysis , 2020, Medical Image Anal..

[10]  Mingzhi Li,et al.  Coronavirus Disease (COVID-19): Spectrum of CT Findings and Temporal Progression of the Disease , 2020, Academic Radiology.

[11]  Xiangjian He,et al.  Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges , 2019, Journal of Digital Imaging.

[12]  Alexander Wong,et al.  COVID-Net: a tailored deep convolutional neural network design for detection of COVID-19 cases from chest X-ray images , 2020, Scientific reports.

[13]  Georg Langs,et al.  Automatic lung segmentation in routine imaging is a data diversity problem, not a methodology problem , 2020, ArXiv.

[14]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[15]  Roberto Cipolla,et al.  Semantic object classes in video: A high-definition ground truth database , 2009, Pattern Recognit. Lett..

[16]  Ling Shao,et al.  Inf-Net: Automatic COVID-19 Lung Infection Segmentation From CT Images , 2020, IEEE Transactions on Medical Imaging.

[17]  Su Ruan,et al.  An automatic COVID-19 CT segmentation network using spatial and channel attention mechanism , 2020, ArXiv.

[18]  Georg Langs,et al.  Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery , 2017, IPMI.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[21]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[22]  Long Jiang Zhang,et al.  Coronavirus Disease 2019 (COVID-19): A Perspective from China , 2020, Radiology.

[23]  Georg Langs,et al.  Automatic lung segmentation in routine imaging is primarily a data diversity problem, not a methodology problem , 2020, European Radiology Experimental.

[24]  Su Ruan,et al.  An automatic COVID-19 CT segmentation based on U-Net with attention mechanism , 2020 .

[25]  Nicola Sverzellati,et al.  Well-aerated Lung on Admitting Chest CT to Predict Adverse Outcome in COVID-19 Pneumonia , 2020, Radiology.

[26]  Heshui Shi,et al.  Temporal Changes of CT Findings in 90 Patients with COVID-19 Pneumonia: A Longitudinal Study , 2020, Radiology.

[27]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.