Lung Ultrasound Segmentation and Adaptation between COVID-19 and Community-Acquired Pneumonia

Lung ultrasound imaging has been shown effective in detecting typical patterns for interstitial pneumonia, as a point-of-care tool for both patients with COVID-19 and other community-acquired pneumonia (CAP). In this work, we focus on the hyperechoic B-line segmentation task. Using deep neural networks, we automatically outline the regions that are indicative of pathology-sensitive artifacts and their associated sonographic patterns. With a real-world data-scarce scenario, we investigate approaches to utilize both COVID-19 and CAP lung ultrasound data to train the networks;comparing fine-tuning and unsupervised domain adaptation. Segmenting either type of lung condition at inference may support a range of clinical applications during evolving epidemic stages, but also demonstrates value in resource-constrained clinical scenarios. Adapting real clinical data acquired from COVID-19 patients to those from CAP patients significantly improved Dice scores from 0.60 to 0.87 (p <0.001) and from 0.43 to 0.71 (p <0.001), on independent COVID-19 and CAP test cases, respectively. It is of practical value that the improvement was demonstrated with only a small amount of data in both training and adaptation data sets, a common constraint for deploying machine learning models in clinical practice. Interestingly, we also report that the inverse adaptation, from labelled CAP data to unlabeled COVID-19 data, did not demonstrate an improvement when tested on either condition. Furthermore, we offer a possible explanation that correlates the segmentation performance to label consistency and data domain diversity in this point-of-care lung ultrasound application. © 2021, Springer Nature Switzerland AG.

[1]  Cristiano Saltori,et al.  Deep Learning for Classification and Localization of COVID-19 Markers in Point-of-Care Lung Ultrasound , 2020, IEEE Transactions on Medical Imaging.

[2]  Yonina C. Eldar,et al.  Assessment of COVID-19 in lung ultrasound by combining anatomy and sonographic artifacts using deep learning , 2020 .

[3]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[4]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[5]  J. Goulet,et al.  POCOVID-Net: Automatic Detection of COVID-19 From a New Lung Ultrasound Imaging Dataset (POCUS) , 2020, ArXiv.

[6]  Danail Stoyanov,et al.  The challenges of deploying artificial intelligence models in a rapidly evolving pandemic , 2020, Nat. Mach. Intell..

[7]  Wufeng Xue,et al.  Modality alignment contrastive learning for severity assessment of COVID-19 from lung ultrasound and clinical information , 2021, Medical Image Analysis.

[8]  D. Hawkes,et al.  Image quality assessment for closed-loop computer-assisted lung ultrasound , 2020, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling.

[9]  D. Buonsenso,et al.  Routine use of Point-of-Care lung ultrasound during the COVID-19 pandemic , 2020, Medicina Intensiva.

[10]  A. Aujayeb,et al.  Lung ultrasound in the COVID-19 pandemic , 2020, Postgraduate Medical Journal.

[11]  Hao Chen,et al.  Unsupervised Bidirectional Cross-Modality Adaptation via Deeply Synergistic Image and Feature Alignment for Medical Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[12]  Manoranjan Paul,et al.  COVID-19 Detection Through Transfer Learning Using Multimodal Imaging Data , 2020, IEEE Access.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Daniel Lichtenstein,et al.  Comparative Diagnostic Performances of Auscultation, Chest Radiography, and Lung Ultrasonography in Acute Respiratory Distress Syndrome , 2004, Anesthesiology.

[15]  Derek J. Wu,et al.  Development of a convolutional neural network to differentiate among the etiology of similar appearing pathological B lines on lung ultrasound: a deep learning study , 2021, BMJ Open.