Potential Features of ICU Admission in X-ray Images of COVID-19 Patients

X-ray images may present non-trivial features with predictive information of patients that develop severe symptoms of COVID-19. If true, this hypothesis may have practical value in allocating resources to particular patients while using a relatively inexpensive imaging technique. The difficulty of testing such a hypothesis comes from the need for large sets of labelled data, which not only need to be well-annotated but also should contemplate the post-imaging severity outcome. On this account, this paper presents a methodology for extracting features from a limited data set with outcome label (patient required ICU admission or not) and correlating its significance to an additional, larger data set with hundreds of images. The methodology employs a neural network trained to recognise lung pathologies to extract the semantic features, which are then analysed with a shallow decision tree to limit overfitting while increasing interpretability. This analysis points out that only a few features explain most of the variance between patients that developed severe symptoms. When applied to an unrelated, larger data set with labels extracted from clinical notes, the method classified distinct sets of samples where there was a much higher frequency of labels such as `Consolidation', `Effusion', and `alveolar'. A further brief analysis on the locations of such labels also showed a significant increase in the frequency of words like `bilateral', `middle', and `lower' in patients classified as with higher chances of going severe. The methodology for dealing with the lack of specific ICU label data while attesting correlations with a data set containing text notes is novel; its results suggest that some pathologies should receive higher weights when assessing disease severity.

[1]  Yoshua Bengio,et al.  Predicting COVID-19 Pneumonia Severity on Chest X-ray With Deep Learning , 2020, Cureus.

[2]  K. Yuen,et al.  Imaging Profile of the COVID-19 Infection: Radiologic Findings and Literature Review , 2020, Radiology. Cardiothoracic imaging.

[3]  Yuan Gao,et al.  Weakly Supervised Deep Learning for COVID-19 Infection Detection and Classification From CT Images , 2020, IEEE Access.

[4]  Serge J. Belongie,et al.  Does Image Segmentation Improve Object Categorization ? , 2007 .

[5]  Deniz Korkmaz,et al.  COVIDiagnosis-Net: Deep Bayes-SqueezeNet based diagnosis of the coronavirus disease 2019 (COVID-19) from X-ray images , 2020, Medical Hypotheses.

[6]  Roger G. Mark,et al.  MIMIC-CXR: A large publicly available database of labeled chest radiographs , 2019, ArXiv.

[7]  Yizhou Yu,et al.  A deep learning approach to characterize 2019 coronavirus disease (COVID-19) pneumonia in chest CT images , 2020, European Radiology.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Stefan Jaeger,et al.  Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. , 2014, Quantitative imaging in medicine and surgery.

[10]  Sema Candemir,et al.  A review on lung boundary detection in chest X-rays , 2019, International Journal of Computer Assisted Radiology and Surgery.

[11]  J. Vincent,et al.  Understanding pathways to death in patients with COVID-19 , 2020, The Lancet Respiratory Medicine.

[12]  A Malicdem,et al.  Deep Residual U-Net Based Lung Image Segmentation for Lung Disease Detection , 2020, IOP Conference Series: Materials Science and Engineering.

[13]  Richard D Riley,et al.  Prediction models for diagnosis and prognosis of covid-19 infection: systematic review and critical appraisal , 2020 .

[14]  D. Jin,et al.  From community-acquired pneumonia to COVID-19: a deep learning–based method for quantitative analysis of COVID-19 on thick-section CT scans , 2020, European Radiology.

[15]  W. Liang,et al.  Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography , 2020, Cell.

[16]  H. Kauczor,et al.  The Role of Chest Imaging in Patient Management during the COVID-19 Pandemic: A Multinational Consensus Statement from the Fleischner Society , 2020, Radiology.

[17]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[18]  Joseph D. Janizek,et al.  AI for radiographic COVID-19 detection selects shortcuts over signal , 2020, Nature Machine Intelligence.

[19]  Yaozong Gao,et al.  Hierarchical Lung Field Segmentation With Joint Shape and Appearance Sparse Learning , 2014, IEEE Transactions on Medical Imaging.

[20]  Claude E. Shannon,et al.  The mathematical theory of communication , 1950 .

[21]  Jannis Born,et al.  POCOVID-Net: Automatic Detection of COVID-19 From a New Lung Ultrasound Imaging Dataset (POCUS) , 2020, ArXiv.

[22]  Y. Hu,et al.  Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China , 2020, The Lancet.

[23]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[24]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[25]  Joseph Paul Cohen,et al.  On the limits of cross-domain generalization in automated X-ray prediction , 2020, MIDL.

[26]  Maria Wimmer,et al.  Fully Convolutional Architectures for Multiclass Segmentation in Chest Radiographs , 2017, IEEE Transactions on Medical Imaging.

[27]  K. Yuen,et al.  Clinical Characteristics of Coronavirus Disease 2019 in China , 2020, The New England journal of medicine.

[28]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[29]  Dae Chul Cho,et al.  Deep Learning-Based Decision-Tree Classifier for COVID-19 Diagnosis From Chest X-ray Imaging , 2020, Frontiers in Medicine.

[30]  Jong Chul Ye,et al.  Deep Learning COVID-19 Features on CXR Using Limited Training Data Sets , 2020, IEEE Transactions on Medical Imaging.

[31]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[32]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[33]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Yifan Yu,et al.  CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison , 2019, AAAI.

[35]  Cristiano Saltori,et al.  Deep Learning for Classification and Localization of COVID-19 Markers in Point-of-Care Lung Ultrasound , 2020, IEEE Transactions on Medical Imaging.

[36]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[37]  Qianjin Feng,et al.  Lung Field Segmentation in Chest Radiographs From Boundary Maps by a Structured Edge Detector , 2018, IEEE Journal of Biomedical and Health Informatics.

[38]  Jonathan E. Schmitz,et al.  Laboratory Diagnosis of COVID-19: Current Issues and Challenges , 2020, Journal of Clinical Microbiology.

[39]  Jun Liu,et al.  Relation Between Chest CT Findings and Clinical Conditions of Coronavirus Disease (COVID-19) Pneumonia: A Multicenter Study. , 2020, AJR. American journal of roentgenology.

[40]  J. Civit-Masot,et al.  Deep Learning System for COVID-19 Diagnosis Aid Using X-ray Pulmonary Images , 2020 .

[41]  Hayit Greenspan,et al.  Rapid AI Development Cycle for the Coronavirus (COVID-19) Pandemic: Initial Results for Automated Detection & Patient Monitoring using Deep Learning CT Image Analysis , 2020, ArXiv.

[42]  C. Park,et al.  Chest Radiographic and CT Findings of the 2019 Novel Coronavirus Disease (COVID-19): Analysis of Nine Patients Treated in Korea , 2020, Korean journal of radiology.

[43]  Miguel Cazorla,et al.  BIMCV COVID-19+: a large annotated dataset of RX and CT images from COVID-19 patients , 2020, ArXiv.

[44]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection , 2020, ArXiv.

[45]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[46]  Z. Fayad,et al.  Chest CT Findings in Coronavirus Disease-19 (COVID-19): Relationship to Duration of Infection , 2020, Radiology.

[47]  Qingmao Hu,et al.  Automatic Lung Field Segmentation in X-ray Radiographs Using Statistical Shape and Appearance Models , 2016 .

[48]  Sangheum Hwang,et al.  Accurate Lung Segmentation via Network-Wise Training of Convolutional Networks , 2017, DLMIA/ML-CDS@MICCAI.

[49]  Joseph Paul Cohen,et al.  COVID-19 Image Data Collection: Prospective Predictions Are the Future , 2020, The Journal of Machine Learning for Biomedical Imaging.