Accuracy of artificial intelligence CT quantification in predicting COVID-19 subjects’ prognosis

Background Artificial intelligence (AI)-aided analysis of chest CT expedites the quantification of abnormalities and may facilitate the diagnosis and assessment of the prognosis of subjects with COVID-19. Objectives This study investigates the performance of an AI-aided quantification model in predicting the clinical outcomes of hospitalized subjects with COVID-19 and compares it with radiologists’ performance. Subjects and methods A total of 90 subjects with COVID-19 (men, n = 59 [65.6%]; age, 52.9±16.7 years) were recruited in this cross-sectional study. Quantification of the total and compromised lung parenchyma was performed by two expert radiologists using a volumetric image analysis software and compared against an AI-assisted package consisting of a modified U-Net model for segmenting COVID-19 lesions and an off-the-shelf U-Net model augmented with COVID-19 data for segmenting lung volume. The fraction of compromised lung parenchyma (%CL) was calculated. Based on clinical results, the subjects were divided into two categories: critical (n = 45) and noncritical (n = 45). All admission data were compared between the two groups. Results There was an excellent agreement between the radiologist-obtained and AI-assisted measurements (intraclass correlation coefficient = 0.88, P < 0.001). Both the AI-assisted and radiologist-obtained %CLs were significantly higher in the critical subjects (P = 0.009 and 0.02, respectively) than in the noncritical subjects. In the multivariate logistic regression analysis to distinguish the critical subjects, an AI-assisted %CL ≥35% (odds ratio [OR] = 17.0), oxygen saturation level of <88% (OR = 33.6), immunocompromised condition (OR = 8.1), and other comorbidities (OR = 15.2) independently remained as significant variables in the models. Our proposed model obtained an accuracy of 83.9%, a sensitivity of 79.1%, and a specificity of 88.6% in predicting critical outcomes. Conclusions AI-assisted measurements are similar to quantitative radiologist-obtained measurements in determining lung involvement in COVID-19 subjects.

[1]  A. Chincarini,et al.  A multicenter evaluation of a deep learning software (LungQuant) for lung parenchyma characterization in COVID-19 pneumonia , 2023, European Radiology Experimental.

[2]  H. Soltanian-Zadeh,et al.  A Multi-centric Evaluation of Deep Learning Models for Segmentation of COVID-19 Lung Lesions on Chest CT Scans , 2022, Iranian Journal of Radiology.

[3]  C. Romei,et al.  Lung vessel volume evaluated with CALIPER software is an independent predictor of mortality in COVID-19 patients: a multicentric retrospective analysis , 2022, European Radiology.

[4]  E. Kunieda,et al.  Effects of sample size and data augmentation on U-Net-based automatic segmentation of various organs , 2021, Radiological Physics and Technology.

[5]  F. Salahshour,et al.  Factors Predicting Outcome in Intensive Care Unit-Admitted COVID-19 Patients: Using Clinical, Laboratory, and Radiologic Characteristics , 2021, Critical care research and practice.

[6]  M. Kalra,et al.  Comparison of deep learning, radiomics and subjective assessment of chest CT findings in SARS-CoV-2 pneumonia , 2021, Clinical Imaging.

[7]  Tharun J. Iyer,et al.  Performance analysis of lightweight CNN models to segment infectious lung tissues of COVID-19 cases from tomographic images , 2021, PeerJ Comput. Sci..

[8]  H. Ghanaati,et al.  Clinical and chest CT features as a predictive tool for COVID-19 clinical progress: introducing a novel semi-quantitative scoring system , 2021, European Radiology.

[9]  Quanzheng Li,et al.  Artificial intelligence matches subjective severity assessment of pneumonia for prediction of patient outcome and need for mechanical ventilation: a cohort study , 2021, Scientific reports.

[10]  H. Soltanian-Zadeh,et al.  Segmentation of COVID-19 Infections on CT: Comparison of Four UNet-Based Networks , 2020, 2020 27th National and 5th International Iranian Conference on Biomedical Engineering (ICBME).

[11]  Miele Vittorio,et al.  Clinical and laboratory data, radiological structured report findings and quantitative evaluation of lung involvement on baseline chest CT in COVID-19 patients to predict prognosis , 2020, La radiologia medica.

[12]  W. Cai,et al.  CT Quantification and Machine-learning Models for Assessment of Disease Severity and Prognosis of COVID-19 Patients , 2020, Academic Radiology.

[13]  A. Zangrillo,et al.  Initial chest radiographs and artificial intelligence (AI) predict clinical outcomes in COVID-19 patients: analysis of 697 Italian patients , 2020, European Radiology.

[14]  K. Sklinda,et al.  COVID-19 severity scoring systems in radiological imaging – a review , 2020, Polish journal of radiology.

[15]  J. Dehmeshki,et al.  Current Landscape of Imaging and the Potential Role for Artificial Intelligence in the Management of COVID-19 , 2020, Current Problems in Diagnostic Radiology.

[16]  Santi Wulan Purnami,et al.  UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation , 2020, TELKOMNIKA (Telecommunication Computing Electronics and Control).

[17]  E. Lanza,et al.  Quantitative chest CT analysis in COVID-19 to predict the need for oxygenation support and intubation , 2020, European Radiology.

[18]  D. Dong,et al.  The Role of Imaging in the Detection and Management of COVID-19: A Review , 2020, IEEE Reviews in Biomedical Engineering.

[19]  Haibo Xu,et al.  Prediction of the Development of Pulmonary Fibrosis Using Serial Thin-Section CT and Clinical Features in Patients Discharged after Treatment for COVID-19 Pneumonia , 2020, Korean journal of radiology.

[20]  Xin Yang,et al.  CT radiomics can help screen the Coronavirus disease 2019 (COVID-19): a preliminary study , 2020, Science China Information Sciences.

[21]  Dinggang Shen,et al.  Review of Artificial Intelligence Techniques in Imaging Data Acquisition, Segmentation, and Diagnosis for COVID-19 , 2020, IEEE Reviews in Biomedical Engineering.

[22]  M. Nishimura,et al.  Intensive care management of coronavirus disease 2019 (COVID-19): challenges and recommendations , 2020, The Lancet Respiratory Medicine.

[23]  Ran Yang,et al.  Chest CT Severity Score: An Imaging Tool for Assessing Severe COVID-19 , 2020, Radiology. Cardiothoracic imaging.

[24]  Jun Liu,et al.  Relation Between Chest CT Findings and Clinical Conditions of Coronavirus Disease (COVID-19) Pneumonia: A Multicenter Study. , 2020, AJR. American journal of roentgenology.

[25]  S. Röhrich,et al.  Automatic lung segmentation in routine imaging is primarily a data diversity problem, not a methodology problem , 2020, European Radiology Experimental.

[26]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[27]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.