COVID-19 Prognostic Models: A Pro-con Debate for Machine Learning vs. Traditional Statistics

The SARS-CoV-2 virus, which causes the COVID-19 pandemic, has had an unprecedented impact on healthcare requiring multidisciplinary innovation and novel thinking to minimize impact and improve outcomes. Wide-ranging disciplines have collaborated including diverse clinicians (radiology, microbiology, and critical care), who are working increasingly closely with data-science. This has been leveraged through the democratization of data-science with the increasing availability of easy to access open datasets, tutorials, programming languages, and hardware which makes it significantly easier to create mathematical models. To address the COVID-19 pandemic, such data-science has enabled modeling of the impact of the virus on the population and individuals for diagnostic, prognostic, and epidemiological ends. This has led to two large systematic reviews on this topic that have highlighted the two different ways in which this feat has been attempted: one using classical statistics and the other using more novel machine learning techniques. In this review, we debate the relative strengths and weaknesses of each method toward the specific task of predicting COVID-19 outcomes.

[1]  G. Heinze,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[2]  Esmita Charani,et al.  Prognostic Modeling of COVID-19 Using Artificial Intelligence in the United Kingdom: Model Development and Validation , 2020, Journal of Medical Internet Research.

[3]  Guangyou Duan,et al.  A prospective observational cohort study , 2016 .

[4]  K. Yuen,et al.  Clinical Characteristics of Coronavirus Disease 2019 in China , 2020, The New England journal of medicine.

[5]  Scott M. Lundberg,et al.  Explainable machine-learning predictions for the prevention of hypoxaemia during surgery , 2018, Nature Biomedical Engineering.

[6]  Douglas G. Altman,et al.  Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD) , 2015, Circulation.

[7]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[8]  S. Mitter,et al.  Testing the Manifold Hypothesis , 2013, 1310.0425.

[9]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[10]  Suman V. Ravuri,et al.  A Clinically Applicable Approach to Continuous Prediction of Future Acute Kidney Injury , 2019, Nature.

[11]  J. Pearl.  Causality: Models, Reasoning and Inference , 2000 .

[12]  T. Therneau,et al.  A model to predict survival in patients with end‐stage liver disease , 2001 .

[13]  J. Bakker,et al.  Effect of a Resuscitation Strategy Targeting Peripheral Perfusion Status vs Serum Lactate Levels on 28-Day Mortality Among Patients with Septic Shock: A Bayesian Reanalysis of the ANDROMEDA-SHOCK Trial. , 2019, American journal of respiratory and critical care medicine.

[14]  Jie Ma,et al.  A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. , 2019, Journal of clinical epidemiology.

[15]  U. Rajendra Acharya,et al.  Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks , 2020, Computers in Biology and Medicine.

[16]  Kathy Rowan,et al.  Delay to admission to critical care and mortality among deteriorating ward patients in UK hospitals: a multicentre, prospective, observational cohort study , 2015, The Lancet.

[17]  Nathan Peiffer-Smadja,et al.  Machine learning in the clinical microbiology laboratory: has the time come for routine practice? , 2020, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[18]  W. Knaus,et al.  APACHE II: a severity of disease classification system. , 1985 .

[19]  D M Linton,et al.  Severity of disease classification system. , 1991, Critical care medicine.

[20]  M. Jones,et al.  The role of chest radiography in confirming covid-19 pneumonia , 2020, BMJ.

[21]  Adam Trendowicz,et al.  Model Development and Validation , 2013 .

[22]  Q. Tao,et al.  Correlation of Chest CT and RT-PCR Testing in Coronavirus Disease 2019 (COVID-19) in China: A Report of 1014 Cases , 2020, Radiology.

[23]  M. Kubát.  An Introduction to Machine Learning , 2017, Springer International Publishing.

[24]  C. Toumazou,et al.  Supervised machine learning for the prediction of infection on admission to hospital: a prospective observational cohort study , 2018, The Journal of antimicrobial chemotherapy.

[25]  Esmita Charani,et al.  Comparison of deep learning with regression analysis in creating predictive models for SARS-CoV-2 outcomes , 2020, BMC Medical Informatics and Decision Making.

[26]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[27]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[28]  W. Lim,et al.  Defining community acquired pneumonia severity on presentation to hospital: an international derivation and validation study , 2003, Thorax.

[29]  M. van Smeden,et al.  Systematic evaluation and external validation of 22 prognostic models among hospitalised adults with COVID-19: an observational cohort study , 2020, European Respiratory Journal.

[30]  Melina Hosseiny,et al.  Coronavirus (COVID-19) Outbreak: What the Department of Radiology Should Know , 2020, Journal of the American College of Radiology.

[31]  David Mascharka,et al.  Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[32]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[33]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[34]  Brett Kuprel,et al.  Automated Classification of Skin Lesions: From Pixels to Practice. , 2018, The Journal of investigative dermatology.

[35]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[36]  Mesut Toğaçar,et al.  COVID-19 detection using deep learning models to exploit Social Mimic Optimization and structured chest X-ray images using fuzzy color and stacking approaches , 2020, Computers in Biology and Medicine.