Statistical issues in the development of COVID‐19 prediction models

Clinical prediction models to aid diagnosis, assess disease severity or prognosis have enormous potential to aid clinical decision making during the covid-19 pandemic. A living systematic review has, so far, identified 145 covid-19 prediction models published (or preprinted) between 03-January-2020 and 05-May-2020. Despite the considerable interest in developing covid-19 prediction models, the review concluded that all models to date, with no exception, are at high risk of bias with concerns related to data quality, flaws in the statistical analysis and poor reporting, and none are recommended for use. Disappointingly, the recent study by Yang and colleagues describing the development of a prediction model to identify covid-19 patients with severe disease, is no different. The study has failed to report important information needed to judge the study findings, but has numerous methodological concerns in design and analysis that deserve highlighting. This article is protected by copyright. All rights reserved.

[1]  P. Yang,et al.  A retrospective study on the epidemiological characteristics and establishment of an early warning system of severe COVID‐19 patients , 2020, Journal of medical virology.

[2]  G. Heinze,et al.  Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal , 2020, BMJ.

[3]  Richard D Riley,et al.  Calculating the sample size required for developing a clinical prediction model , 2020, BMJ.

[4]  G. Collins,et al.  Guide to presenting clinical prediction models for use in clinical settings , 2019, BMJ.

[5]  Sander Greenland,et al.  Separation in Logistic Regression: Causes, Consequences, and Control. , 2018, American journal of epidemiology.

[6]  L. Tao,et al.  [Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis]. , 2018, Zhonghua yi xue za zhi.

[7]  Gary S Collins,et al.  Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): Explanation and Elaboration , 2015, Annals of Internal Medicine.

[8]  G. Collins,et al.  Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD): The TRIPOD Statement , 2015, Annals of Internal Medicine.

[9]  Martha Sajatovic,et al.  Clinical Prediction Models , 2013 .

[10]  M. Kenward,et al.  Multiple imputation for missing data in epidemiological and clinical research: potential and pitfalls , 2009, BMJ : British Medical Journal.

[11]  C.J.H. Mann,et al.  Clinical Prediction Models: A Practical Approach to Development, Validation and Updating , 2009 .

[12]  G W Sun,et al.  Inappropriate use of bivariable analysis to screen risk factors for use in multivariable analysis. , 1996, Journal of clinical epidemiology.