A general presentation on how to carry out a CHARMS analysis for prognostic multivariate models

The CHARMS (critical appraisal and data extraction for systematic reviews of prediction modelling studies) checklist was created to provide methodological appraisals of predictive models, based on the best available scientific evidence and through systematic reviews. Our purpose is to give a general presentation on how to carry out a CHARMS analysis for prognostic multivariate models, making clear what the steps are and how they are applied individually to the studies included in the systematic review. This tutorial is aimed at providing such a resource. In addition to this explanation, we will apply the method to a real case: predictive models of atrial fibrillation in the community. This methodology could be applied to other predictive models using the steps provided in our review so as to have complete information for each included model and determine whether it can be implemented in daily clinical practice.

[1]  G. Collins,et al.  Prediction models for cardiovascular disease risk in the general population: systematic review , 2016, British Medical Journal.

[2]  Antonio Palazón-Bru,et al.  A method to construct a points system to predict cardiovascular disease considering repeated measures of risk factors , 2016, PeerJ.

[3]  Elsayed Z Soliman,et al.  A clinical risk score for atrial fibrillation in a biracial prospective cohort (from the Atherosclerosis Risk in Communities [ARIC] study). , 2011, The American journal of cardiology.

[4]  Aankita Kaur.  Hybrid approach: Predictive data mining model for Atrial Fibrillation , 2011, 2011 World Congress on Information and Communication Technologies.

[5]  G. Collins,et al.  Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement , 2015, BMJ : British Medical Journal.

[6]  Jin-Ling Tang,et al.  Prognostic Models for Predicting Overall Survival in Patients with Primary Gastric Cancer: A Systematic Review , 2019, BioMed research international.

[7]  D. Levy,et al.  Development of a risk score for atrial fibrillation (Framingham Heart Study): a community-based cohort study , 2009, The Lancet.

[8]  G. Collins,et al.  Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist , 2014, PLoS medicine.

[9]  David Moher,et al.  CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. , 2010, Journal of clinical epidemiology.

[10]  R. Van der Meer,et al.  A systematic review of methodological quality of model development studies predicting prognostic outcome for resectable pancreatic cancer , 2019, BMJ Open.

[11]  David Moher,et al.  STARD 2015: an updated list of essential items for reporting diagnostic accuracy studies , 2015, BMJ : British Medical Journal.

[12]  Y. Kokubo,et al.  Development of a Basic Risk Score for Incident Atrial Fibrillation in a Japanese General Population　- The Suita Study. , 2017, Circulation journal : official journal of the Japanese Circulation Society.

[13]  P. Kirchhof,et al.  2016 ESC Guidelines for the management of atrial fibrillation developed in collaboration with EACTS. , 2016, European journal of cardio-thoracic surgery : official journal of the European Association for Cardio-thoracic Surgery.

[14]  Nancy R. Cook,et al.  Novel genetic markers improve measures of atrial fibrillation risk prediction , 2013, European heart journal.

[15]  T. Wakatsuki,et al.  Clinical, Electrocardiographic, and Echocardiographic Parameter Combination Predicts the Onset of Atrial Fibrillation. , 2018, Circulation journal : official journal of the Japanese Circulation Society.

[16]  H. May,et al.  Clinical predictors of risk for atrial fibrillation: implications for diagnosis and monitoring. , 2014, Mayo Clinic proceedings.

[17]  V. Gil-Guillén,et al.  Sample size calculation to externally validate scoring systems based on logistic regression models , 2017, PloS one.

[18]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2008, Journal of clinical epidemiology.

[19]  I. Graham,et al.  Value and limitations of existing scores for the assessment of cardiovascular risk: a review for clinicians. , 2009, Journal of the American College of Cardiology.

[20]  G. Collins,et al.  Developing risk prediction models for type 2 diabetes: a systematic review of methodology and reporting , 2011, BMC medicine.

[21]  V. Gil-Guillén,et al.  A systematic review of predictive models for recurrence and mortality in patients with tongue cancer. , 2019, European journal of cancer care.

[22]  D. Mutlak,et al.  Risk Score for Prediction of 10-Year Atrial Fibrillation: A Community-Based Study , 2018, Thrombosis and Haemostasis.

[23]  Gary S Collins,et al.  Predicting the 10 year risk of cardiovascular disease in the United Kingdom: independent and external validation of an updated version of QRISK2 , 2012, BMJ : British Medical Journal.

[24]  Á. Alonso,et al.  Predicting Atrial Fibrillation and Its Complications. , 2016, Circulation journal : official journal of the Japanese Circulation Society.

[25]  Roger L. Brown,et al.  Systematic review of prediction models for delirium in the older adult inpatient , 2018, BMJ Open.

[26]  Olle Melander,et al.  Assessment of conventional cardiovascular risk factors and multiple biomarkers for the prediction of incident heart failure and atrial fibrillation. , 2010, Journal of the American College of Cardiology.

[27]  O. Franco,et al.  B-type natriuretic peptide and C-reactive protein in the prediction of atrial fibrillation risk: the CHARGE-AF Consortium of community-based cohort studies. , 2014, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[28]  V. Gil-Guillén,et al.  A critical appraisal of the clinical applicability and risk of bias of the predictive models for mortality and recurrence in patients with oropharyngeal cancer: Systematic review , 2019, Head & neck.

[29]  G. Zhang,et al.  Incidence of atrial fibrillation and its risk prediction model based on a prospective urban Han Chinese cohort , 2017, Journal of Human Hypertension.

[30]  Gary S Collins,et al.  A systematic review finds prediction models for chronic kidney disease were poorly reported and often developed using inappropriate methods. , 2013, Journal of clinical epidemiology.