An independent and external validation of QRISK2 cardiovascular disease risk score: a prospective open cohort study

Objective To evaluate the performance of the QRISK2 score for predicting 10-year cardiovascular disease in an independent UK cohort of patients from general practice records and to compare it with the NICE version of the Framingham equation and QRISK1. Design Prospective cohort study to validate a cardiovascular risk score. Setting 365 practices from United Kingdom contributing to The Health Improvement Network (THIN) database. Participants 1.58 million patients registered with a general practice between 1 January 1993 and 20 June 2008, aged 35-74 years (9.4 million person years) with 71 465 cardiovascular events. Main outcome measures First diagnosis of cardiovascular disease (myocardial infarction, angina, coronary heart disease, stroke, and transient ischaemic stroke) recorded in general practice records. Results QRISK2 offered improved prediction of a patient’s 10-year risk of cardiovascular disease over the NICE version of the Framingham equation. Discrimination and calibration statistics were better with QRISK2. QRISK2 explained 33% of the variation in men and 40% for women, compared with 29% and 34% respectively for the NICE Framingham and 32% and 38% respectively for QRISK1. The incidence rate of cardiovascular events (per 1000 person years) among men in the high risk group was 27.8 (95% CI 27.4 to 28.2) with QRISK2, 21.9 (21.6 to 22.2) with NICE Framingham, and 24.8 (22.8 to 26.9) with QRISK1. Similarly, the incidence rate of cardiovascular events (per 1000 person years) among women in the high risk group was 24.3 (23.8 to 24.9) with QRISK2, 20.6 (20.1 to 21.0) with NICE Framingham, and 21.8 (18.9 to 24.6) with QRISK1. Conclusions QRISK2 is more accurate in identifying a high risk population for cardiovascular disease in the United Kingdom than the NICE version of the Framingham equation. Differences in performance between QRISK2 and QRISK1 were marginal.

[1]  F. Rademakers,et al.  Quantitative dobutamine stress echocardiography for the early detection of cardiac allograft vasculopathy in heart transplant recipients , 2007, Heart.

[2]  Douglas G Altman,et al.  Developing a prognostic model in the presence of missing data: an ovarian cancer case study. , 2003, Journal of clinical epidemiology.

[3]  Patrick Royston,et al.  Reporting performance of prognostic models in cancer: a review , 2010, BMC medicine.

[4]  J. Robson,et al.  Lipid modification: cardiovascular risk assessment and the modification of blood lipids for the primary and secondary prevention of cardiovascular disease , 2007, Heart.

[5]  Holly Janes,et al.  Assessing the Value of Risk Predictions by Using Risk Stratification Tables , 2008, Annals of Internal Medicine.

[6]  J. Hippisley-Cox,et al.  Performance of the QRISK cardiovascular risk prediction algorithm in an independent UK sample of patients from general practice: a validation study , 2007, Heart.

[7]  Qingxia Chen,et al.  Dealing with missing predictor values when applying clinical prediction models. , 2009, Clinical chemistry.

[8]  N. Cook,et al.  Development and validation of improved algorithms for the assessment of global cardiovascular risk in women: the Reynolds Risk Score. , 2007, JAMA.

[9]  Douglas G Altman,et al.  Combining estimates of interest in prognostic modelling studies after multiple imputation: current practice and guidelines , 2009, BMC medical research methodology.

[10]  I. Graham,et al.  Value and limitations of existing scores for the assessment of cardiovascular risk: a review for clinicians. , 2009, Journal of the American College of Cardiology.

[11]  Patrick Royston,et al.  Multivariable Model-Building: A Pragmatic Approach to Regression Analysis based on Fractional Polynomials for Modelling Continuous Variables , 2008 .

[12]  A. Sheikh,et al.  Predicting cardiovascular risk in England and Wales: prospective derivation and validation of QRISK2 , 2008, BMJ : British Medical Journal.

[13]  D G Altman,et al.  What do we mean by validating a prognostic model? , 2000, Statistics in medicine.

[14]  J. Hippisley-Cox,et al.  Derivation and validation of QRISK, a new cardiovascular disease risk score for the United Kingdom: prospective open cohort study , 2007, BMJ : British Medical Journal.

[15]  R. Marshall Cardiovascular risk can be represented by scaled rectangle diagrams. , 2009, Journal of clinical epidemiology.

[16]  Angela Cooper,et al.  Risk assessment and lipid modification for primary and secondary prevention of cardiovascular disease: summary of NICE guidance , 2008, BMJ : British Medical Journal.

[17]  Gary S Collins,et al.  An independent external validation and evaluation of QRISK cardiovascular risk prediction: a prospective open cohort study , 2009, BMJ : British Medical Journal.

[18]  Patrick Royston,et al.  Explained Variation for Survival Models , 2006 .

[19]  H. Flor QrIsK valIdatIon and evaluatIon , 2009 .

[20]  Patrick Royston,et al.  Reporting methods in studies developing prognostic models in cancer: a review , 2010, BMC medicine.

[21]  Patrick Royston,et al.  A new measure of prognostic separation in survival data , 2004, Statistics in medicine.

[22]  Richard D Riley,et al.  Ten steps towards improving prognosis research , 2009, BMJ : British Medical Journal.

[23]  K. Anderson,et al.  Cardiovascular disease risk profiles. , 1991, American heart journal.

[24]  Martin Utley,et al.  Monitoring risk-adjusted outcomes in congenital heart surgery: does the appropriateness of a risk model change with time? , 2009, The Annals of thoracic surgery.

[25]  Joseph Eliahoo,et al.  Cardiac surgery risk modeling for mortality: a review of current practice and suggestions for improvement. , 2004, The Annals of thoracic surgery.

[26]  J. Schafer Multiple imputation: a primer , 1999, Statistical methods in medical research.

[27]  M. Woodward,et al.  Adding social deprivation and family history to cardiovascular risk assessment: the ASSIGN score from the Scottish Heart Health Extended Cohort (SHHEC) , 2005, Heart.

[28]  F. Harrell,et al.  Criteria for Evaluation of Novel Markers of Cardiovascular Risk: A Scientific Statement From the American Heart Association , 2009, Circulation.

[29]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: validating a prognostic model , 2009, BMJ : British Medical Journal.

[30]  Yvonne Vergouwe,et al.  Development and validation of a prediction model with missing predictor data: a practical approach. , 2010, Journal of clinical epidemiology.

[31]  P. Glasziou,et al.  QRISK may be less useful , 2009, BMJ : British Medical Journal.

[32]  H. Tunstall-Pedoe,et al.  Estimation of ten-year risk of fatal cardiovascular disease in Europe: the SCORE project. , 2003, European heart journal.

[33]  L. Irwig,et al.  Assessing new biomarkers and predictive models for use in clinical practice: a clinician's guide. , 2008, Archives of internal medicine.

[34]  R. Jackson Cardiovascular risk prediction: are we there yet? , 2007, Heart.

[35]  E Graf,et al.  Assessment and comparison of prognostic classification schemes for survival data. , 1999, Statistics in medicine.