Large-scale international validation of the ADO index in subjects with COPD: an individual subject data analysis of 10 cohorts

Background Little evidence on the validity of simple and widely applicable tools to predict mortality in patients with chronic obstructive pulmonary disease (COPD) exists. Objective To conduct a large international study to validate the ADO index that uses age, dyspnoea and FEV1 to predict 3-year mortality and to update it in order to make prediction of mortality in COPD patients as generalisable as possible. Design Individual subject data analysis of 10 European and American cohorts (n=13 914). Setting Population-based, primary, secondary and tertiary care. Patients COPD GOLD stages I–IV. Measurements We validated the original ADO index. We then obtained an updated ADO index in half of our cohorts to improve its predictive accuracy, which in turn was validated comprehensively in the remaining cohorts using discrimination, calibration and decision curve analysis and a number of sensitivity analyses. Results 1350 (9.7%) of all subjects with COPD (60% male, mean age 61 years, mean FEV1 66% predicted) had died at 3 years. The original ADO index showed high discrimination but poor calibration (p<0.001 for difference between predicted and observed risk). The updated ADO index (scores from 0 to 14) preserved excellent discrimination (area under curve 0.81, 95% CI 0.80 to 0.82) but showed much improved calibration with predicted 3-year risks from 0.7% (95% CI 0.6% to 0.9%, score of 0) to 64.5% (61.2% to 67.7%, score of 14). The ADO index showed higher net benefit in subjects at low-to-moderate risk of 3-year mortality than FEV1 alone. Interpretation The updated 15-point ADO index accurately predicts 3-year mortality across the COPD severity spectrum and can be used to inform patients about their prognosis, clinical trial study design or benefit harm assessment of medical interventions.

[1]  E. Steyerberg Applications of Prediction Models , 2019, Statistics for Biology and Health.

[2]  Josep Roca,et al.  Identification and prospective validation of clinically relevant chronic obstructive pulmonary disease (COPD) subtypes , 2010, Thorax.

[3]  John Doyle,et al.  A review of quantitative risk-benefit methodologies for assessing drug safety and efficacy-report of the ISPOR risk-benefit management working group. , 2010, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[4]  Niels H Chavannes,et al.  Derivation and validation of a composite index of severity in chronic obstructive pulmonary disease: the DOSE Index. , 2009, American journal of respiratory and critical care medicine.

[5]  Ulrike Held,et al.  Expansion of the prognostic assessment of patients with chronic obstructive pulmonary disease: the updated BODE index and the ADO index , 2009, The Lancet.

[6]  C.J.H. Mann,et al.  Clinical Prediction Models: A Practical Approach to Development, Validation and Updating , 2009 .

[7]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: validating a prognostic model , 2009, BMJ : British Medical Journal.

[8]  J. Yarnold,et al.  Early and locally advanced breast cancer: diagnosis and treatment National Institute for Health and Clinical Excellence guideline 2009. , 2009, Clinical oncology (Royal College of Radiologists (Great Britain)).

[9]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: Developing a prognostic model , 2009, BMJ : British Medical Journal.

[10]  B. Yawn,et al.  Aspirin for the prevention of cardiovascular disease: U.S. Preventive Services Task Force recommendation statement. , 2009 .

[11]  U. P. S. T. Force Aspirin for the Prevention of Cardiovascular Disease: U.S. Preventive Services Task Force Recommendation Statement , 2009, Annals of Internal Medicine.

[12]  Yvonne Vergouwe,et al.  Prognosis and prognostic research: what, why, and how? , 2009, BMJ : British Medical Journal.

[13]  N. Unwin,et al.  Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) Detection, Evaluation, and Treatment of High Blood Cholesterol Education Program (NCEP) Expert Panel on Executive Summary of the Third Report of the National , 2009 .

[14]  J. Garcia-Aymerich,et al.  Caracterización fenotípica y evolución de la EPOC en el estudio PAC-COPD: diseño y metodología , 2009 .

[15]  E. Steyerberg Study design for prediction models , 2009 .

[16]  F. Gómez,et al.  [Phenotypic characterization and course of chronic obstructive pulmonary disease in the PAC-COPD Study: design and methods]. , 2009, Archivos de bronconeumologia.

[17]  A. Vickers Decision Analysis for the Evaluation of Diagnostic Tests, Prediction Models, and Molecular Markers , 2008, The American statistician.

[18]  E. Steyerberg Clinical Prediction Models , 2008, Statistics for Biology and Health.

[19]  M Cazzola,et al.  Outcomes for COPD pharmacological trials: From lung function to biomarkers. , 2008, Revista portuguesa de pneumologia.

[20]  C. Pedone,et al.  COPD: more than respiratory , 2008, The Lancet.

[21]  Y Vergouwe,et al.  Updating methods improved the performance of a clinical prediction model in new patients. , 2008, Journal of clinical epidemiology.

[22]  David M Kent,et al.  Limitations of applying summary results of clinical trials to individual patients: the need for risk stratification. , 2007, JAMA.

[23]  Paul K J Han,et al.  Communicating the Uncertainty of Harms and Benefits of Medical Interventions , 2007, Medical decision making : an international journal of the Society for Medical Decision Making.

[24]  C. Mathers,et al.  Projections of Global Mortality and Burden of Disease from 2002 to 2030 , 2006, PLoS medicine.

[25]  E. Elkin,et al.  Decision Curve Analysis: A Novel Method for Evaluating Prediction Models , 2006, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  Theo Stijnen,et al.  Using the outcome for imputation of missing predictor values was preferred. , 2006, Journal of clinical epidemiology.

[27]  T. Stijnen,et al.  Review: a gentle introduction to imputation of missing values. , 2006, Journal of clinical epidemiology.

[28]  C. D. Mathers,et al.  Chronic obstructive pulmonary disease: current burden and future projections , 2006, European Respiratory Journal.

[29]  N. Clark,et al.  Standards of Medical Care in Diabetes: Response to Power , 2006 .

[30]  Cesar G Victora,et al.  Chronic obstructive pulmonary disease in five Latin American cities (the PLATINO study): a prevalence study , 2005, The Lancet.

[31]  N. Anthonisen,et al.  The effects of a smoking cessation intervention on 14.5-year mortality: a randomized clinical trial , 2005 .

[32]  Yvonne Vergouwe,et al.  Substantial effective sample sizes were required for external validation studies of predictive logistic regression models. , 2005, Journal of clinical epidemiology.

[33]  P. Austin,et al.  Conventional models overestimate the statistical significance of volume-outcome associations, compared with multilevel models. , 2005, Journal of clinical epidemiology.

[34]  Daniel W. Jones,et al.  Toward resolution of cardiovascular health disparities in African Americans: design and methods of the Jackson Heart Study. , 2005, Ethnicity & disease.

[35]  Y. Jang,et al.  Standards of Medical Care in Diabetes-2010 by the American Diabetes Association: Prevention and Management of Cardiovascular Disease , 2010 .

[36]  A. Dhar,et al.  National Institute for Health and Clinical Excellence , 2005 .

[37]  Ralph B D'Agostino,et al.  Presentation of multivariate data for clinical use: The Framingham Study risk score functions. , 2005, Statistics in medicine.

[38]  Gregory Evans,et al.  Laboratory, Reading Center, and Coordinating Center Data Management Methods in the Jackson Heart Study , 2004, The American journal of the medical sciences.

[39]  Ewout W Steyerberg,et al.  Validation and updating of predictive logistic regression models: a study on sample size and shrinkage , 2004, Statistics in medicine.

[40]  W. MacNee,et al.  Standards for the diagnosis and treatment of patients with COPD: a summary of the ATS/ERS position paper , 2004, European Respiratory Journal.

[41]  Ciro Casanova,et al.  The body-mass index, airflow obstruction, dyspnea, and exercise capacity index in chronic obstructive pulmonary disease. , 2004, The New England journal of medicine.

[42]  Steven Piantadosi,et al.  A randomized trial comparing lung-volume-reduction surgery with medical therapy for severe emphysema. , 2003, The New England journal of medicine.

[43]  Ewout W Steyerberg,et al.  Internal and external validation of predictive models: a simulation study of bias and precision in small samples. , 2003, Journal of clinical epidemiology.

[44]  J. Mckenney,et al.  National Cholesterol Education Program Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults (Adult Treatment Panel III) , 2002 .

[45]  Jordi Alonso,et al.  Health-related quality of life and mortality in male patients with chronic obstructive pulmonary disease. , 2002, American journal of respiratory and critical care medicine.

[46]  S. Grundy,et al.  National Cholesterol Education Program Third Report of the National Cholesterol Education Program ( NCEP ) Expert Panel on Detection , Evaluation , and Treatment of High Blood Cholesterol in Adults ( Adult Treatment Panel III ) Final Report , 2022 .

[47]  M. Gail The Estimation and Use of Absolute Risk for Weighing the Risks and Benefits of Selective Estrogen Receptor Modulators for Preventing Breast Cancer , 2001, Annals of the New York Academy of Sciences.

[48]  Vivek Goel,et al.  An Introduction to Multilevel Regression Models , 2001, Canadian journal of public health = Revue canadienne de sante publique.

[49]  David E. Booth,et al.  Analysis of Incomplete Multivariate Data , 2000, Technometrics.

[50]  D G Altman,et al.  What do we mean by validating a prognostic model? , 2000, Statistics in medicine.

[51]  S Greenland,et al.  Principles of multilevel modelling. , 2000, International journal of epidemiology.

[52]  K. Covinsky,et al.  Assessing the Generalizability of Prognostic Information , 1999, Annals of Internal Medicine.

[53]  J. Concato,et al.  A simulation study of the number of events per variable in logistic regression analysis. , 1996, Journal of clinical epidemiology.

[54]  G. Owens The Lung Health Study. , 1996, Current opinion in pulmonary medicine.

[55]  W. Bailey,et al.  Design of the Lung Health Study: a randomized clinical trial of early intervention for chronic obstructive pulmonary disease. , 1993, Controlled clinical trials.

[56]  R. Kronmal,et al.  The Cardiovascular Health Study: design and rationale. , 1991, Annals of epidemiology.

[57]  F. Harrell,et al.  Regression modelling strategies for improved prognostic prediction. , 1984, Statistics in medicine.