Summary measure of discrimination in survival models based on cumulative/dynamic time-dependent ROC curves

Assessments of the discriminative performance of prognostic models have led to the development of several measures that extend the concept of discrimination as evaluated by the receiver operating characteristics curve and the area under the receiver operating characteristic curve (AUC) of diagnostic settings. Thus, several time-dependent-receiver operating characteristic curve and AUC(t) have been proposed. One of the most used, the cumulative/dynamic AUCC,D(t) is the probability that, given two randomly chosen patients, one having failed before t and the other having failed after t, the prognostic marker will be correctly ranked. In this paper, we propose a weighted AUCC,D(t) with time- and data-dependent weights as a summary measure of the mean AUCC,D(t), restricted to a finite time range to ensure its clinical relevance. A simulation study shows that estimated restricted mean AUC increased with the strength of association of the covariate with the outcome, with low impact of censoring, and adequate coverage of bootstrap confidence intervals. We illustrate this methodology to two real datasets from two randomized clinical trials to assess the prognostic factors of the overall mortality in patients who have compensated cirrhosis and to assess the prognostic factors of event-free survival in patients who have acute myeloid leukemia.

[1]  Xiao Song,et al.  A semiparametric approach for the covariate specific ROC curve with survival outcome , 2008 .

[2]  M. Pencina,et al.  Overall C as a measure of discrimination in survival analysis: model specific population value and confidence interval estimation , 2004, Statistics in medicine.

[3]  M. Pepe,et al.  Limitations of the odds ratio in gauging the performance of a diagnostic, prognostic, or screening marker. , 2004, American journal of epidemiology.

[4]  J. Bourhis,et al.  Randomized study of intensified anthracycline doses for induction and recombinant interleukin-2 for maintenance in patients with acute myeloid leukemia age 50 to 70 years: results of the ALFA-9801 study. , 2010, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[5]  B W Turnbull,et al.  Statistical models for longitudinal biomarkers of disease onset. , 2000, Statistics in medicine.

[6]  Jialiang Li,et al.  Time‐dependent ROC analysis under diverse censoring patterns , 2011, Statistics in medicine.

[7]  Guoqing Diao,et al.  Estimation of time‐dependent area under the ROC curve for long‐term risk prediction , 2006, Statistics in medicine.

[8]  P. Royston,et al.  The use of restricted mean survival time to estimate the treatment effect in randomized clinical trials when the proportional hazards assumption is in doubt , 2011, Statistics in medicine.

[9]  M. Pencina,et al.  On the C‐statistics for evaluating overall adequacy of risk prediction procedures with censored survival data , 2011, Statistics in medicine.

[10]  Daniel B. Mark,et al.  TUTORIAL IN BIOSTATISTICS MULTIVARIABLE PROGNOSTIC MODELS: ISSUES IN DEVELOPING MODELS, EVALUATING ASSUMPTIONS AND ADEQUACY, AND MEASURING AND REDUCING ERRORS , 1996 .

[11]  F. Harrell,et al.  Evaluating the yield of medical tests. , 1982, JAMA.

[12]  Jean-François Dartigues,et al.  Review and comparison of ROC curve estimators for a time-dependent outcome with marker-dependent censoring. , 2013, Biometrical journal. Biometrische Zeitschrift.

[13]  P. Heagerty,et al.  Time‐Dependent Predictive Accuracy in the Presence of Competing Risks , 2010, Biometrics.

[14]  M. Gonen,et al.  Concordance probability and discriminatory power in proportional hazards regression , 2005 .

[15]  Margaret Sullivan Pepe,et al.  The sensitivity and specificity of markers for event times. , 2005, Biostatistics.

[16]  Gary Longton,et al.  Incorporating the Time Dimension in Receiver Operating Characteristic Curves: A Case Study of Prostate Cancer , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  F. Harrell,et al.  Prognostic/Clinical Prediction Models: Multivariable Prognostic Models: Issues in Developing Models, Evaluating Assumptions and Adequacy, and Measuring and Reducing Errors , 2005 .

[18]  Elia Biganzoli,et al.  A time‐dependent discrimination index for survival data , 2005, Statistics in medicine.

[19]  Kathleen F. Kerr,et al.  Testing for improvement in prediction model performance , 2013, Statistics in medicine.

[20]  N. Obuchowski,et al.  Assessing the Performance of Prediction Models: A Framework for Traditional and Novel Measures , 2010, Epidemiology.

[21]  Tianxi Cai,et al.  Evaluating Prediction Rules for t-Year Survivors With Censored Regression Models , 2007 .

[22]  Paul Blanche,et al.  Time-dependent AUC with right-censored data:a survey. In: Risk Assessment and Evaluation of Predictions , 2012, 1210.6805.

[23]  Chin-Tsang Chiang,et al.  Estimation methods for time‐dependent AUC models with survival data , 2009 .

[24]  Vivian Viallon,et al.  Discrimination measures for survival outcomes: Connection between the AUC and the predictiveness curve , 2011, Biometrical journal. Biometrische Zeitschrift.

[25]  Richard D. Gelber,et al.  A quality-of-life-oriented endpoint for comparing therapies. , 1989 .

[26]  V. Vilgrain,et al.  Ultrasonographic surveillance of hepatocellular carcinoma in cirrhosis: A randomized trial comparing 3‐ and 6‐month periodicities , 2011, Hepatology.

[27]  C. Begg,et al.  One statistical test is sufficient for assessing new predictive markers , 2011, BMC Medical Research Methodology.

[28]  Yingye Zheng,et al.  Prospective Accuracy for Longitudinal Markers , 2007, Biometrics.

[29]  T. Lumley,et al.  Time‐Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker , 2000, Biometrics.

[30]  P. Heagerty,et al.  Survival Model Predictive Accuracy and ROC Curves , 2005, Biometrics.

[31]  Tianxi Cai,et al.  Application of the Time‐Dependent ROC Curves for Prognostic Accuracy with Multiple Biomarkers , 2006, Biometrics.

[32]  R. Gelber,et al.  A quality-of-life-oriented endpoint for comparing therapies. , 1989, Biometrics.