Quantifying the Predictive Performance of Prognostic Models for Censored Survival Data with Time‐Dependent Covariates

Prognostic models in survival analysis typically aim to describe the association between patient covariates and future outcomes. More recently, efforts have been made to include covariate information that is updated over time. However, there exists as yet no standard approach to assess the predictive accuracy of such updated predictions. In this article, proposals from the literature are discussed and a conditional loss function approach is suggested, illustrated by a publicly available data set.

[1]  L. J. Savage Elicitation of Personal Probabilities and Expectations , 1971 .

[2]  R Simon,et al.  Measures of explained variation for survival data. , 1990, Statistics in medicine.

[3]  Margaret Sullivan Pepe,et al.  The sensitivity and specificity of markers for event times. , 2005, Biostatistics.

[4]  B. Efron How Biased is the Apparent Error Rate of a Prediction Rule , 1986 .

[5]  Elizabeth R DeLong,et al.  ROC methodology within a monitoring framework , 2003, Statistics in medicine.

[6]  Explained Variation Measures in Survival Analysis , 2005 .

[7]  P. Grambsch,et al.  Primary biliary cirrhosis: Prediction of short‐term survival based on repeated patient visits , 1994, Hepatology.

[8]  Yan Wang,et al.  Jointly Modeling Longitudinal and Event Time Data With Application to Acquired Immunodeficiency Syndrome , 2001 .

[9]  E. DeLong,et al.  Sensitivity and specificity of a monitoring test. , 1985, Biometrics.

[10]  T. Lumley,et al.  Time‐Dependent ROC Curves for Censored Survival Data and a Diagnostic Marker , 2000, Biometrics.

[11]  Robin Henderson,et al.  Identification and efficacy of longitudinal markers for survival. , 2002, Biostatistics.

[12]  J R Anderson,et al.  Analysis of survival by tumor response. , 1983, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[13]  Francis Cantraine,et al.  Use of the Sequential Organ Failure Assessment score as a severity score , 2005, Intensive Care Medicine.

[14]  M. Schumacher,et al.  Consistent Estimation of the Expected Brier Score in General Survival Models with Right‐Censored Event Times , 2006, Biometrical journal. Biometrische Zeitschrift.

[15]  M. Schemper,et al.  Predictive Accuracy and Explained Variation in Cox Regression , 2000, Biometrics.

[16]  A. Tsiatis,et al.  Nonparametric survival estimation using prognostic longitudinal covariates. , 1996, Biometrics.

[17]  P. Grambsch,et al.  Prognosis in primary biliary cirrhosis: Model for decision making , 1989, Hepatology.

[18]  Yudi Pawitan,et al.  Modeling Disease Marker Processes in AIDS , 1993 .

[19]  E Graf,et al.  Assessment and comparison of prognostic classification schemes for survival data. , 1999, Statistics in medicine.

[20]  M H Gail,et al.  Evaluating serial cancer marker studies in patients at risk of recurrent disease. , 1981, Biometrics.

[21]  P. Heagerty,et al.  Survival Model Predictive Accuracy and ROC Curves , 2005, Biometrics.

[22]  M Jones,et al.  Accuracy of point predictions in survival analysis , 2001, Statistics in medicine.

[23]  Gary Longton,et al.  Incorporating the Time Dimension in Receiver Operating Characteristic Curves: A Case Study of Prostate Cancer , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[24]  S. Ringer,et al.  Quantifying uncertainty: physicians' estimates of infection in critically ill neonates and children. , 2004, Clinical Infectious Diseases.

[25]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[26]  D. Pauler,et al.  Predicting time to prostate cancer recurrence based on joint models for non‐linear longitudinal biomarkers and event time outcomes , 2002, Statistics in medicine.

[27]  Chaya S Moskowitz,et al.  Quantifying and comparing the accuracy of binary biomarkers when predicting a failure time outcome. , 2004, Statistics in medicine.

[28]  Yingye Zheng,et al.  Semiparametric estimation of time-dependent ROC curves for longitudinal marker data. , 2004, Biostatistics.

[29]  Yingye Zheng,et al.  Partly Conditional Survival Models for Longitudinal Data , 2005, Biometrics.

[30]  D. Cox Regression Models and Life-Tables , 1972 .

[31]  Gillian Bartlett,et al.  Updated risk factor values and the ability of the multivariable risk score to predict coronary heart disease. , 2004, American journal of epidemiology.

[32]  M. Wulfsohn,et al.  Modeling the Relationship of Survival to Longitudinal Data Measured with Error. Applications to Survival and CD4 Counts in Patients with AIDS , 1995 .

[33]  D. Kuban,et al.  PSA nadir predicts biochemical and distant failures after external beam radiotherapy for prostate cancer: a multi-institutional analysis. , 2004, International journal of radiation oncology, biology, physics.