Evaluating the Predictiveness of a Continuous Marker

Consider a continuous marker for predicting a binary outcome. For example, the serum concentration of prostate specific antigen may be used to calculate the risk of finding prostate cancer in a biopsy. In this article, we argue that the predictive capacity of a marker has to do with the population distribution of risk given the marker and suggest a graphical tool, the predictiveness curve, that displays this distribution. The display provides a common meaningful scale for comparing markers that may not be comparable on their original scales. Some existing measures of predictiveness are shown to be summary indices derived from the predictiveness curve. We develop methods for making inference about the predictiveness curve, for making pointwise comparisons between two curves, and for evaluating covariate effects. Applications to risk prediction markers in cancer and cystic fibrosis are discussed.

[1]  Ziding Feng,et al.  Assessing prostate cancer risk: results from the Prostate Cancer Prevention Trial. , 2006, Journal of the National Cancer Institute.

[2]  M S Pepe,et al.  Phases of biomarker development for early detection of cancer. , 2001, Journal of the National Cancer Institute.

[3]  P. van’t Veer,et al.  Dietary fat and the risk of breast cancer. , 1990, International journal of epidemiology.

[4]  B Vastag,et al.  Detection network gives early cancer tests a push. , 2000, Journal of the National Cancer Institute.

[5]  J. Copas The Effectiveness of Risk Scores: the Logit Rank Plot , 1999 .

[6]  Patrick J. Heagerty,et al.  Semiparametric estimation of regression quantiles with application to standardizing weight for height and age in US children , 1999 .

[7]  M Schemper,et al.  Explained variation for logistic regression. , 1996, Statistics in medicine.

[8]  A F Roche,et al.  NCHS growth curves for children birth-18 years. United States. , 1977, Vital and health statistics. Series 11, Data from the National Health Survey.

[9]  Chaya S Moskowitz,et al.  Quantifying and comparing the predictive accuracy of continuous prognostic factors for binary outcomes. , 2004, Biostatistics.

[10]  C. D. Kemp,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[11]  Joseph L. Gastwirth,et al.  The binary regression quantile plot : Assessing the importance of predictors in binary regression visually , 2001 .

[12]  T J Cole,et al.  Smoothing reference centile curves: the LMS method and penalized likelihood. , 1992, Statistics in medicine.

[13]  Mitchell H Gail,et al.  On criteria for evaluating models of absolute risk. , 2005, Biostatistics.

[14]  M. Lebowitz,et al.  Changes in the normal maximal expiratory flow-volume curve with growth and aging. , 1983, The American review of respiratory disease.

[15]  Alan R. Shapiro,et al.  The Evaluation of Clinical Predictions: A Method and Initial Application , 1977 .