A Parametric Roc Model Based Approach for Evaluating the Predictiveness of Continuous Markers in Case-control Studies Suggested Citation

The predictiveness curve shows the population distribution of risk endowed by a marker or risk prediction model. It provides a means for assessing the model's capacity for stratifying the population according to risk. Methods for making inference about the predictiveness curve have been developed using cross-sectional or cohort data. Here we consider inference based on case-control studies, which are far more common in practice. We investigate the relationship between the ROC curve and the predictiveness curve. Insights about their relationship provide alternative ROC interpretations for the predictiveness curve and for a previously proposed summary index of it. Next the relationship motivates ROC based methods for estimating the predictiveness curve. An important advantage of these methods over previously proposed methods is that they are rank invariant. In addition they provide a way of combining information across populations that have similar ROC curves but varying prevalence of the outcome. We apply the methods to prostate-specific antigen (PSA), a marker for predicting risk of prostate cancer.

[1]  Ziding Feng,et al.  Evaluating the Predictiveness of a Continuous Marker , 2007, Biometrics.

[2]  N. Obuchowski.  Receiver operating characteristic curves and their use in radiology. , 2003, Radiology.

[3]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[4]  B. Reiser,et al.  Estimation of the Youden Index and its Associated Cutoff Point , 2005, Biometrical journal. Biometrische Zeitschrift.

[5]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[6]  W. England,et al.  An Exponential Model Used for optimal Threshold selection on ROC Curues , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[7]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[8]  M. Pencina,et al.  Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyond , 2008, Statistics in medicine.

[9]  Lori E. Dodd,et al.  Semiparametric Regression for the Area Under the Receiver Operating Characteristic Curve , 2003 .

[10]  D. McClish.  Analyzing a Portion of the ROC Curve , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  Margaret Sullivan Pepe,et al.  Distribution-free ROC analysis using binary regression techniques. , 2002, Biostatistics.

[12]  B. Turnbull,et al.  NONPARAMETRIC AND SEMIPARAMETRIC ESTIMATION OF THE RECEIVER OPERATING CHARACTERISTIC CURVE , 1996 .

[13]  T. Cai,et al.  Semi-parametric estimation of the binormal ROC curve for a continuous diagnostic test. , 2004, Biostatistics.

[14]  Holly Janes,et al.  Matching in Studies of Classification Accuracy: Implications for Analysis, Efficiency, and Assessment of Incremental Value , 2008, Biometrics.

[15]  Sudhir Srivastava,et al.  Markers for early detection of cancer: Statistical guidelines for nested case-control studies , 2002, BMC medical research methodology.

[16]  B. Reiser,et al.  Estimation of the area under the ROC curve , 2002, Statistics in medicine.

[17]  S. Greenhouse,et al.  The evaluation of diagnostic tests. , 1950, Biometrics.

[18]  Giovanni Parmigiani,et al.  Semiparametric regression for count data , 2002 .

[19]  K. Berbaum,et al.  Proper receiver operating characteristic analysis: the bigamma model. , 1997, Academic radiology.

[20]  Margaret Sullivan Pepe,et al.  Semiparametric methods for evaluating risk prediction markers in case-control studies. , 2009, Biometrika.

[21]  J. Hanley.  The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[22]  Margaret Sullivan Pepe,et al.  Biomarker evaluation and comparison using the controls as a reference population. , 2009, Biostatistics.

[23]  Margaret Sullivan Pepe,et al.  The Analysis of Placement Values for Evaluating Discriminatory Measures , 2004, Biometrics.

[24]  Margaret S. Pepe,et al.  Biomarker Evaluation Using the Controls as a Reference Population , 2007 .

[25]  Yingye Zheng,et al.  Integrating the predictiveness of a marker with its performance as a classifier. , 2007, American journal of epidemiology.

[26]  Ziding Feng,et al.  Assessing prostate cancer risk: results from the Prostate Cancer Prevention Trial. , 2006, Journal of the National Cancer Institute.

[27]  H. D. Brunk,et al.  Statistical inference under order restrictions : the theory and application of isotonic regression , 1973 .

[28]  Joseph L. Gastwirth,et al.  The binary regression quantile plot : Assessing the importance of predictors in binary regression visually , 2001 .

[29]  Ying Huang,et al.  Semiparametric and nonparametric methods for evaluating risk prediction markers in case-control studies , 2008 .

[30]  M S Pepe,et al.  Semiparametric methods for evaluating the covariate‐specific predictiveness of continuous markers in matched case–control studies , 2010, Journal of the Royal Statistical Society. Series C, Applied statistics.

[31]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[32]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[33]  Holly Janes,et al.  Pivotal Evaluation of the Accuracy of a Biomarker Used for Classification or Prediction: Standards for Study Design , 2008, Journal of the National Cancer Institute.

[34]  Margaret Sullivan Pepe,et al.  Combining Several Screening Tests: Optimality of the Risk Score , 2002, Biometrics.

[35]  George R. Bergus,et al.  Medical Decision Making: Medical Decision Making , 2008 .

[36]  Holly Janes,et al.  Adjusting for covariate effects on classification accuracy using the covariate-adjusted receiver operating characteristic curve. , 2009, Biometrika.

[37]  K. Zou,et al.  Two transformation models for estimating an ROC curve derived from continuous data , 2000 .

[38]  Mitchell H Gail,et al.  On criteria for evaluating models of absolute risk. , 2005, Biostatistics.

[39]  Holly Janes,et al.  Practice of Epidemiology Adjusting for Covariates in Studies of Diagnostic, Screening, or Prognostic Markers: an Old Concept in a New Setting , 2022 .

[40]  C. Metz,et al.  "Proper" Binormal ROC Curves: Theory and Maximum-Likelihood Estimation. , 1999, Journal of mathematical psychology.

[41]  Gregory Campbell,et al.  An application of lomax distributions in receiver operating characteristic(roc)curve analysis , 1993 .

[42]  M S Pepe,et al.  Phases of biomarker development for early detection of cancer. , 2001, Journal of the National Cancer Institute.

[43]  K. Lomax.  Business Failures: Another Example of the Analysis of Failure Data , 1954 .

[44]  D. Dorfman,et al.  Maximum-likelihood estimation of parameters of signal-detection theory and determination of confidence intervals—Rating-method data , 1969 .

[45]  C. Metz,et al.  A receiver operating characteristic partial area index for highly sensitive diagnostic tests. , 1996, Radiology.

[46]  N. Cook.  Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[47]  M. Pepe.  An Interpretation for the ROC Curve and Inference Using GLM Procedures , 2000, Biometrics.

[48]  W Zucchini,et al.  On the statistical analysis of ROC curves. , 1989, Statistics in medicine.

[49]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[50]  Mitchell H. Gail,et al.  A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data , 1989 .