Regression Models for Convex ROC Curves

Summary. The performance of a diagnostic test is summarized by its receiver operating characteristic (ROC) curve. Under quite natural assumptions about the latent variable underlying the test, the ROC curve is convex. Empirical data on a test's performance often comes in the form of observed true positive and false positive relative frequencies under varying conditions. This paper describes a family of regression models for analyzing such data. The underlying ROC curves are specified by a quality parameter μ and a shape parameter Δ and are guaranteed to be convex provided Δ > 1. Both the position along the ROC curve and the quality parameter Δ are modeled linearly with covariates at the level of the individual. The shape parameter μ enters the model through the link functions log(pμ) ‐ log(1 ‐ pμ) of a binomial regression and is estimated either by search or from an appropriate constructed variate. One simple application is to the meta‐analysis of independent studies of the same diagnostic test, illustrated on some data of Moses, Shapiro, and Littenberg (1993). A second application, to so‐called vigilance data, is given, where ROC curves differ across subjects and modeling of the position along the ROC curve is of primary interest.

[1]  E. Lehmann Testing Statistical Hypotheses , 1960 .

[2]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[3]  D. Dorfman,et al.  Maximum likelihood estimation of parameters of signal detection theory—A direct solution , 1968, Psychometrika.

[4]  Jerome L. Myers,et al.  Implications of latency data for threshold and nonthreshold models of signal detection , 1972 .

[5]  P. M. E. Altham,et al.  A NON‐PARAMETRIC MEASURE OF SIGNAL DISCRIMINABILITY , 1973 .

[6]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[7]  D. Pregibon Goodness of Link Tests for Generalized Linear Models , 1980 .

[8]  C. Metz,et al.  Statistical significance tests for binormal ROC curves , 1980 .

[9]  D. A. Williams,et al.  Extra‐Binomial Variation in Logistic Linear Models , 1982 .

[10]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[11]  P Ducimetière,et al.  Comparison of receiver operating curves derived from the same population: a bootstrapping approach. , 1985, Computers and biomedical research, an international journal.

[12]  S. Inouye,et al.  Standard and computed tomography in the evaluation of neoplasms of the chest. A comparative efficacy assessment. , 1986, Annals of internal medicine.

[13]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  W. England,et al.  An Exponential Model Used for optimal Threshold selection on ROC Curues , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Mitchell H. Gail,et al.  A family of nonparametric statistics for comparing diagnostic markers with paired or unpaired data , 1989 .

[16]  Gregory Campbell,et al.  An application of lomax distributions in receiver operating characteristic(roc)curve analysis , 1993 .

[17]  D. Collett,et al.  Modelling Binary Data , 1991 .

[18]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[19]  C A Gatsonis,et al.  Regression methods for meta-analysis of diagnostic test data. , 1995, Academic radiology.

[20]  X H Zhou,et al.  A simple method for comparing correlated ROC curves using incomplete data. , 1996, Statistics in medicine.

[21]  A. Toledano,et al.  Ordinal regression methodology for ROC curves derived from correlated data. , 1996, Statistics in medicine.

[22]  K. Berbaum,et al.  Proper receiver operating characteristic analysis: the bigamma model. , 1997, Academic radiology.

[23]  W Leisenring,et al.  A marginal regression modelling framework for evaluating medical diagnostic tests. , 1997, Statistics in medicine.

[24]  C E Metz,et al.  The "proper" binormal model: parametric receiver operating characteristic curve estimation with degenerate data. , 1997, Academic radiology.

[25]  C A Roe,et al.  Statistical Comparison of Two ROC-curve Estimates Obtained from Partially-paired Datasets , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[26]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[27]  Chris Lloyd,et al.  Using Smoothed Receiver Operating Characteristic Curves to Summarize and Compare Diagnostic Systems , 1998 .

[28]  M S Pepe,et al.  Three approaches to regression analysis of receiver operating characteristic curves for continuous test results. , 1998, Biometrics.

[29]  C. Metz,et al.  "Proper" Binormal ROC Curves: Theory and Maximum-Likelihood Estimation. , 1999, Journal of mathematical psychology.

[30]  C. Lloyd,et al.  Theory & Methods: Choosing Sampling Effort for Recapture Experiments with Behavioural Response , 1999 .

[31]  Chris J. Lloyd Theory & Methods: Fitting Roc Curves Using Non‐linear Binomial Regression , 2000 .