Three approaches to regression analysis of receiver operating characteristic curves for continuous test results.

The accuracy of a medical diagnostic test is typically summarized by the sensitivity and specificity when the test result is dichotomous. Receiver operating characteristic (ROC) curves are measures of test accuracy that are used when test results are continuous and are considered the analogs of sensitivity and specificity for continuous tests. ROC regression analysis allows one to evaluate effects of factors that may influence test accuracy. Such factors might include characteristics of study subjects or operating conditions for the test. Unfortunately, regression analysis methods for ROC curves are not well developed and methods that do exist have received little use to date. In this paper, we propose and compare three very different regression analysis methods. Two are modifications of methods previously proposed for radiology settings. The third is a special case of a general method recently proposed by us. The three approaches are compared with regard to settings in which they can be applied and distributional assumptions they require. In the setting where test results are normally distributed, we elucidate the correspondence between regression parameters in the different models. The methods are applied to simulated data and to data from a study of a new diagnostic test for hearing impairment. It is hoped that the presentation in this paper will both encourage the use of regression analysis for evaluating diagnostic tests and help guide the choice of the most appropriate regression analysis approach in applications.

[1]  Thomas R. Fleming,et al.  Model misspecification in proportional hazards regression , 1995 .

[2]  J. Swets Sensitivities and specificities of diagnostic tests. , 1982, JAMA.

[3]  M P Gorga,et al.  Toward optimizing the clinical utility of distortion product otoacoustic emission measurements. , 1996, The Journal of the Acoustical Society of America.

[4]  W Leisenring,et al.  A marginal regression modelling framework for evaluating medical diagnostic tests. , 1997, Statistics in medicine.

[5]  D. McClish Analyzing a Portion of the ROC Curve , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  N A Obuchowski,et al.  Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. , 1995, Academic radiology.

[7]  M. Gail,et al.  Biased estimates of treatment effect in randomized experiments with nonlinear regressions and omitted covariates , 1984 .

[8]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[9]  J. Hanley Receiver operating characteristic (ROC) methodology: the state of the art. , 1989, Critical reviews in diagnostic imaging.

[10]  W Zucchini,et al.  On the statistical analysis of ROC curves. , 1989, Statistics in medicine.

[11]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[12]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[13]  W Jesteadt,et al.  A comparison of transient-evoked and distortion product otoacoustic emissions in normal-hearing and hearing-impaired subjects. , 1993, The Journal of the Acoustical Society of America.

[14]  John A. Swets,et al.  Evaluation of diagnostic systems : methods from signal detection theory , 1982 .