Efficient confidence bounds for ROC curves.

The specificity and sensitivity of a quantitative diagnostic marker depends on the selected cut-off point. The ROC curve is generated by plotting sensitivity against specificity as the cut-off point runs through the whole range of possible marker values. Confidence bounds for ROC curves may be constructed by combining two separate confidence intervals for sensitivity and specificity. In the present paper, a more efficient method, which is based on a statistical test introduced by Greenhouse and Mantel, is presented. The resulting 95 per cent confidence intervals are up to 40 per cent smaller. A formula is given to calculate the sample size necessary to obtain a confidence interval of a stipulated length at a specified point of the ROC curve. As an example, the performance of a tumour marker in the diagnosis of bone marrow metastases is investigated.

[1]  R. Holle,et al.  Cisplatin/etoposide versus ifosfamide/etoposide combination chemotherapy in small-cell lung cancer: a multicenter German randomized trial. , 1987, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[2]  C. Begg,et al.  Advances in statistical methodology for diagnostic medicine in the 1980's. , 1991, Statistics in medicine.

[3]  John A. Swets,et al.  Evaluation of diagnostic systems : methods from signal detection theory , 1982 .

[4]  K Linnet,et al.  Comparison of quantitative diagnostic tests: type I error, power, and sample size. , 1987, Statistics in medicine.

[5]  R. Hilgers Distribution-Free Confidence Bounds for ROC Curves , 1991, Methods of Information in Medicine.

[6]  David W. Scott,et al.  Frequency Polygons: Theory and Application , 1985 .

[7]  H. Schäfer,et al.  Constructing a cut-off point for a quantitative diagnostic test. , 1989, Statistics in medicine.

[8]  S. Greenhouse,et al.  The evaluation of diagnostic tests. , 1950, Biometrics.

[9]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[10]  K. Linnet,et al.  A review on the methodology for assessing diagnostic tests. , 1988, Clinical chemistry.

[11]  E. S. Pearson,et al.  THE USE OF CONFIDENCE OR FIDUCIAL LIMITS ILLUSTRATED IN THE CASE OF THE BINOMIAL , 1934 .

[12]  R. Holle,et al.  Alternating versus sequential chemotherapy in small cell lung cancer. A randomized german multicenter trial , 1987, Cancer.

[13]  Lee B. Lusted,et al.  Introduction to medical decision making , 1968 .