Diagnostic tests: A statistical review

Common measures of the accuracy of diagnostic tests are reviewed. It is shown that the actual performance (predictive value) of these tests depends not only on their sensitivity and specificity, but also on the prevalence of the disease in the population tested (Bayes' theorem). The effect of an inaccurate “gold standard” on the calibration of a new diagnostic test is discussed. Receiver operating characteristic (ROC) curves are introduced as a tool for selecting an optimal cutpoint for a test, and for comparing different tests. Schemes are given for combining tests to improve their accuracy. When multiple continuous measurements are available, methods of discriminant analysis (and logistic regression) are shown to provide measurement combinations with improved accuracy. Examples and key references are provided. © 1994 John Wiley & Sons, Inc.

[1]  S. Drance,et al.  Sensitivity and specificity of a diagnostic test determined by repeated observations in the absence of an external standard. , 1991, Journal of clinical epidemiology.

[2]  W. Grove.  Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[3]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[4]  C. Metz.  Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[5]  J J Gart,et al.  Comparison of a screening test and a reference test in epidemiologic studies. I. Indices of agreement and their relation to prevalence. , 1966, American journal of epidemiology.

[6]  M Staquet,et al.  Methodology for the assessment of new dichotomous diagnostic tests. , 1981, Journal of chronic diseases.

[7]  J. Gart,et al.  Comparison of a screening test and a reference test in epidemiologic studies. II. A probabilistic model for the comparison of diagnostic tests. , 1966, American journal of epidemiology.

[8]  J. Yerushalmy.  Statistical problems in assessing methods of medical diagnosis, with special reference to X-ray techniques. , 1947, Public health reports.

[9]  David W. Hosmer,et al.  Applied Logistic Regression , 1991 .

[10]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[11]  D. Bamber.  The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .