Meta‐analysis of Diagnostic Test Accuracy Assessment Studies with Varying Number of Thresholds

Summary.  Current meta‐analytic methods for diagnostic test accuracy are generally applicable to a selection of studies reporting only estimates of sensitivity and specificity, or at most, to studies whose results are reported using an equal number of ordered categories. In this article, we propose a new meta‐analytic method to evaluate test accuracy and arrive at a summary receiver operating characteristic (ROC) curve for a collection of studies evaluating diagnostic tests, even when test results are reported in an unequal number of nonnested ordered categories. We discuss both non‐Bayesian and Bayesian formulations of the approach. In the Bayesian setting, we propose several ways to construct summary ROC curves and their credible bands. We illustrate our approach with data from a recently published meta‐analysis evaluating a single serum progesterone test for diagnosing pregnancy failure.

[1]  F. Buntinx,et al.  Meta-analysis of ROC Curves , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  P. McCullagh Regression Models for Ordinal Data , 1980 .

[3]  D. McClish Analyzing a Portion of the ROC Curve , 1989, Medical decision making : an international journal of the Society for Medical Decision Making.

[4]  Giovanni Parmigiani,et al.  Meta-Analysis of Migraine Headache Treatments: Combining Information from Heterogeneous Designs , 1999 .

[5]  D. Rennie,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative , 2003, BMJ : British Medical Journal.

[6]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[7]  Alan E. Gelfand,et al.  Model choice: A minimum posterior predictive loss approach , 1998, AISTATS.

[8]  A. Purdie Ectopic pregnancy. , 1963, The Practitioner.

[9]  Donald A. Berry,et al.  Meta-Analysis in Medicine and Health Policy , 2000 .

[10]  C A Gatsonis,et al.  Regression methods for meta-analysis of diagnostic test data. , 1995, Academic radiology.

[11]  C A Gatsonis,et al.  Random-effects models for diagnostic accuracy data. , 1995, Academic radiology.

[12]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[13]  K R Abrams,et al.  Bayesian Approaches to Meta-analysi of ROC Curves , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  John A. Swets,et al.  Evaluation of diagnostic systems : methods from signal detection theory , 1982 .

[15]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[16]  J. Peipert,et al.  Progesterone, Inhibin, and hCG Multiple Marker Strategy to Differentiate Viable From Nonviable Pregnancies , 2000, Obstetrics and gynecology.

[17]  H. Ishwaran,et al.  A general class of hierarchical ordinal regression models with applications to correlated roc analysis , 2000 .

[18]  E. Darai,et al.  Is maternal serum creatine kinase actually a marker for early diagnosis of ectopic pregnancy? , 1996, European journal of obstetrics, gynecology, and reproductive biology.

[19]  L. Hedges,et al.  Meta-analysis of screening and diagnostic tests. , 1995, Psychological bulletin.

[20]  J. Piatt,et al.  Receiver-operating characteristic curves. , 2001, Journal of neurosurgery.

[21]  K. Zou,et al.  Smooth non-parametric receiver operating characteristic (ROC) curves for continuous diagnostic tests. , 1997, Statistics in medicine.

[22]  I. Huhtaniemi,et al.  Early Pregnancy Failure: Study by Ultrasonic and Hormonal Methods , 1980, Obstetrics and gynecology.

[23]  Margaret S. Pepe,et al.  Receiver Operating Characteristic Methodology , 2000 .

[24]  F van der Veen,et al.  The accuracy of single serum progesterone measurement in the diagnosis of ectopic pregnancy: a meta-analysis. , 1998, Human reproduction.

[25]  G. Campbell,et al.  Advances in statistical methodology for the evaluation of diagnostic and laboratory tests. , 1994, Statistics in medicine.

[26]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[27]  A. Fitter,et al.  Molecular diversity of arbuscular mycorrhizal fungi colonising arable crops. , 2001, FEMS microbiology ecology.

[28]  M. Wells,et al.  Quantile Comparison Functions in Two-Sample Problems, with Application to Comparisons of Diagnostic Markers , 1996 .

[29]  R. Hilgers Distribution-Free Confidence Bounds for ROC Curves , 1991, Methods of Information in Medicine.

[30]  D. E. Shapiro,et al.  Issues in combining independent estimates of the sensitivity and specificity of a diagnostic test. , 1995, Academic radiology.

[31]  K. Amankwah,et al.  Hemolytic Anemia and Pyruvate Kinase Deficiency in Pregnancy , 1980, Obstetrics and gynecology.

[32]  W. Hall,et al.  Confidence Bands for Receiver Operating Characteristic Curves , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[33]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[34]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[35]  R. Hanka The Handbook of Research Synthesis , 1994 .

[36]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[37]  A Whitehead,et al.  Meta‐analysis of ordinal outcomes using individual patient data , 2001, Statistics in medicine.