A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations

An important quality of meta-analytic models for research synthesis is their ability to account for both within- and between-study variability. Currently available meta-analytic approaches for studies of diagnostic test accuracy work primarily within a fixed-effects framework. In this paper we describe a hierarchical regression model for meta-analysis of studies reporting estimates of test sensitivity and specificity. The model allows more between- and within-study variability than fixed-effect approaches, by allowing both test stringency and test accuracy to vary across studies. It is also possible to examine the effects of study specific covariates. Estimates are computed using Markov Chain Monte Carlo simulation with publicly available software (BUGS). This estimation method allows flexibility in the choice of summary statistics. We demonstrate the advantages of this modelling approach using a recently published meta-analysis comparing three tests used to detect nodal metastasis of cervical cancer.

[1]  E. Boyko,et al.  Ruling Out or Ruling In Disease with the Most sensitiue or Specific Diagnostic Test , 1994, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[3]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[4]  Philip Heidelberger,et al.  Simulation Run Length Control in the Presence of an Initial Transient , 1983, Oper. Res..

[5]  J. Polak,et al.  Summary receiver operating characteristic curves as a technique for meta-analysis of the diagnostic performance of duplex ultrasonography in peripheral arterial disease. , 1996, Academic radiology.

[6]  S D Walter,et al.  Meta-analysis of diagnostic tests with imperfect reference standards. , 1999, Journal of clinical epidemiology.

[7]  R. Hambleton,et al.  Item Response Theory , 1984, The History of Educational Measurement.

[8]  K. Holcomb,et al.  The impact of pretreatment staging laparotomy on survival in locally advanced cervical carcinoma. , 1999, European journal of gynaecological oncology.

[9]  B. Goff,et al.  Impact of surgical staging in women with locally advanced cervical cancer. , 1999, Gynecologic oncology.

[10]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[11]  Frederick Mosteller,et al.  A Survey of Current Problems in Meta‐Analysis: Discussion from the Agency for Health Care Policy and Research Inter‐PORT Work Group on Literature Review/Meta‐Analysis , 1995, Medical care.

[12]  M. Tanner,et al.  Facilitating the Gibbs Sampler: The Gibbs Stopper and the Griddy-Gibbs Sampler , 1992 .

[13]  M R Segal,et al.  Radiological evaluation of lymph node metastases in patients with cervical cancer. A meta-analysis. , 1997, JAMA.

[14]  L. Hedges,et al.  Meta-analysis of screening and diagnostic tests. , 1995, Psychological bulletin.

[15]  J. Hanley.  Receiver operating characteristic (ROC) methodology: the state of the art. , 1989, Critical reviews in diagnostic imaging.

[16]  L. Delclos,et al.  Early stage I adenocarcinoma of the uterine cervix: Treatment results in patients with tumors ≤4 cm in diameter , 1991 .

[17]  A H Russell,et al.  Diagnostic assessments in patients with invasive cancer of the cervix: a national patterns of care study of the American College of Surgeons. , 1996, Gynecologic oncology.

[18]  B. Sevin,et al.  Prospective surgical-pathological study of disease-free interval in patients with stage IB squamous cell carcinoma of the cervix: a Gynecologic Oncology Group study. , 1990, Gynecologic oncology.

[19]  C B Begg,et al.  A General Regression Methodology for ROC Curve Estimation , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[20]  P J Eifel,et al.  Pelvic radiation with concurrent chemotherapy compared with pelvic and para-aortic radiation for high-risk cervical cancer. , 1999, The New England journal of medicine.

[21]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[22]  V. Abeler,et al.  Tumor size, depth of invasion, and grading of the invasive tumor front are the main prognostic factors in early squamous cell cervical carcinoma. , 1999, Gynecologic oncology.

[23]  J. Kardaun,et al.  Comparative Diagnostic Performance of Three Radiological Procedures for the Detection of Lumbar Disk Herniation , 1990, Methods of Information in Medicine.

[24]  P. McCullagh.  Regression Models for Ordinal Data , 1980 .

[25]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[26]  Yinsheng Qu,et al.  A Model for Evaluating Sensitivity and Specificity for Correlated Diagnostic Tests in Efficacy Studies with an Imperfect Reference Test , 1998 .

[27]  S L Normand,et al.  Meta-analysis: formulating, evaluating, combining, and reporting. , 1999, Statistics in medicine.

[28]  L. Joseph,et al.  Inferences for Likelihood Ratios in the Absence of a "Gold Standard" , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[29]  A. Toledano,et al.  Ordinal regression methodology for ROC curves derived from correlated data. , 1996, Statistics in medicine.