The conditional relative odds ratio provided less biased results for comparing diagnostic test accuracy in meta-analyses.

OBJECTIVE Meta-analytic techniques are used to combine the results of different studies that have evaluated the accuracy of a given diagnostic test. The techniques commonly generate values that either describe the performance of a particular test or compare the discriminative ability of two tests. The later has received very little attention in the literature, and is the focus of this article. STUDY DESIGN AND SETTING We summarize existing methods based on an odds ratio (OR) and propose a novel technique for conducting such analysis, the conditional relative odds ratio (CROR). We demonstrate how to extract the required data and calculate several different comparative indexes using a hypothetic example. RESULTS A paired analysis is preferred to decrease selection bias and increase statistical power. There is no standard method of obtaining the standard error (SE) of each relative OR; thus, the SE of the summary index might be underestimated under the assumption of no within-study variability. CONCLUSION The CROR method estimates less biased indexes with SEs, and conditioned on discordant results, it is much less problematic ethically and economically. However, small cell counts may lead to larger SEs, and it might be impossible to construct McNemar's 2 x 2 tables for some studies.

[1]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[2]  J. Whitfield,et al.  Should We Use Carbohydrate-deficient Transferrin instead of γ-Glutamyltransferase for Detecting Problem Drinkers? A Systematic Review and Metaanalysis , 2000 .

[3]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[4]  W. Haenszel,et al.  Statistical aspects of the analysis of data from retrospective studies of disease. , 1959, Journal of the National Cancer Institute.

[5]  Milos Jenicek,et al.  Epidemiology : The logic of modern medicine , 1995 .

[6]  R L Wahl,et al.  Metastases from non-small cell lung cancer: mediastinal staging in the 1990s--meta-analytic comparison of PET and CT. , 1999, Radiology.

[7]  D. McClish,et al.  Combining and Comparing Area Estimates across Studies or Strata , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  R. Peto,et al.  Beta blockade during and after myocardial infarction: an overview of the randomized trials. , 1985, Progress in cardiovascular diseases.

[9]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[10]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[11]  G. Guyatt,et al.  The Science of Reviewing Research a , 1993, Annals of the New York Academy of Sciences.

[12]  J. Fleiss,et al.  Meta-analysis in epidemiology, with special reference to studies of the association between exposure to environmental tobacco smoke and lung cancer: a critique. , 1991, Journal of clinical epidemiology.

[13]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[14]  K Y Liang,et al.  Longitudinal data analysis for discrete and continuous outcomes. , 1986, Biometrics.

[15]  C. Begg,et al.  Publication bias and dissemination of clinical research. , 1989, Journal of the National Cancer Institute.

[16]  F. Buntinx,et al.  Meta-analysis of ROC Curves , 2000, Medical decision making : an international journal of the Society for Medical Decision Making.

[17]  S. Sheps,et al.  The assessment of diagnostic tests , 1988, Journal of general internal medicine.

[18]  C. Beam,et al.  Status of clinical MR evaluations 1985-1988: baseline and design for further assessments. , 1991, Radiology.

[19]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[20]  William R. Shadish,et al.  Combining estimates of effect size. , 1994 .

[21]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[22]  S. Hallan,et al.  The accuracy of C-reactive protein in diagnosing acute appendicitis--a meta-analysis. , 1997, Scandinavian journal of clinical and laboratory investigation.

[23]  S. Sheps,et al.  The assessment of diagnostic tests. A survey of current medical research. , 1984, JAMA.

[24]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[25]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[26]  Chandler Stolp,et al.  Summing Up: The Science of Reviewing Research , 1984 .

[27]  E. Vamvakas,et al.  Meta-analyses of studies of the diagnostic accuracy of laboratory tests: a review of the concepts and methods. , 1998, Archives of pathology & laboratory medicine.

[28]  D. E. Shapiro,et al.  Issues in combining independent estimates of the sensitivity and specificity of a diagnostic test. , 1995, Academic radiology.

[29]  J. Kardaun,et al.  Comparative Diagnostic Performance of Three Radiological Procedures for the Detection of Lumbar Disk Herniation , 1990, Methods of Information in Medicine.

[30]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[31]  C B Begg,et al.  Biases in the assessment of diagnostic tests. , 1987, Statistics in medicine.