Bivariate Random Effects Meta-Analysis of Diagnostic Studies Using Generalized Linear Mixed Models

Bivariate random effect models are currently one of the main methods recommended to synthesize diagnostic test accuracy studies. However, only the logit transformation on sensitivity and specificity has been previously considered in the literature. In this article, the authors consider a bivariate generalized linear mixed model to jointly model the sensitivities and specificities, and they discuss the estimation of the summary receiver operating characteristic curve (ROC) and the area under the ROC curve (AUC). As the special cases of this model, the authors discuss the commonly used logit, probit, and complementary log-log transformations. To evaluate the impact of misspecification of the link functions on the estimation, they present 2 case studies and a set of simulation studies. Their study suggests that point estimation of the median sensitivity and specificity and AUC is relatively robust to the misspecification of the link functions. However, the misspecification of link functions has a noticeable impact on the standard error estimation and the 95% confidence interval coverage, which emphasizes the importance of choosing an appropriate link function to make statistical inference.

[1]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[2]  Petra Macaskill,et al.  Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. , 2004, Journal of clinical epidemiology.

[3]  D. Bates,et al.  Approximations to the Log-Likelihood Function in the Nonlinear Mixed-Effects Model , 1995 .

[4]  M. Pittler Systematic Reviews in Health Care: Meta‐analysis in Context , 2010 .

[5]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[6]  Haitao Chu,et al.  Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. , 2006, Journal of clinical epidemiology.

[7]  J. C. Houwelingen,et al.  Bivariate Random Effects Meta-Analysis of ROC Curves , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  Nicola J Cooper,et al.  Integration of Meta-analysis and Economic Decision Modeling for Evaluating Diagnostic Tests , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[9]  Thomas A Louis,et al.  Random Effects Models in a Meta-Analysis of the Accuracy of Two Diagnostic Tests Without a Gold Standard , 2009, Journal of the American Statistical Association.

[10]  D K Owens,et al.  Accuracy of positron emission tomography for diagnosis of pulmonary nodules and mass lesions: a meta-analysis. , 2001, JAMA.

[11]  S D Walter,et al.  The partial area under the summary ROC curve , 2005, Statistics in medicine.

[12]  Patrick Royston,et al.  The design of simulation studies in medical statistics , 2006, Statistics in medicine.

[13]  S D Walter,et al.  Meta-analysis of diagnostic tests with imperfect reference standards. , 1999, Journal of clinical epidemiology.

[14]  Douglas G. Altman,et al.  Systematic Reviews in Health Care , 2001 .

[15]  J. Fine,et al.  Meta-Analysis: Methods for Diagnosing Intravascular DeviceRelated Bloodstream Infection , 2005, Annals of Internal Medicine.

[16]  Haitao Chu,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2009, Biostatistics.

[17]  Alex J Sutton,et al.  Asymmetric funnel plots and publication bias in meta-analyses of diagnostic accuracy. , 2002, International journal of epidemiology.

[18]  Richard D Riley,et al.  An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown. , 2008, Biostatistics.

[19]  Theo Stijnen,et al.  The binomial distribution of meta-analysis was preferred to model within-study variability. , 2008, Journal of clinical epidemiology.

[20]  Richard D Riley,et al.  Beyond the Bench: Hunting Down Fugitive Literature , 2004, Environmental Health Perspectives.

[21]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[22]  S. Walter,et al.  Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data , 2002, Statistics in medicine.

[23]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[24]  Steve Halligan,et al.  Systematic reviews of diagnostic tests in cancer: review of methods and reporting , 2006, BMJ : British Medical Journal.

[25]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[26]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[27]  Patrick M Bossuyt,et al.  We should not pool diagnostic likelihood ratios in systematic reviews , 2008, Statistics in medicine.

[28]  Haitao Chu,et al.  Meta‐analysis of diagnostic accuracy studies accounting for disease prevalence: Alternative parameterizations and model selection , 2009, Statistics in medicine.