A multilevel model framework for meta-analysis of clinical trials with binary outcomes.

In this paper we explore the potential of multilevel models for meta-analysis of trials with binary outcomes for both summary data, such as log-odds ratios, and individual patient data. Conventional fixed effect and random effects models are put into a multilevel model framework, which provides maximum likelihood or restricted maximum likelihood estimation. To exemplify the methods, we use the results from 22 trials to prevent respiratory tract infections; we also make comparisons with a second example data set comprising fewer trials. Within summary data methods, confidence intervals for the overall treatment effect and for the between-trial variance may be derived from likelihood based methods or a parametric bootstrap as well as from Wald methods; the bootstrap intervals are preferred because they relax the assumptions required by the other two methods. When modelling individual patient data, a bias corrected bootstrap may be used to provide unbiased estimation and correctly located confidence intervals; this method is particularly valuable for the between-trial variance. The trial effects may be modelled as either fixed or random within individual data models, and we discuss the corresponding assumptions and implications. If random trial effects are used, the covariance between these and the random treatment effects should be included; the resulting model is equivalent to a bivariate approach to meta-analysis. Having implemented these techniques, the flexibility of multilevel modelling may be exploited in facilitating extensions to standard meta-analysis methods.

[1]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[2]  D. Clayton,et al.  Statistical Models in Epidemiology , 1993 .

[3]  Harvey Goldstein Consistent estimators for multilevel generalised linear models using an iterated bootstrap , 1998 .

[4]  Harvey Goldstein,et al.  Improved Approximations for Multilevel Models with Binary Responses , 1996 .

[5]  H C Van Houwelingen,et al.  A bivariate approach to meta-analysis. , 1993, Statistics in medicine.

[6]  N Breslow,et al.  Approximate hierarchical modelling of discrete data in epidemiology , 1998, Statistical methods in medical research.

[7]  C S Berkey,et al.  A random-effects regression model for meta-analysis. , 1995, Statistics in medicine.

[8]  S G Thompson,et al.  Investigating underlying risk as a source of heterogeneity in meta-analysis. , 1997, Statistics in medicine.

[9]  H. Goldstein,et al.  Meta‐analysis using multilevel models with an application to the study of class size effects , 2000 .

[10]  M. Aitkin,et al.  Meta-analysis by random effect modelling in generalized linear models. , 1999, Statistics in medicine.

[11]  M. Parmar,et al.  Meta-analysis of the literature or of individual patient data: is there a difference? , 1993, The Lancet.

[12]  Sue J. Welham,et al.  Likelihood Ratio Tests for Fixed Model Terms using Residual Maximum Likelihood , 1997 .

[13]  Jack L. Vevea,et al.  A general linear model for estimating effect size in the presence of publication bias , 1995 .

[14]  A Whitehead,et al.  Borrowing strength from external trials in a meta-analysis. , 1996, Statistics in medicine.

[15]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[16]  A. Kuk Asymptotically Unbiased Estimation in Generalized Linear Models with Random Effects , 1995 .

[17]  Y. Ohashi,et al.  A Bayesian hierarchical survival model for the institutional effects in a multi-centre cancer clinical trial. , 1998, Statistics in medicine.

[18]  T. Lewis,et al.  Outliers in multilevel data , 1998 .

[19]  C. Morrell,et al.  Likelihood ratio testing of variance components in the linear mixed-effects model using restricted maximum likelihood. , 1998, Biometrics.

[20]  D O Stram,et al.  Meta-analysis of published data using a linear mixed-effects model. , 1996, Biometrics.

[21]  J. Carlin Meta-analysis for 2 x 2 tables: a Bayesian approach. , 1992, Statistics in medicine.

[22]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .

[23]  S. Thompson,et al.  Detecting and describing heterogeneity in meta-analysis. , 1998, Statistics in medicine.

[24]  S G Thompson,et al.  Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated , 1994, BMJ.

[25]  S G Thompson,et al.  A likelihood approach to meta-analysis with random effects. , 1996, Statistics in medicine.

[26]  N. Breslow,et al.  The analysis of case-control studies , 1980 .

[27]  Dk Pauler,et al.  Modeling and Implementation Issues in Bayesian Meta-Analysis , 2000 .

[28]  F Mosteller,et al.  Meta-analysis of multiple outcomes by regression with random effects. , 1998, Statistics in medicine.

[29]  Anthony C. Davison,et al.  Bootstrap Methods and Their Application , 1998 .

[30]  M. McIntosh,et al.  The population risk as an explanatory variable in research synthesis of clinical trials. , 1996, Statistics in medicine.

[31]  Noreen Goldman,et al.  An assessment of estimation procedures for multilevel models with binary responses , 1995 .

[32]  B J Biggerstaff,et al.  Incorporating variability in estimates of heterogeneity in the random effects model in meta-analysis. , 1997, Statistics in medicine.

[33]  S. Pocock,et al.  Can meta-analyses be trusted? , 1991, The Lancet.

[34]  S D Walter,et al.  Variation in baseline risk as an explanation of heterogeneity in meta-analysis. , 1997, Statistics in medicine.

[35]  S. Sharp,et al.  Explaining heterogeneity in meta-analysis: a comparison of methods. , 1999 .

[36]  J. Copas What works?: selectivity models and meta‐analysis , 1999 .

[37]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[38]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[39]  D. Cox,et al.  The analysis of binary data , 1971 .

[40]  D. Cox,et al.  Analysis of Survival Data. , 1986 .

[41]  R. Kempton,et al.  The application of REML in clinical trials. , 1994, Statistics in medicine.

[42]  H. Goldstein Multilevel Statistical Models , 2006 .

[43]  S. Thompson,et al.  Multi-level models for repeated measurement data: application to quality of life data in clinical trials. , 1996, Statistics in medicine.

[44]  S G Thompson,et al.  Controversies in meta-analysis: the case of the trials of serum cholesterol reduction , 1993, Statistical methods in medical research.

[45]  Kelvyn Jones Review of HLM 4 for Windows , 1996 .

[46]  H. Goldstein Nonlinear multilevel models, with an application to discrete response data , 1991 .

[47]  R. Little,et al.  A note about models for selectivity bias. , 1985 .

[48]  Harvey Goldstein,et al.  A user's guide to MLwiN, Version 1.0 , 1998 .