Predictive distributions for between-study heterogeneity and simple methods for their application in Bayesian meta-analysis

Numerous meta-analyses in healthcare research combine results from only a small number of studies, for which the variance representing between-study heterogeneity is estimated imprecisely. A Bayesian approach to estimation allows external evidence on the expected magnitude of heterogeneity to be incorporated. The aim of this paper is to provide tools that improve the accessibility of Bayesian meta-analysis. We present two methods for implementing Bayesian meta-analysis, using numerical integration and importance sampling techniques. Based on 14 886 binary outcome meta-analyses in the Cochrane Database of Systematic Reviews, we derive a novel set of predictive distributions for the degree of heterogeneity expected in 80 settings depending on the outcomes assessed and comparisons made. These can be used as prior distributions for heterogeneity in future meta-analyses. The two methods are implemented in R, for which code is provided. Both methods produce equivalent results to standard but more complex Markov chain Monte Carlo approaches. The priors are derived as log-normal distributions for the between-study variance, applicable to meta-analyses of binary outcomes on the log odds-ratio scale. The methods are applied to two example meta-analyses, incorporating the relevant predictive distributions as prior distributions for between-study heterogeneity. We have provided resources to facilitate Bayesian meta-analysis, in a form accessible to applied researchers, which allow relevant prior information on the degree of heterogeneity to be incorporated. © 2014 The Authors. Statistics in Medicine published by John Wiley & Sons Ltd.

[1]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[2]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[3]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[4]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[5]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[6]  Jack Bowden,et al.  How does the DerSimonian and Laird procedure for random effects meta-analysis compare with its more efficient but harder to compute counterparts? , 2010 .

[7]  Rebecca M Turner,et al.  Characteristics of meta-analyses and their component studies in the Cochrane Database of Systematic Reviews: a cross-sectional, descriptive analysis , 2011, BMC medical research methodology.

[8]  A. W. Kemp,et al.  Kendall's Advanced Theory of Statistics. , 1994 .

[9]  Eleanor M Pullenayegum,et al.  An informed reference prior for between‐study heterogeneity in meta‐analyses of binary outcomes , 2011, Statistics in medicine.

[10]  Guobing Lu,et al.  Modeling between-trial variance structure in mixed treatment comparisons. , 2009, Biostatistics.

[11]  A. O'Hagan,et al.  Kendall's Advanced Theory of Statistics, Vol. 2b: Bayesian Inference. , 1996 .

[12]  Wolfgang Viechtbauer,et al.  Confidence intervals for the amount of heterogeneity in meta‐analysis , 2007, Statistics in medicine.

[13]  A E Ades,et al.  The Interpretation of Random-Effects Meta-Analysis in Decision Models , 2005, Medical decision making : an international journal of the Society for Medical Decision Making.

[14]  David J Spiegelhalter,et al.  A re-evaluation of random-effects meta-analysis , 2009, Journal of the Royal Statistical Society. Series A,.

[15]  Yinghui Wei,et al.  Bayesian multivariate meta‐analysis with multiple outcomes , 2013, Statistics in medicine.

[16]  Anthony O'Hagan,et al.  Kendall's Advanced Theory of Statistics, volume 2B: Bayesian Inference, second edition , 2004 .

[17]  S. Gates,et al.  Auricular acupuncture for cocaine dependence. , 2006, The Cochrane database of systematic reviews.

[18]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[19]  Brian D. Ripley,et al.  Stochastic Simulation , 2005 .

[20]  J. Geweke,et al.  Bayesian Inference in Econometric Models Using Monte Carlo Integration , 1989 .

[21]  B. Cosmi,et al.  Ticlopidine versus oral anticoagulation for coronary stenting. , 2001, The Cochrane database of systematic reviews.

[22]  Theo Stijnen,et al.  The binomial distribution of meta-analysis was preferred to model within-study variability. , 2008, Journal of clinical epidemiology.

[23]  A Whitehead,et al.  Borrowing strength from external trials in a meta-analysis. , 1996, Statistics in medicine.

[24]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[25]  Aki Vehtari Discussion to "Bayesian measures of model complexity and fit" by Spiegelhalter, D.J., Best, N.G., Carlin, B.P., and van der Linde, A. , 2002 .

[26]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[27]  Simon G Thompson,et al.  Predicting the extent of heterogeneity in meta-analysis, using empirical data from the Cochrane Database of Systematic Reviews , 2012, International journal of epidemiology.