Investigating underlying risk as a source of heterogeneity in meta-analysis.

In a meta-analysis of clinical trials, an important issue is whether the treatment benefit varies according to the underlying risk of the patients in the different trials. The usual naive analyses employed to investigate this question use either the observed risk of events in the control groups, or the average risk in the control and treatment groups, as a measure of underlying risk. These analyses are flawed and can produce seriously misleading results. We show how their biases depend on three components of variability, the within-trial and between-trial variances of the control group risks, and the between-trial variance of the treatment effects. We propose a Bayesian solution to the problem which can be carried out using the BUGS implementation of Gibbs sampling. The analysis is illustrated for a meta-analysis of bleeding and mortality data in trials of sclerotherapy for patients with cirrhosis, and the results contrasted with those from the naive approaches. Comparisons with other methods recently proposed for this problem are also made. We conclude that the Bayesian solution presented in this paper is not only more appropriate than other proposed methods, but is also sufficiently easy to implement that it can be used by applied researchers undertaking meta-analyses.

[1]  H C Van Houwelingen,et al.  A bivariate approach to meta-analysis. , 1993, Statistics in medicine.

[2]  J C Wakefield,et al.  Hierarchical models for multicentre binary response studies. , 1990, Statistics in medicine.

[3]  M. McIntosh,et al.  The population risk as an explanatory variable in research synthesis of clinical trials. , 1996, Statistics in medicine.

[4]  S G Thompson,et al.  Systematic Review: Why sources of heterogeneity in meta-analysis should be investigated , 1994, BMJ.

[5]  S. Thompson Modelling in matched case-control studies in epidemiology , 1986 .

[6]  S. Senn,et al.  IMPORTANCE OF TRENDS IN THE INTERPRETATION OF AN OVERALL ODDS RATIO IN THEMETA-ANALYSIS OF CLINICAL TRIALS. AUTHOR'S REPLY , 1994 .

[7]  Douglas G Altman,et al.  The relation between treatment benefit and underlying risk in meta-analysis , 1996, BMJ.

[8]  S G Thompson,et al.  A likelihood approach to meta-analysis with random effects. , 1996, Statistics in medicine.

[9]  C S Berkey,et al.  A random-effects regression model for meta-analysis. , 1995, Statistics in medicine.

[10]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[11]  S D Walter,et al.  Variation in baseline risk as an explanation of heterogeneity in meta-analysis. , 1997, Statistics in medicine.

[12]  S G Thompson,et al.  Controversies in meta-analysis: the case of the trials of serum cholesterol reduction , 1993, Statistical methods in medical research.