Funnel Plots in Meta-analysis

Funnel plots are a visual tool for investigating publication and other bias in meta-analysis. They are simple scatterplots of the treatment effects estimated from individual studies (horizontal axis) against a measure of study size (vertical axis). The name “funnel plot” is based on the precision in the estimation of the underlying treatment effect increasing as the sample size of component studies increases. Therefore, in the absence of bias, results from small studies will scatter widely at the bottom of the graph, with the spread narrowing among larger studies. Publication bias (the association of publication probability with the statistical significance of study results) may lead to asymmetrical funnel plots. It is, however, important to realize that publication bias is only one of a number of possible causes of funnel-plot asymmetry-funnel plots should be seen as a generic means of examining small study effects (the tendency for the smaller studies in a meta-analysis to show larger treatment effects) rather than a tool to diagnose specific types of bias. This article introduces the metafunnel command, which produces funnel plots in Stata. In accordance with published recommendations, standard error is used as the measure of study size. Treatment effects expressed as ratio measures (for example risk ratios or odds ratios) may be plotted on a log scale.

[1]  Douglas G. Altman,et al.  Systematic Reviews in Health Care: Meta-Analysis in Context: Second Edition , 2008 .

[2]  Alex J. Sutton,et al.  Publication and related biases: a review , 2000 .

[3]  C. Begg,et al.  Operating characteristics of a rank correlation test for publication bias. , 1994, Biometrics.

[4]  R. J. Hayes,et al.  Empirical evidence of bias. Dimensions of methodological quality associated with estimates of treatment effects in controlled trials. , 1995, JAMA.

[5]  M. Tramèr,et al.  Impact of covert duplicate publication on meta-analysis: a case study , 1997, BMJ.

[6]  I Olkin,et al.  Heterogeneity and statistical significance in meta-analysis: an empirical study of 125 meta-analyses. , 2000, Statistics in medicine.

[7]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[8]  Jonathan J Deeks,et al.  metan-an alternative meta-analysis command , 1999 .

[9]  J. Sterne,et al.  How important are comprehensive literature searches and the assessment of trial quality in systematic reviews? Empirical study. , 2003, Health technology assessment.

[10]  M. Egger,et al.  Who benefits from medical interventions? , 1994, BMJ.

[11]  S. Sharp,et al.  Explaining heterogeneity in meta-analysis: a comparison of methods. , 1997, Statistics in medicine.

[12]  Thomas J. Steichen,et al.  Tests for publication bias in meta-analysis , 1998 .

[13]  Peter Jüni,et al.  Direction and impact of language bias in meta-analyses of controlled trials: empirical study. , 2002, International journal of epidemiology.

[14]  Jonathan A C Sterne,et al.  Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. , 2001, BMJ.

[15]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[16]  J. Sterne,et al.  Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. , 2000, Journal of clinical epidemiology.

[17]  Douglas G. Altman,et al.  Systematic Reviews in Health Care , 2001 .

[18]  S Greenland,et al.  Random-effects meta-analyses are not always conservative. , 1999, American journal of epidemiology.

[19]  Les M Irwig,et al.  An evidence based approach to individualising treatment , 1995, BMJ.

[20]  Thomas J. Steichen 1 Tests for publication bias in meta-analysis , 2000 .

[21]  L. Rubenstein,et al.  Comprehensive geriatric assessment: a meta-analysis of controlled trials , 1993, The Lancet.

[22]  R. Simes,et al.  Publication bias: evidence of delayed publication in a cohort study of clinical research projects , 1997, BMJ.

[23]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.