Contour-Enhanced Funnel Plots for Meta-Analysis

Funnel plots are commonly used to investigate publication and related biases in meta-analysis. Although asymmetry in the appearance of a funnel plot is often interpreted as being caused by publication bias, in reality the asymmetry could be due to other factors that cause systematic differences in the results of large and small studies, for example, confounding factors such as differential study quality. Funnel plots can be enhanced by adding contours of statistical significance to aid in interpreting the funnel plot. If studies appear to be missing in areas of low statistical significance, then it is possible that the asymmetry is due to publication bias. If studies appear to be missing in areas of high statistical significance, then publication bias is a less likely cause of the funnel asymmetry. It is proposed that this enhancement to funnel plots should be used routinely for meta-analyses where it is possible that results could be suppressed on the basis of their statistical significance.

[1]  Jonathan A C Sterne,et al.  Funnel Plots in Meta-analysis , 2004 .

[2]  Jonathan J Deeks,et al.  metan-an alternative meta-analysis command , 1999 .

[3]  P. Easterbrook,et al.  Publication bias in clinical research , 1991, The Lancet.

[4]  R. Tweedie,et al.  A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis , 2000 .

[5]  Thomas J. Steichen,et al.  Tests for publication bias in meta-analysis , 1998 .

[6]  N J Wald,et al.  The accumulated evidence on lung cancer and environmental tobacco smoke , 1997, BMJ.

[7]  Alex J Sutton,et al.  Contour-enhanced meta-analysis funnel plots help distinguish publication bias from other causes of asymmetry. , 2008, Journal of clinical epidemiology.

[8]  Jonathan A C Sterne,et al.  The Funnel Plot , 2006 .

[9]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[10]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[11]  Douglas G. Altman,et al.  Metan: Fixed- and Random-Effects Meta-Analysis , 2008 .

[12]  J. Ioannidis.  Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. , 1998, JAMA.

[13]  Thomas J. Steichen,et al.  Nonparametric trim and fill analysis of publication bias in meta-analysis: erratum , 2001 .

[14]  Jonathan AC Sterne,et al.  Are the clinical effects of homoeopathy placebo effects? Comparative study of placebo-controlled trials of homoeopathy and allopathy , 2005, The Lancet.

[15]  Raymond C. Schneider,et al.  ISIS-4: A randomised factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58 050 patients with suspected acute myocardial infarction , 1995, The Lancet.

[16]  David J Spiegelhalter,et al.  Funnel plots for comparing institutional performance , 2005, Statistics in medicine.

[17]  R. Collins,et al.  ISIS-4: A randomised factorial trial assessing early oral captopril, oral mononitrate, and intravenous magnesium sulphate in 58 050 patients with suspected acute myocardial infarction , 1995, The Lancet.

[18]  Roger M Harbord,et al.  A modified test for small‐study effects in meta‐analyses of controlled trials with binary endpoints , 2006, Statistics in medicine.

[19]  Santiago G. Moreno,et al.  Assessment of regression-based methods to adjust for publication bias through a comprehensive simulation study , 2009, BMC medical research methodology.

[20]  R Peto,et al.  Effects of intravenous magnesium in suspected acute myocardial infarction: overview of randomised trials. , 1991, BMJ.

[21]  R. Rosenthal,et al.  Selective publication of antidepressant trials and its influence on apparent efficacy. , 2008, The New England journal of medicine.

[22]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[23]  Nicola J Cooper,et al.  Novel methods to deal with publication biases: secondary analysis of antidepressant trials in the FDA trial registry database and related journal publications , 2009, BMJ : British Medical Journal.

[24]  D. Spiegelhalter,et al.  Funnel plots for institutional comparison , 2002, Quality & safety in health care.

[25]  I. Olkin,et al.  The case of the misleading funnel plot , 2006, BMJ : British Medical Journal.

[26]  Michele Tarsilla.  Cochrane Handbook for Systematic Reviews of Interventions , 2010, Journal of MultiDisciplinary Evaluation.

[27]  J. Sterne,et al.  Meta‒Analysis in Stata™ , 2008 .

[28]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[29]  K. Dickersin.  How important is publication bias? A synthesis of available data. , 1997, AIDS education and prevention : official publication of the International Society for AIDS Education.