Publication Bias in Road Safety Evaluation: How can It be Detected and how Common is It?

Publication bias denotes the tendency not to publish a study if its findings are not statistically significant or are regarded as unwanted or difficult to explain. In road safety evaluation research, studies that find an increase in the number of accidents as a result of a safety treatment may be less likely to be published than studies that find an accident reduction. How publication bias can be detected and how its influence on summary estimates of effect in meta-analyses can be determined are demonstrated by applying the trim-and-fill technique. Examples are based on recent analyses that indicate the presence of publication bias in studies that evaluate several different road safety measures. Although there is no way to determine conclusively how widespread publication bias is, indications of bias have been found for a number of well-known and widely applied road safety measures. Factors that may influence the likelihood of publication bias are discussed.

[1]  R Elvik,et al.  Evaluations of road accident blackspot treatment: a case of the Iron Law of Evaluation Studies? , 1997, Accident; analysis and prevention.

[2]  J. Sterne,et al.  Publication and related bias in meta-analysis: power of statistical tests and prevalence in the literature. , 2000, Journal of clinical epidemiology.

[3]  K R Abrams,et al.  Modelling publication bias in meta-analysis: a review. , 2000, Statistical methods in medical research.

[4]  Rune Elvik,et al.  The Handbook of Road Safety Measures , 2009 .

[5]  D. W. Lawrence THE INFORMATION-SEEKING BEHAVIORS OF PROFESSIONALS AND INFORMATION SOURCES IN THE FIELD OF INJURY PREVENTION AND SAFETY PROMOTION , 2008 .

[6]  S Duval,et al.  Trim and Fill: A Simple Funnel‐Plot–Based Method of Testing and Adjusting for Publication Bias in Meta‐Analysis , 2000, Biometrics.

[7]  Richard L. Tweedie,et al.  A Non-parametric "Trim and Fill" Method of Assessing Publication Bias in Meta-analysis , 1998 .

[8]  R Elvik The effects on accidents of studded tires and laws banning their use: a meta-analysis of evaluation studies. , 1999, Accident; analysis and prevention.

[9]  Ezra Hauer,et al.  The harm done by tests of significance. , 2004, Accident; analysis and prevention.

[10]  Rune Elvik,et al.  Introductory Guide to Systematic Reviews and Meta-Analysis , 2005 .

[11]  Rune Elvik,et al.  Can We Trust the Results of Meta-Analyses?: A Systematic Approach to Sensitivity Analysis in Meta-Analyses , 2005 .

[12]  R. Tweedie,et al.  A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis , 2000 .

[13]  R G Attewell,et al.  Bicycle helmet efficacy: a meta-analysis. , 2001, Accident; analysis and prevention.

[14]  K. Dickersin,et al.  Publication Bias: The Problem That Won't Go Away , 1993, Annals of the New York Academy of Sciences.

[15]  David Ogilvie,et al.  Informing Healthy Transport Policies: Systematic Reviews and Research Synthesis , 2005 .

[16]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[17]  P. Sleight,et al.  Publication bias , 1991, The Lancet.