Evidence-based road safety policy? Evidence-based transport policy? A discussion of randomised experimentation and meta-analysis in the evaluation of interventions

words): This paper discusses methods of evaluating interventions. Examples in the transport field might include improving compliance with speed limits, or boosting the use of public transport. In recent years there has been a push towards higher methodological standards in medical research, because of the biases that can easily creep into the comparisons that are of central interest in a research project. Particular features of this trend are (a) in the conduct of research, randomised allocation of the experimental units (e.g., people) to treatment or control groups, and (b) in synthesis of previous research, carrying out what is termed a meta-analysis rather than a review in narrative style, with the analysis giving much greater weight to studies that had good methodology than to those which did not. The phrase 'evidence-based' is used in this paper to refer to these features, not to a general hope that research and facts will influence policy. This paper documents the extent to which high methodological standards have been adopted in transport and transport safety to date, and attempts to assess what place they might have in future.

[1]  James J. Heckman,et al.  Assessing the Case for Social Experiments , 1995 .

[2]  M. Petticrew,et al.  New roads and human health: a systematic review. , 2003, American journal of public health.

[3]  I. Roberts,et al.  Safety education of pedestrians for injury prevention. , 2002, The Cochrane database of systematic reviews.

[4]  R Wentz,et al.  Size and quality of randomised controlled trials in head injury: review of published studies , 2000, BMJ : British Medical Journal.

[5]  F P Rivara,et al.  Systematic reviews of strategies to prevent motor vehicle injuries. , 1999, American journal of preventive medicine.

[6]  Rune Elvik,et al.  Meta-analysis of evaluations of public lighting as accident countermeasure , 1995 .

[7]  Rune Elvik,et al.  Road Safety Effects of Bypasses , 2001 .

[8]  Ann Oakley,et al.  Social Science and Evidence-based Everything: The case of education , 2002 .

[9]  Allan Donner,et al.  Design and Analysis of Cluster Randomization Trials in Health Research , 2001 .

[10]  A F Williams,et al.  Driver education renaissance? , 2004, Injury Prevention.

[11]  M. Petticrew,et al.  What are the most effective ways of improving population health through transport interventions? Evidence from systematic reviews , 2003, Journal of epidemiology and community health.

[12]  R. Bangert-Drowns,et al.  Final results from a meta-analysis of remedial interventions with drink/drive offenders. , 1995, Addiction.

[13]  Anne T McCartt,et al.  A review of evidence-based traffic engineering measures designed to reduce pedestrian-motor vehicle crashes. , 2003, American journal of public health.

[14]  Phil Edwards,et al.  Identifying controlled evaluation studies of road safety interventions: Searching for needles in a haystack , 2001 .

[15]  R Wentz,et al.  Traffic calming for the prevention of road traffic injuries: systematic review and meta-analysis , 2003, Injury prevention : journal of the International Society for Child and Adolescent Injury Prevention.

[16]  A C Wagenaar Importance of systematic reviews and meta-analyses for research and practice. , 1999, American journal of preventive medicine.

[17]  Rune Elvik,et al.  Effects on Road Safety of Converting Intersections to Roundabouts: Review of Evidence from Non-U.S. Studies , 2003 .

[18]  David M. Murray,et al.  Design and Analysis of Group- Randomized Trials , 1998 .

[19]  R Elvik,et al.  The safety value of guardrails and crash cushions: a meta-analysis of evidence from evaluation studies. , 1995, Accident; analysis and prevention.

[20]  R W Zavoski,et al.  Evaluation of the effectiveness of a pavement stencil in promoting safe behavior among elementary school children boarding school buses. , 1996, Pediatrics.

[21]  A. Williams,et al.  Comment on occupant and licensing interventions. , 1999, American journal of preventive medicine.

[22]  L. Sherman Misleading Evidence and Evidence-Led Policy: Making Social Science more Experimental , 2003 .

[23]  S Fosser An experimental evaluation of the effects of periodic motor vehicle inspection on accident rates. , 1992, Accident; analysis and prevention.

[24]  Allan F. Williams,et al.  Changes in crash risk following re-timing of traffic signal change intervals. , 2002, Accident; analysis and prevention.

[25]  R Elvik,et al.  Area-wide urban traffic calming schemes: a meta-analysis of safety effects. , 2001, Accident; analysis and prevention.

[26]  R Elvik,et al.  Evaluations of road accident blackspot treatment: a case of the Iron Law of Evaluation Studies? , 1997, Accident; analysis and prevention.

[27]  Howard S. Bloom,et al.  Extending the reach of randomized social experiments: new directions in evaluations of American welfare‐to‐work and employment initiatives , 2001 .

[28]  E. Ferlie,et al.  Evidence-Based Medicine and the Implementation Gap , 2003 .

[29]  Rob Watts,et al.  Tampering with the evidence: a critical appraisal of evidence-based policy-making , 2003 .

[30]  Richard L. Edwards,et al.  An experimental evaluation of driver license manuals and written tests , 1982 .

[31]  A. Feinstein,et al.  Problems in the "evidence" of "evidence-based medicine". , 1997, The American journal of medicine.