Getting started with meta‐analysis

. Meta-analysis is a powerful and informative tool for basic and applied research. It provides a statistical framework for synthesizing and comparing the results of studies which have all tested a particular hypothesis. Meta-analysis has the potential to be particularly useful for ecologists and evolutionary biologists, as individual experiments often rely on small sample sizes due to the constraints of time and manpower, and therefore have low statistical power. 2. The rewards of conducting a meta-analysis can be significant. It can be the basis of a systematic review of a topic that provides a powerful exploration of key hypotheses or theoretical assumptions, thereby influencing the future development of a field of research. Alternatively, for the applied scientist, it can provide robust answers to questions of ecological, medical or economic significance. However, planning and conducting a meta-analysis can be a daunting prospect and the analysis itself is invariably demanding and labour intensive. Errors or omissions made at the planning stage can create weeks of extra work. 3. While a range of useful resources is available to help the budding meta-analyst on his or her way, much of the key information and explanation is spread across different articles and textbooks. In order to help the reader use the available information as efficiently as possible (and so avoid making time-consuming errors) this article aims to provide a ‘road map’ to the existing literature. It provides a brief guide to planning, organizing and implementing a meta-analysis which focuses more on logic and implementation than on maths; it is intended to be a first port of call for those interested in the topic and should be used in conjunction with the more detailed books and articles referenced. In the main, references are cited and discussed with an emphasis on useful reading order rather than a chronological history of meta-analysis and its uses. 4. No prior knowledge of meta-analysis is assumed in the current article, though it is assumed that the reader is familiar with anova and regression-type statistical models.

[1]  M. Rosenberg,et al.  THE FILE‐DRAWER PROBLEM REVISITED: A GENERAL WEIGHTED METHOD FOR CALCULATING FAIL‐SAFE NUMBERS IN META‐ANALYSIS , 2005, Evolution; international journal of organic evolution.

[2]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[3]  A. Møller,et al.  Testing and adjusting for publication bias , 2001 .

[4]  Michael D. Jennions,et al.  Meta‐analysis can “fail”: reply to Kotiaho and Tomkins , 2004 .

[5]  William J. Sutherland,et al.  The Effectiveness of Removing Predators to Protect Bird Populations , 1997 .

[6]  H. Schielzeth Simple means to improve the interpretability of regression coefficients , 2010 .

[7]  L. Hedges,et al.  Vote-counting methods in research synthesis. , 1980 .

[8]  D. Adams,et al.  PHYLOGENETIC META-ANALYSIS , 2008, Evolution; international journal of organic evolution.

[9]  Gavin B. Stewart,et al.  Meta-analysis in applied ecology , 2010, Biology Letters.

[10]  Eduardo Fernandez-Duque,et al.  Meta‐Analysis: A Valuable Tool in Conservation Research , 1994 .

[11]  Philip A. Stephens,et al.  Inference in ecology and evolution. , 2007, Trends in ecology & evolution.

[12]  W. Thalheimer,et al.  How to calculate effect sizes from published research: A simplified methodology , 2002 .

[13]  Andrew S. Pullin,et al.  Are review articles a reliable source of evidence to support conservation and environmental management? A comparison with medicine , 2006 .

[14]  Jacob Cohen,et al.  THINGS I HAVE LEARNED (SO FAR) , 1990 .

[15]  Tim M. Blackburn,et al.  Lessons from the establishment of exotic species: a meta-analytical case study using birds , 2005 .

[16]  A. Pullin,et al.  Guidelines for Systematic Review in Conservation and Environmental Management , 2006, Conservation biology : the journal of the Society for Conservation Biology.

[17]  M. Lajeunesse,et al.  Meta‐Analysis and the Comparative Phylogenetic Method , 2009, The American Naturalist.

[18]  Larry V Hedges,et al.  The power of statistical tests for moderators in meta-analysis. , 2004, Psychological methods.

[19]  Harukazu Tsuruta,et al.  Development and validation of MIX: comprehensive free software for meta-analysis of causal research data , 2006, BMC medical research methodology.

[20]  G. Arnqvist,et al.  MetaWin: Statistical Software for Meta-Analysis with Resampling Tests. Version 1.Michael S. Rosenberg , Dean C. Adams , Jessica Gurevitch , 1998 .

[21]  Byron C. Wallace,et al.  Meta-Analyst: software for meta-analysis of binary, continuous and diagnostic data , 2009, BMC medical research methodology.

[22]  Andrew S. Pullin,et al.  Applying evidence-based practice in conservation management: Lessons from the first systematic review and dissemination projects , 2005 .

[23]  Jessica Gurevitch,et al.  A Meta-Analysis of Competition in Field Experiments , 1992, The American Naturalist.

[24]  L. Hedges,et al.  The power of statistical tests in meta-analysis. , 2001, Psychological methods.

[25]  F Harrison,et al.  How is sexual conflict over parental care resolved? A meta‐analysis , 2009, Journal of evolutionary biology.

[26]  Jessica Gurevitch,et al.  THE META‐ANALYSIS OF RESPONSE RATIOS IN EXPERIMENTAL ECOLOGY , 1999 .