Meta-analytic insights into evolutionary ecology: an introduction and synthesis

Meta-analysis now pervades ecology and evolutionary biology as the tool of choice for the synthesis of primary results. In the opening article of this special issue on “Meta-analytic insights into evolutionary ecology”, we begin by contrasting meta-analysis with the more traditional ‘narrative’ reviewing approach. Although it is not without faults, we find that meta-analysis usually outperforms qualitative reviews with respect to testing hypotheses, identifying sources of heterogeneity among primary results, assessing publication bias, and even generating new hypotheses and future research directions. We then highlight the key messages of the nine other contributions to this special issue, on the topics of natural selection, sexual selection, community ecology, host-parasite interactions, plant evolutionary ecology, social behaviour, behavioural syndromes, conservation biology, and methodological advances. We also discuss issues associated with the quality assessments and the inadequate reporting of basic statistics in primary empirical studies, and the need to share credit with the authors of those primary studies through actual citations. Finally, we turn to the future and argue that meta-analysis needs to adopt the principles of systematic reviews, following strict protocols that facilitate replicable and updatable research syntheses. Ecology and evolutionary biology urgently need collaborative networks such as the Cochrane Collaboration in the medical sciences, to oversee the standards of systematic reviews and meta-analyses. The formation of a collaborative meta-analytic research network will be an important step for meta-analysis to solidify its central role in research and data synthesis.

[1]  M. Borenstein,et al.  Publication Bias in Meta-Analysis: Prevention, Assessment and Adjustments , 2006 .

[2]  Dan Jackson,et al.  Multivariate meta-analysis: Potential and promise , 2011, Statistics in medicine.

[3]  M. Pittler Systematic Reviews in Health Care: Meta‐analysis in Context , 2010 .

[4]  M. Lajeunesse,et al.  Achieving synthesis with meta-analysis by combining and comparing all available studies. , 2010, Ecology.

[5]  M. Kirkpatrick,et al.  The Evolution of Infidelity in Socially Monogamous Passerines: The Strength of Direct and Indirect Selection on Extrapair Copulation Behavior in Females , 2005, The American Naturalist.

[6]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[7]  M. Borenstein,et al.  Publication Bias in Meta-Analysis , 2006 .

[8]  Miguel Verdú,et al.  Meta-analysis of meta-analyses in plant evolutionary ecology , 2012, Evolutionary Ecology.

[9]  Shinichi Nakagawa,et al.  General Quantitative Genetic Methods for Comparative Biology , 2014 .

[10]  G. Schino,et al.  The relative roles of kinship and reciprocity in explaining primate altruism. , 2010, Ecology letters.

[11]  S. Thompson,et al.  How should meta‐regression analyses be undertaken and interpreted? , 2002, Statistics in medicine.

[12]  J. Endler Natural selection in the wild , 1987 .

[13]  Kerrie Mengersen,et al.  Handbook of Meta-analysis in Ecology and Evolution , 2013 .

[14]  J. Stamps,et al.  Species Identity Cues in Animal Communication , 2009, The American Naturalist.

[15]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[16]  Matthew B. Jones,et al.  Challenges and Opportunities of Open Data in Ecology , 2011, Science.

[17]  L. Rowe,et al.  Assortative mating by size: A meta-analysis of mating patterns in water striders , 1996, Evolutionary Ecology.

[18]  Christiane Werner,et al.  Fame, glory and neglect in meta-analyses. , 2011, Trends in ecology & evolution.

[19]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[20]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[21]  D. Moher,et al.  The nuts and bolts of PROSPERO: an international prospective register of systematic reviews , 2012, Systematic Reviews.

[22]  Filippo Aureli,et al.  Meta-analysis and animal social behaviour , 2012, Evolutionary Ecology.

[23]  R. Whittaker,et al.  Meta-analyses and mega-mistakes: calling time on meta-analysis of the species richness-productivity relationship. , 2010, Ecology.

[24]  John P.A. Ioannidis,et al.  Integration of evidence from multiple meta-analyses: a primer on umbrella reviews, treatment networks and multiple treatments meta-analyses , 2009, Canadian Medical Association Journal.

[25]  Julian P T Higgins,et al.  Recent developments in meta‐analysis , 2008, Statistics in medicine.

[26]  N. Dingemanse,et al.  Evolutionary and ecological approaches to the study of personality , 2010, Philosophical Transactions of the Royal Society B: Biological Sciences.

[27]  B. Kempenaers,et al.  Female extrapair mating behavior can evolve via indirect selection on males , 2011, Proceedings of the National Academy of Sciences.

[28]  Jay Brand,et al.  File Drawer Problem , 2022, The SAGE Encyclopedia of Research Design.

[29]  P. Dixon,et al.  Modelling data from different sites, times or studies: weighted vs. unweighted regression , 2012 .

[30]  I. Cuthill,et al.  Effect size, confidence interval and statistical significance: a practical guide for biologists , 2007, Biological reviews of the Cambridge Philosophical Society.

[31]  A. Møller,et al.  Testing and adjusting for publication bias , 2001 .

[32]  Jeffrey C. Valentine Judging the quality of primary research. , 2009 .

[33]  S. J. Arnold,et al.  Multiple mating by females: a perspective from quantitative genetics , 1987, Animal Behaviour.

[34]  Meta-analysis and research on host–parasite interactions: past and future , 2012, Evolutionary Ecology.

[35]  David R. Bowler,et al.  The Nuts and Bolts , 2013 .

[36]  A. Griffin,et al.  Kin Discrimination and the Benefit of Helping in Cooperatively Breeding Vertebrates , 2003, Science.

[37]  Duncan N. L. Menge,et al.  Gauging the impact of meta-analysis on ecology , 2012, Evolutionary Ecology.

[38]  William J. Sutherland,et al.  Natural Selection in the Wild. , 1987 .

[39]  Julia H. Littell,et al.  Systematic Reviews and Meta-Analysis , 2008 .

[40]  L. Garamszegi,et al.  A meta-analysis of correlated behaviours with implications for behavioural syndromes: mean effect size, publication bias, phylogenetic effects and the role of mediator variables , 2012, Evolutionary Ecology.

[41]  B. Bushman,et al.  Vote counting methods in meta-analysis , 2009 .

[42]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[43]  Joel G. Kingsolver,et al.  Synthetic analyses of phenotypic selection in natural populations: lessons, limitations and future directions , 2012, Evolutionary Ecology.

[44]  Shinichi Nakagawa,et al.  Methodological issues and advances in biological meta-analysis , 2012, Evolutionary Ecology.

[45]  A meta‐analytic study of the effects of female age on laying‐date and clutch‐size in the Great Tit Parus major and the Pied Flycatcher Ficedula hypoleuca , 2008 .

[46]  G. Arnqvist,et al.  Meta-analysis: synthesizing research findings in ecology and evolution. , 1995, Trends in ecology & evolution.

[47]  Gavin B. Stewart,et al.  Meta-analysis in applied ecology , 2010, Biology Letters.

[48]  John P A Ioannidis,et al.  Meta‐research: The art of getting it wrong , 2010, Research synthesis methods.

[49]  G. Glass Primary, Secondary, and Meta-Analysis of Research1 , 1976 .

[50]  M. Petticrew,et al.  Systematic Reviews in the Social Sciences: A Practical Guide , 2005 .

[51]  Jessica Gurevitch,et al.  STATISTICAL ISSUES IN ECOLOGICAL META‐ANALYSES , 1999 .

[52]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. , 2009, Journal of clinical epidemiology.

[53]  Isabelle M. Côté,et al.  Meta-analysis at the intersection of evolutionary ecology and conservation , 2012, Evolutionary Ecology.

[54]  Douglas G. Altman,et al.  Systematic Reviews in Health Care , 2001 .

[55]  A J Sutton,et al.  Publication and related biases. , 2000, Health technology assessment.

[56]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[57]  Deborah M Caldwell,et al.  Mixed treatment comparison analysis provides internally coherent treatment effect estimates based on overviews of reviews and can reveal inconsistency. , 2010, Journal of clinical epidemiology.

[58]  John A Foley,et al.  Nuts and bolts. , 2013, Connecticut medicine.

[59]  Filippo Aureli,et al.  Grooming reciprocation among female primates: a meta-analysis , 2008, Biology Letters.

[60]  Douglas G. Altman,et al.  Systematic Reviews in Health Care: Meta-Analysis in Context: Second Edition , 2008 .

[61]  Gabriele Schino,et al.  Grooming, competition and social rank among female primates: a meta-analysis , 2001, Animal Behaviour.

[62]  A. Griffin,et al.  Routes to indirect fitness in cooperatively breeding vertebrates: kin discrimination and limited dispersal , 2009, Journal of evolutionary biology.

[63]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[64]  L. Hedges,et al.  Statistical Methods for Meta-Analysis , 1987 .

[65]  R. Rosenthal The file drawer problem and tolerance for null results , 1979 .

[66]  Hanna Kokko,et al.  Meta-analysis and sexual selection: past studies and future possibilities , 2012, Evolutionary Ecology.