RESAMPLING TESTS FOR META‐ANALYSIS OF ECOLOGICAL DATA

Meta-analysis is a statistical technique that allows one to combine the results from multiple studies to glean inferences on the overall importance of various phenomena. This method can prove to be more informative than common ''vote counting,'' in which the number of significant results is compared to the number with nonsignificant results to determine whether the phenomenon of interest is globally important. While the use of meta- analysis is widespread in medicine and the social sciences, only recently has it been applied to ecological questions. We compared the results of parametric confidence limits and ho- mogeneity statistics commonly obtained through meta-analysis to those obtained from re- sampling methods to ascertain the robustness of standard meta-analytic techniques. We found that confidence limits based on bootstrapping methods were wider than standard confidence limits, implying that resampling estimates are more conservative. In addition, we found that significance tests based on homogeneity statistics differed occasionally from results of randomization tests, implying that inferences based solely on chi-square signif- icance tests may lead to erroneous conclusions. We conclude that resampling methods should be incorporated in meta-analysis studies, to ensure proper evaluation of main effects in ecological studies.

[1]  G. Arnqvist,et al.  Meta-analysis: synthesizing research findings in ecology and evolution. , 1995, Trends in ecology & evolution.

[2]  R. Hanka.  The Handbook of Research Synthesis , 1994 .

[3]  L. Hedges,et al.  The Handbook of Research Synthesis , 1995 .

[4]  Jessica Gurevitch,et al.  MetaWin: Statistical Software for Meta-analysis with Resampling Tests , 1997 .

[5]  T. E. Doerfler,et al.  The behaviour of some significance tests under experimental randomization , 1969 .

[6]  J. Gentle,et al.  Randomization and Monte Carlo Methods in Biology. , 1990 .

[7]  D. N. Byrne,et al.  The effects of crop diversification on herbivorous insects: a meta‐analysis approach , 1994 .

[8]  G. Arnqvist,et al.  MetaWin: Statistical Software for Meta-Analysis with Resampling Tests. Version 1.Michael S. Rosenberg , Dean C. Adams , Jessica Gurevitch , 1998 .

[9]  Jessica Gurevitch,et al.  A Meta-Analysis of Competition in Field Experiments , 1992, The American Naturalist.

[10]  B. Efron.  Better Bootstrap Confidence Intervals , 1987 .

[11]  D. Adams,et al.  Using randomization techniques to analyse behavioural data , 1996, Animal Behaviour.

[12]  Stephen W. Raudenbush,et al.  Random effects models. , 1994 .

[13]  Philip H. Crowley,et al.  RESAMPLING METHODS FOR COMPUTATION-INTENSIVE DATA ANALYSIS IN ECOLOGY AND EVOLUTION , 1992 .

[14]  B. Efron.  Bootstrap Methods: Another Look at the Jackknife , 1979 .

[15]  Peter S. Curtis,et al.  A meta‐analysis of leaf gas exchange and nitrogen in trees grown under elevated carbon dioxide , 1996 .

[16]  L. Hedges,et al.  Meta-analysis: Combining the results of independent experiments , 1993 .