Statistical power analysis in wildlife research

Statistical power analysis can be used to increase the efficiency of research efforts and to clarify research results. Power analysis is most valuable in the design or planning phases of research efforts. Such prospective (a priori) power analyses can be used to guide research design and to estimate the number of samples necessary to achieve a high probability of detecting biologically significant effects. Retrospective (a posteriori) power analysis has been advocated as a method to increase information about hypothesis tests that were not rejected. However, estimating power for tests of null hypotheses that were not rejected with the effect size observed in the study is incorrect; these power estimates will always be ≤0.50 when bias adjusted and have no relation to true power. Therefore, retrospective power estimates based on the observed effect size for hypothesis tests that were not rejected are misleading; retrospective power estimates are only meaningful when based on effect sizes other than the observed effect size, such as those effect sizes hypothesized to be biologically significant. Retrospective power analysis can be used effectively to estimate the number of samples or effect size that would have been necessary for a completed study to have rejected a specific null hypothesis. Simply presenting confidence intervals can provide additional information about null hypotheses that were not rejected, including information about the size of the true effect and whether or not there is adequate evidence to accept a null hypothesis as true. We suggest that (1) statistical power analyses be routinely incorporated into research planning efforts to increase their efficiency, (2) confidence intervals be used in lieu of retrospective power analyses for null hypotheses that were not rejected to assess the likely size of the true effect, (3) minimum biologically significant effect sizes be used for all power analyses, and (4) if retrospective power estimates are to be reported, then the α-level, effect sizes, and sample sizes used in calculations must also be reported.

[1]  Jacob Cohen.  Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[2]  Robert J. Steidl,et al.  Statistical Power Analysis and Amphibian Population Trends , 1997 .

[3]  Paul Beier,et al.  Power of track surveys to detect changes in cougar populations , 1996 .

[4]  Aaron M. Ellison,et al.  AN INTRODUCTION TO BAYESIAN INFERENCE FOR ECOLOGICAL RESEARCH AND ENVIRONMENTAL , 1996 .

[5]  John T. E. Richardson.  Measures of effect size , 1996 .

[6]  Jeff S. Hatfield,et al.  Detecting trends in raptor counts: power and Type I error rates of various statistical tests , 1996 .

[7]  Douglas H. Johnson.  STATISTICAL SIRENS: THE ALLURE OF NONPARAMETRICS' , 1995 .

[8]  Wallace P. Erickson,et al.  Tests for bioequivalence of control media and test media in studies of toxicity , 1995 .

[9]  Franklin A. Graybill,et al.  Regression Analysis-Concepts and Applications , 1995 .

[10]  R. Searcy-Bernal.  Statistical power and aquacultural research , 1994 .

[11]  A. Freeny,et al.  Statistical Principles for Research Design and Analysis , 1994 .

[12]  R. Steidl.  Human impacts on the ecology of bald eagles in interior Alaska , 1994 .

[13]  S. Goodman,et al.  The Use of Predicted Confidence Intervals When Planning Experiments and the Misuse of Power When Interpreting Results , 1994, Annals of Internal Medicine.

[14]  Craig W. Osenberg,et al.  Detection of Environmental Impacts: Natural Variability, Effect Size, and Power Analysis , 1994 .

[15]  Bruce E. Barrett.  Regression Analysis: Concepts and Applications , 1994 .

[16]  Tim Gerrodette,et al.  The Uses of Statistical Power in Conservation Biology: The Vaquita and Northern Spotted Owl , 1993 .

[17]  K. Shrader-Frechette,et al.  Method in Ecology: References , 1993 .

[18]  J. Hagar.  Bird communities in commercially thinned and unthinned Douglas-fir stands in western Oregon , 1992 .

[19]  Jacob Cohen.  Statistical Power Analysis , 1992 .

[20]  Andrew R. Solow,et al.  On sample size, statistical power, and the detection of density dependence. , 1990 .

[21]  Stephen Dubin.  How many subjects? Statistical power analysis in research , 1990 .

[22]  R. Peterman.  Statistical Power Analysis can Improve Fisheries Research and Management , 1990 .

[23]  M. Kenward,et al.  Design and Analysis of Cross-Over Trials , 1989 .

[24]  S Greenland,et al.  On sample-size and power calculations for studies using confidence intervals. , 1988, American journal of epidemiology.

[25]  Randall M. Peterman,et al.  Statistical Power of Trends in Fish Abundance , 1987 .

[26]  Tim Gerrodette,et al.  A POWER ANALYSIS FOR DETECTING TRENDS , 1987 .

[27]  Helena Chmura Kraemer,et al.  How Many Subjects? Statistical Power Analysis in Research , 1987 .

[28]  J P Hayes,et al.  The positive approach to negative results in toxicology studies. , 1987, Ecotoxicology and environmental safety.

[29]  David S. Salsburg,et al.  The Religion of Statistics as Practiced in Medical Journals , 1985 .

[30]  John A. Wiens,et al.  Statistical Power Analysis and Community-Wide Patterns , 1985, The American Naturalist.

[31]  C. Toft,et al.  Detecting Community-Wide Patterns: Estimating Power Strengthens Statistical Inference , 1983, The American Naturalist.

[32]  Kenneth P. Burnham,et al.  USE AND INTERPRETATION OF STATISTICS IN WILDLIFE JOURNALS , 1982 .

[33]  H. Charles Romesburg,et al.  WILDLIFE SCIENCE: GAINING RELIABLE KNOWLEDGE , 1981 .

[34]  C. Dunnett,et al.  Significance testing to establish equivalence between treatments, with special reference to data in the form of 2X2 tables. , 1977, Biometrics.

[35]  W. Westlake,et al.  Symmetrical confidence intervals for bioequivalence trials. , 1976, Biometrics.

[36]  C M Metzler,et al.  Bioavailability--a problem in equivalence. , 1974, Biometrics.

[37]  M. Tiku.  More Tables of the Power of the F-Test , 1972 .

[38]  R. Greenberg.  Biometry , 1969, The Yale Journal of Biology and Medicine.

[39]  M. Tiku.  Tables of the Power of the F-Test , 1967 .

[40]  Walter Modell,et al.  CRC Handbook of Tables for Probability and Statistics , 1966 .

[41]  K. Popper,et al.  Conjectures and Refutations , 1963 .

[42]  P. C. Tang,et al.  The power function of the analysis of variance tests, with tables and illustrations of their use. , 1938 .