An info‐gap approach to power and sample size calculations

Power and sample size calculations are an important but underutilised component of many ecological investigations. A key problem with these calculations is the need to estimate or guess the effect size and error variance (the design parameters) prior to the actual data collection. Furthermore, calculations associated with statistical power and sample size are invariably predicated on normal distribution theory. While the central limit theorem ensures the applicability of normal‐based inference for reasonably large sample sizes, the impact of violations of this assumed distributional form in the context of power and sample size determinations is rarely considered. This paper uses information‐gap theory to provide sample size guidelines that are robust to uncertainties associated with both the design parameters and distributional form. A simple information‐gap approach is developed for one‐ and two‐sided hypothesis tests. The model results quantify the extent to which minimum power demands can be protected from uncertainty by taking additional samples, and demonstrate the importance of the combined effects of standard deviation/effect size ratio and assumed distribution in these considerations. Info‐gap theory does not eliminate the need for an initial estimate or best guess of the design parameters or the specification of a parametric distribution from which to compute power. It does, however, measure the degree of insurance provided by additional samples in the face of uncertainties in each of these. Copyright © 2006 John Wiley & Sons, Ltd.

[1]  Y. Ben-Haim,et al.  Info‐Gap Robust‐Satisficing Model of Foraging Behavior: Do Foragers Optimize or Satisfice? , 2005, The American Naturalist.

[2]  Helen M. Regan,et al.  ROBUST DECISION‐MAKING UNDER SEVERE UNCERTAINTY FOR CONSERVATION MANAGEMENT , 2005 .

[3]  Lesley F. Wright,et al.  Information Gap Decision Theory: Decisions under Severe Uncertainty , 2004 .

[4]  M. Chapman,et al.  Problems of measuring biodiversity in coastal habitats: a summary of issues , 2003 .

[5]  G. Quinn,et al.  Experimental Design and Data Analysis for Biologists , 2002 .

[6]  D. R. Fox,et al.  Environmental power analysis – a new perspective , 2001 .

[7]  D. Heisey,et al.  The Abuse of Power , 2001 .

[8]  Robert H. Lyles,et al.  Assessing Regulatory Compliance of Occupational Exposures Via the Balanced One-Way Random Effects ANOVA Model , 1997 .

[9]  J. Michael Reed,et al.  Biologically Significant Population Declines and Statistical Power , 1997 .

[10]  F. Juanes,et al.  The importance of statistical power analysis: an example from Animal Behaviour , 1996, Animal Behaviour.

[11]  Student BELIEF IN THE LAW OF SMALL NUMBERS , 1994 .

[12]  Jacob Cohen,et al.  A power primer. , 1992, Psychological bulletin.

[13]  Peter G. Fairweather,et al.  Statistical Power and Design Requirements for Environmental Monitoring , 1991 .

[14]  R. Green,et al.  Power analysis and practical strategies for environmental monitoring. , 1989, Environmental research.

[15]  M. Oakes Statistical Inference: A Commentary for the Social and Behavioural Sciences , 1986 .

[16]  P. Kelly,et al.  Geometry and Convexity: A Study in Mathematical Methods , 1979 .

[17]  W. Watson,et al.  Enforcement of Environmental Standards and the Central Limit Theorem , 1976 .