Are there any differences? A non-sensical question in ecology

One of the main questions that ecologists pose in their investigations includes the analysis of differences in some trait between two or more populations. I argue here that asking whether there are differences or not between populations is biologically irrelevant, since no two livings things are ever equal. On the contrary the appropriate question to pose is how large differences are between populations. That is, we urge a shift in interest from statistical significance to biological relevance for proper knowledge accumulation. I emphasise that to test biologically informative hypotheses from a classical perspective, there are two tools available: (a) the use of a priori power tests; and (b) the use of confidence intervals. Using both ensures that statistical significance and biological relevance are not decoupled, and studies yielding negative results do not need to be discarded balancing the current bias in publishing mostly ‘positive’ results. Complex ecological questions however require the formulation of multiple hypotheses and hence the use of modern alternative tools for ecological statistical inference such as information theoretical criteria and Bayesian statistics.

[1]  G. Quinn,et al.  Experimental Design and Data Analysis for Biologists , 2002 .

[2]  A. Palmer,et al.  QUASIREPLICATION AND THE CONTRACT OF ERROR: Lessons from Sex Ratios, Heritabilities and Fluctuating Asymmetry , 2000 .

[3]  Philip A. Stephens,et al.  Information theory and hypothesis testing: a call for pluralism , 2005 .

[4]  Daniel Oro,et al.  Can ornithology advance as a science relying on significance testing? A literature review in search of a consensus , 2005 .

[5]  James S. Clark,et al.  Why environmental scientists are becoming Bayesians , 2004 .

[6]  Neil Thomason,et al.  Toward improved statistical reporting in the journal of consulting and clinical psychology. , 2005, Journal of consulting and clinical psychology.

[7]  L. Harlow,et al.  What if there were no significance tests , 1997 .

[8]  P. Killeen,et al.  An Alternative to Null-Hypothesis Significance Tests , 2005, Psychological science.

[9]  Neil Thomason,et al.  Impact of Criticism of Null‐Hypothesis Significance Testing on Statistical Reporting Practices in Conservation Biology , 2006, Conservation biology : the journal of the Society for Conservation Biology.

[10]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[11]  David R. Anderson,et al.  Concerns regarding a call for pluralism of information theory and hypothesis testing , 2007 .

[12]  Philip A. Stephens,et al.  Inference in ecology and evolution. , 2007, Trends in ecology & evolution.

[13]  Robert P Freckleton,et al.  Why do we still use stepwise modelling in ecology and behaviour? , 2006, The Journal of animal ecology.

[14]  Jessica Gurevitch,et al.  Design and Analysis of Ecological Experiments , 1993 .

[15]  Philip A. Stephens,et al.  A call for statistical pluralism answered , 2007 .