On misinterpretations of pseudoreplication and related matters: a reply to Oksanen

Pseudoreplication has become a widely accepted label for a certain class of statistical error common in the literature of ecology as well as of other fields. A wide-ranging critique by L. Oksanen recently published in this journal criticizes the term and concept and concludes it to be a “pseudoissue,” one reflecting an intellectual disease, “a totally outdated epistemology” known as “inductionism.” The present article addresses some of Oksanen's complaints. His critique is based on a misconception of pseudoreplication, reflects unawareness of most of the literature on the topic, and mistakenly argues that the seriousness of the error is a function of whether an experiment is conducted in an inductive or deductive spirit. Oksanen's advocacy of using resources available for large scale ecology more for large numbers of experiments with unreplicated treatments than for fewer experiments with modest replication of treatments is unrealistic. It is based on an overly optimistic view of the ability of a meta-analysis to compensate for deficiencies, such as very noisy estimates of treatment effects, of the individual studies that are fed into it. A definition is offered of the term manipulative experiment, since adequate ones are lacking in the literature. Attention is called to the fact that for certain types of manipulative experiments lacking treatment replication, there are valid ways to test for treatment effects.

[1]  Kenneth Petren,et al.  Experimental Ecology: Issues and Perspectives , 1999 .

[2]  Celia M. Lombardi,et al.  Sunfish cognition and pseudoreplication , 1996, Animal Behaviour.

[3]  P. Petraitis,et al.  Experimental Design and Data Analysis for Biologists , 2002 .

[4]  Nelson G. Hairston,et al.  Ecological Experiments: Purpose, Design and Execution , 1989 .

[5]  R. Mead,et al.  The Design of Experiments. , 1989 .

[6]  J. I The Design of Experiments , 1936, Nature.

[7]  Stuart H. Hurlbert,et al.  EXPERIMENTS WITH FRESHWATER INVERTEBRATE ZOOPLANKTIVORES: QUALITY OF STATISTICAL ANALYSES , 1993 .

[8]  Donald E. Kroodsma,et al.  Suggested experimental designs for song playbacks , 1989, Animal Behaviour.

[9]  D. Jamieson Interpretation and Explanation in the Study of Animal Behavior , 2021 .

[10]  Stuart H Hurlbert,et al.  Pseudoreplication, fungi, and locusts. , 2003, Journal of economic entomology.

[11]  Donald E. Kroodsma Inappropriate experimental designs impede progress in bioacoustic research: A reply , 1989, Animal Behaviour.

[12]  A. J. Underwood,et al.  Experiments in Ecology. , 1997 .

[13]  R. Mead,et al.  The Design of Experiments , 1989 .

[14]  Karl Cottenie,et al.  Comment to Oksanen (2001): reconciling Oksanen (2001) and Hurlbert (1984) , 2003 .

[15]  Clifford Ambrose Truesdell,et al.  Great Scientists of Old As Heretics in "the Scientific Method" , 1987 .

[16]  Gene E. Likens,et al.  Effects of Forest Cutting and Herbicide Treatment on Nutrient Budgets in the Hubbard Brook Watershed-Ecosystem , 1970 .

[17]  Jessica Gurevitch,et al.  Design and Analysis of Ecological Experiments , 1993 .

[18]  D. Schindler,et al.  Eutrophication of Lake 227, Experimental Lakes Area, Northwestern Ontario, by Addition of Phosphate and Nitrate , 1971 .

[19]  E. David Ford,et al.  Scientific Method for Ecological Research , 2000 .

[20]  Lauri Oksanen,et al.  Logic of experiments in ecology: is pseudoreplication a pseudoissue? , 2001 .

[21]  Celia M. Lombardi,et al.  Design and Analysis: Uncertain Intent, Uncertain Result , 2003 .

[22]  J. Reid Experimental Design and Data Analysis for Biologists , 2003 .

[23]  S. Hurlbert Pseudoreplication and the Design of Ecological Field Experiments , 1984 .

[24]  S. H. Jenkins Data pooling and type I errors: a comment on Leger & Didrichsons , 2002, Animal Behaviour.