Biological importance and statistical significance.

Statistical ideas behind the analysis of experiments related to crop composition and the genetic factors underlying composition are discussed. The emphasis is on concepts rather than statistical formulations. Statistical analysis and biological considerations are shown to be complementary rather than contradictory, in that the statistical analysis of a data set depends on the experimental design, that no amount of statistical sophistication can rescue a badly designed study, and that good experimental design is crucial. The traditional null hypothesis significance testing approach has severe limitations, but p values and statistical significance still often seem to be the primary objective of an analysis. Emphasis instead should be on identifying the size of effects that are biologically important and, with the involvement of the "domain" scientist, using these to help design experiments with appropriate sample sizes and statistical power. The issues discussed here are also directly applicable to other areas of research.

[1]  Newton E. Morton,et al.  Fisher, the life of a scientist. , 1979 .

[2]  D G Altman,et al.  Statistics notes: Absence of evidence is not evidence of absence , 1995 .

[3]  E. S. Pearson,et al.  ON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE PART I , 1928 .

[4]  Douglas G. Altman,et al.  Practical statistics for medical research , 1990 .

[5]  Frank Yates,et al.  The Influence of Statistical Methods for Research Workers on the Development of the Science of Statistics , 1951 .

[6]  D G Altman,et al.  Absence of evidence is not evidence of absence. , 1996, Australian veterinary journal.

[7]  R. Hubbard,et al.  Why P Values Are Not a Useful Measure of Evidence in Statistical Significance Testing , 2008 .

[8]  Sidney Addelman,et al.  trans-Dimethanolbis(1,1,1-trifluoro-5,5-dimethylhexane-2,4-dionato)zinc(II) , 2008, Acta crystallographica. Section E, Structure reports online.

[9]  Adrian F. M. Smith.  Mad cows and ecstasy : Chance and choice in an evidence-based society , 1996 .

[10]  D. Rindskopf.  Null-hypothesis tests are not completely stupid, but Bayesian statistics are better , 1998, Behavioral and Brain Sciences.

[11]  R. Fisher.  Statistical methods for research workers , 1927, Protoplasma.

[12]  Heidi Ledford,et al.  Language: Disputed definitions , 2008, Nature.

[13]  M. Gardner,et al.  Confidence intervals rather than P values: estimation rather than hypothesis testing. , 1986, British medical journal.

[14]  J. Brooks.  Why most published research findings are false: Ioannidis JP, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, Ioannina, Greece , 2008 .

[15]  F. Yates.  Design and Analysis of Factorial Experiments , 1958 .

[16]  D. Salsburg.  The lady tasting tea : how statistics revolutionized science in the twentieth century , 2002 .

[17]  D G Altman,et al.  Statistics in medical journals. , 1982, Statistics in medicine.

[18]  J L Moran,et al.  A farewell to P-values. , 2004, Critical care and resuscitation : journal of the Australasian Academy of Critical Care Medicine.

[19]  S. Pocock,et al.  Clinical trials with multiple outcomes: a statistical perspective on their design, analysis, and interpretation. , 1997, Controlled clinical trials.

[20]  J. Rick Turner.  New Drug Development , 2007 .

[21]  W. Krämer.  The cult of statistical significance tests , 2010 .

[22]  David Cox,et al.  Applied Statistics - Principles and Examples , 1981 .

[23]  D. J. Finney,et al.  Life of a Scientist , 1979, Asia-Pacific Biotech News.

[24]  J. Perry,et al.  Multiple-comparison procedures: a dissenting view. , 1986, Journal of economic entomology.

[25]  D. Mccloskey,et al.  The Cult of Statistical Significance: How the Standard Error Costs Us Jobs, Justice, and Lives , 2008 .

[26]  P. McCullagh,et al.  Generalized Linear Models , 1984 .

[27]  John B. Carlin,et al.  Statistics for clinicians: 7: Sample size , 2002 .

[28]  F. Fidler.  From Statistical Significance to Effect Estimation: Statistical Reform in Psychology, Medicine and Ecology , 2018 .

[29]  S. Senn.  Two cheers for P-values? , 2001, Journal of epidemiology and biostatistics.

[30]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[31]  John W. Tukey,et al.  Exploratory Data Analysis. , 1979 .

[32]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[33]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[34]  D. Altman,et al.  Confidence intervals illuminate absence of evidence , 2004, BMJ : British Medical Journal.

[35]  David M. Reif,et al.  Profiling Chemicals Based on Chronic Toxicity Results from the U.S. EPA ToxRef Database , 2008, Environmental health perspectives.

[36]  W. D. Price,et al.  Application of laws, policies, and guidance from the United States and Canada to the regulation of food and feed derived from genetically modified crops: interpretation of composition data. , 2013, Journal of agricultural and food chemistry.

[37]  Giovanni Montana,et al.  Statistical methods in genetics , 2006, Briefings Bioinform..

[38]  Esther J Kok,et al.  Substantial equivalence--an appropriate paradigm for the safety assessment of genetically modified foods? , 2002, Toxicology.

[39]  Russell V. Lenth,et al.  Some Practical Guidelines for Effective Sample Size Determination , 2001 .

[40]  Seamus Heaney,et al.  Open Letter , 1977 .

[41]  George G Harrigan,et al.  Introduction to Bayesian statistical approaches to compositional analyses of transgenic crops 1. Model validation and setting the stage. , 2011, Regulatory toxicology and pharmacology : RTP.

[42]  R. A. Fisher,et al.  Statistical Tables for Biological, Agricultural and Medical Research , 1956 .

[43]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[44]  Jack Meadows,et al.  Editorial Peer Review: Its Strengths and Weaknesses , 2002, J. Documentation.

[45]  A. Edwards.  R. A. Fisher. Twice professor of genetics: London and Cambridge or "a fairly well-known geneticist". , 1990, Biometrics.

[46]  Jacob Cohen.  The earth is round (p < .05) , 1994 .