On Some Assumptions of the Null Hypothesis Statistical Testing

Bayesian and classical statistical approaches are based on different types of logical principles. In order to avoid mistaken inferences and misguided interpretations, the practitioner must respect the inference rules embedded into each statistical method. Ignoring these principles leads to the paradoxical conclusions that the hypothesis μ 1 = μ 2 could be less supported by the data than a more restrictive hypothesis such as μ 1 = μ 2 = 0 , where μ 1 and μ 2 are two population means. This article intends to discuss and explicit some important assumptions inherent to classical statistical models and null statistical hypotheses. Furthermore, the definition of the p-value and its limitations are analyzed. An alternative measure of evidence, the s-value, is discussed. This article presents the steps to compute s-values and, in order to illustrate the methods, some standard examples are analyzed and compared with p-values. The examples denunciate that p-values, as opposed to s-values, fail to hold some logical relations.

[1]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .

[2]  A. G. Patriota A measure of evidence based on the likelihood-ratio statistics , 2015, Statistical Papers.

[3]  Carlos Alberto de Bragança Pereira,et al.  RELATIONSHIP BETWEEN BAYESIAN AND FREQUENTIST SIGNIFICANCE INDICES , 2012 .

[4]  Anthony C. Atkinson,et al.  Plots, transformations, and regression : an introduction to graphical methods of diagnostic regression analysis , 1987 .

[5]  M. Schervish,et al.  Bayes Factors: What They are and What They are Not , 1999 .

[6]  F. Y. Edgeworth,et al.  The theory of statistics , 1996 .

[7]  M. Schervish P Values: What They are and What They are Not , 1996 .

[8]  R. Fisher,et al.  The Logic of Inductive Inference , 1935 .

[9]  D. Mayo,et al.  Severe Testing as a Basic Concept in a Neyman–Pearson Philosophy of Induction , 2006, The British Journal for the Philosophy of Science.

[10]  R. Cook Assessment of Local Influence , 1986 .

[11]  Arthur P. Dempster,et al.  A Generalization of Bayesian Inference , 1968, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[12]  Rafael Izbicki,et al.  Logical consistency in simultaneous statistical test procedures , 2015, Log. J. IGPL.

[13]  T. Tao Compactness and Contradiction , 2013 .

[14]  D. Cox,et al.  Frequentist statistics as a theory of inductive inference , 2006, math/0610846.

[15]  K. Bollen Latent variables in psychology and the social sciences. , 2002, Annual review of psychology.

[16]  J. Berger,et al.  Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence , 1987 .

[17]  D. Trafimow Hypothesis testing and theory evaluation at the boundaries: surprising insights from Bayes's theorem. , 2003, Psychological review.

[18]  R. Cook Detection of influential observation in linear regression , 2000 .

[19]  Alexandre Galvão Patriota,et al.  A Confidence Set Analysis for Observed Samples: A Fuzzy Set Approach , 2016, Entropy.

[20]  R. Fisher,et al.  STATISTICAL METHODS AND SCIENTIFIC INDUCTION , 1955 .

[21]  A. Hájek Arguments for–or against–Probabilism? , 2008, The British Journal for the Philosophy of Science.

[22]  Oscar Kempthore,et al.  Of what use are tests of significance and tests of hypothesis , 1976 .

[23]  Stephen E. Fienberg,et al.  Testing Statistical Hypotheses , 2005 .

[24]  M. Bensebti,et al.  Statistical Model , 2005 .

[25]  J. Kadane Principles of Uncertainty , 2011 .

[26]  Alexandre G. Patriota,et al.  A classical measure of evidence for general null hypotheses , 2012, Fuzzy Sets Syst..

[27]  R. Fisher,et al.  On the Mathematical Foundations of Theoretical Statistics , 1922 .

[28]  George Casella,et al.  Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence: Rejoinder , 1987 .

[29]  M. Schervish Theory of Statistics , 1995 .

[30]  M. J. Bayarri,et al.  Confusion Over Measures of Evidence (p's) Versus Errors (α's) in Classical Statistical Testing , 2003 .

[31]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .