Testing Precise Hypotheses

Testing of precise (point or small interval) hypotheses is reviewed, with special emphasis placed on exploring the dramatic conflict between conditional measures (Bayes factors and posterior probabilities) and the classical P-value (or observed significance level). This conflict is highlighted by finding lower bounds on the conditional measures over wide classes of priors, in normal and binomial situations, lower bounds, which are much larger than the P-value; this leads to the recommendation of several alter- natives to P-values. Results are also given concerning the validity of approximating an interval null by a point null. The overall discussion features critical examination of issues such as the probability of objective testing and the possibility of testing from confidence sets.

[1]  N. Campbell,et al.  Scientific Inference , 1931, Nature.

[2]  L. Stein,et al.  Probability and the Weighing of Evidence , 1950 .

[3]  J. L. Hodges,et al.  Testing the Approximate Validity of Statistical Hypotheses , 1954 .

[4]  D. Lindley.  A STATISTICAL PARADOX , 1957 .

[5]  I. Good.  Significance Tests in Parallel and in Series , 1958 .

[6]  D. Lindley.  The Use of Prior Probability Distributions in Statistical Inference and Decisions , 1961 .

[7]  H. Raiffa,et al.  Applied Statistical Decision Theory. , 1961 .

[8]  Clifford Hildrethi.  BAYESIAN STATISTICIANS AND REMOTE CLIENTS , 1963 .

[9]  Irving John Good,et al.  The Estimation of Probabilities: An Essay on Modern Bayesian Methods , 1965 .

[10]  Cedric A. B. Smith,et al.  Personal Probability and Statistical Analysis , 1965 .

[11]  John W. Pratt,et al.  Bayesian Interpretation of Standard Inference Statements , 1965 .

[12]  William Mendenhall,et al.  Introduction to Probability and Statistics , 1961, The Mathematical Gazette.

[13]  J. Dickey.  The Weighted Likelihood Ratio, Linear Hypotheses on Normal Location Parameters , 1971 .

[14]  H. Rubin.  A DECISION-THEORETIC APPROACH TO THE PROBLEM OF TESTING A NULL HYPOTHESIS , 1971 .

[15]  A. Zellner.  An Introduction to Bayesian Inference in Econometrics , 1971 .

[16]  K. Gaver,et al.  Posterior probabilities of alternative linear models , 1971 .

[17]  M. Degroot.  Doing What Comes Naturally: Interpreting a Tail Area as a Posterior Probability or as a Likelihood Ratio , 1973 .

[18]  James M. Dickey,et al.  Scientific Reporting and Personal Probabilities: Student's Hypothesis , 1973 .

[19]  J. Dickey.  Approximate Posterior Distributions , 1976 .

[20]  J. Dickey.  Is the Tail Area Useful as an Approximate Bayes Factor , 1977 .

[21]  Edward E. Leamer,et al.  Specification Searches: Ad Hoc Inference with Nonexperimental Data , 1980 .

[22]  Allan H. Seheult,et al.  On a problem in forensic science , 1978 .

[23]  J. Bernardo.  A Bayesian analysis of classical hypothesis testing , 1980 .

[24]  D. Spiegelhalter,et al.  Bayes Factors and Choice Criteria for Linear Models , 1980 .

[25]  A. Zellner,et al.  Posterior odds ratios for selected regression hypotheses , 1980 .

[26]  A. Zellner.  Posterior odds ratios for regression hypotheses : General considerations and some specific results , 1981 .

[27]  B. M. Hill.  Lindley's Paradox: Comment , 1982 .

[28]  G. Shafer.  Lindley's Paradox , 1982 .

[29]  I. Good.  Good Thinking: The Foundations of Probability and Its Applications , 1983 .

[30]  G A Diamond,et al.  Clinical trials and statistical verdicts: probable grounds for appeal. , 1983, Annals of internal medicine.

[31]  R. Wolpert,et al.  Likelihood Principle , 2022, The SAGE Encyclopedia of Research Design.

[32]  I. J. Good,et al.  C272. A flexible bayesian model for comparing two treatments , 1986 .

[33]  J. Berger,et al.  Testing a Point Null Hypothesis: The Irreconcilability of P Values and Evidence , 1987 .

[34]  G. Casella,et al.  Reconciling Bayesian and Frequentist Evidence in the One-Sided Testing Problem , 1987 .

[35]  James O. Berger,et al.  The Relevance of Stopping Rules in Statistical Inference , 1988 .

[36]  J. Berger.  Statistical Decision Theory and Bayesian Analysis , 1988 .

[37]  Mohan Delampady,et al.  Lower bounds on Bayes factors for invariant testing situations , 1989 .

[38]  Mohan Delampady,et al.  Lower Bounds on Bayes Factors for Interval Null Hypotheses , 1989 .