The Bayes / Non-Bayes Compromise : A Brief

Some forms of compromise between Bayesian and nonBayesian statistics date back perhaps to Laplace, but the concept of such a compromise seems to have been not fully explicit until much more recently. There is an analogy with the explicit way in which Egon Pearson introduced the nonnull hypotheses and the earlier and less explicit use by Fisher. Pearson ( 1939, p. 242) acknowledged that a letter from "Student" had stimulated him to be more explicit about non-null hypotheses than was customary among P value devotees, and that this suggestion "formed the basis of all the later joint researches of Neyman and myself." Student was very familiar with Bayes's theorem, which uses explicit nonnull hypotheses. So the influence of Bayesianism on the Neyman-Pearson technique seems to have been fairly direct. An explicit mention of the compromise was published 35 years ago, hidden in a paper on saddle-point methods (Good 1957, pp. 862-863). The basic idea was that a Bayesian model not necessarily a good one, could be used to compute a Bayes factor F against a (sharp or point) null hypothesis, and that F then could be used as a significance criterion; that is, its distribution under the null hypothesis could be used for computing P values. A subsidiary suggestion was that F should lie in the range

[1]  J. Polkinghorne,et al.  The Development and Meaning of Eddington's Fundamental Theory , 1958 .

[2]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[3]  J. F. Crook,et al.  The Bayes/Non-Bayes Compromise and the Multinomial Distribution , 1974 .

[4]  W. Pelz Topics on the estimation of small probabilities. , 1977 .

[5]  Leonard J. Savage,et al.  The Foundations of Statistics Reconsidered , 1961 .

[6]  C. Kilmister,et al.  Men of Physics: Sir Arthur Eddington , 1968 .

[7]  D. Lindley A STATISTICAL PARADOX , 1957 .

[8]  I. Good C148. Probability estimation by maximum penalized likelhood for large contingency tables and for other categorical data , 1983 .

[9]  I. Good C378. Comments concerning the hadron quantal hypothesis , 1990 .

[10]  S. S. Wilks The Large-Sample Distribution of the Likelihood Ratio for Testing Composite Hypotheses , 1938 .

[11]  I. Good A Bayesian Significance Test for Multinomial Distributions , 1967 .

[12]  Irving John Good,et al.  The Interface Between Statistics and Philosophy of Science , 1988 .

[13]  C. Kilmister The Development and Meaning of Eddington's "Fundamental Theory" , 1959, The Mathematical Gazette.

[14]  I. Good Maximum Entropy for Hypothesis Formulation, Especially for Multidimensional Contingency Tables , 1963 .

[15]  I. Good Saddle-point Methods for the Multinomial Distribution , 1957 .

[16]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[17]  N. J. A. Sloane,et al.  Sphere Packings, Lattices and Groups , 1987, Grundlehren der mathematischen Wissenschaften.

[18]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[19]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[20]  I. Good A Quantal Hypothesis for Hadrons and the Judging of Physical , 2007 .

[21]  G. Box Sampling inference, Bayes’ inference, and robustness in the advancement of learning , 1980 .

[22]  I. Good C317. The theorem of corroboration and undermining, and popper's demarcation rule , 1989 .

[23]  I. Good On the Application of Symmetric Dirichlet Distributions and their Mixtures to Contingency Tables , 1976 .

[24]  A. R. Thatcher,et al.  Relationships between Bayesian and Confidence Limits for Predictions , 1964 .

[25]  E. S. Pearson WILLIAM SEALY GOSSET, 1876-1937(2) “STUDENT” AS STATISTICIAN , 1939 .

[26]  P. Libby The Scientific American , 1881, Nature.

[27]  E. S. Pearson,et al.  On the Problem of the Most Efficient Tests of Statistical Hypotheses , 1933 .

[28]  C. Quigg Elementary Particles and Forces. , 1985 .

[29]  I. Good The Bayes Factor Against Equiprobability of a Multinomial Population Assuming a Symmetric Dirichlet Prior , 1975 .

[30]  W. Jefferys Bayesian Analysis of Random Event Generator Data , 1990 .

[31]  Paul Erdös,et al.  Highly Composite Numbers , 1915 .

[32]  P. Paufler Tensor properties of crystals , 1996 .

[33]  J. F. Crook,et al.  The Powers and Strengths of Tests for Multinomials and Contingency Tables , 1982 .

[34]  Jie W Weiss,et al.  Bayesian Statistical Inference for Psychological Research , 2008 .

[35]  Michael B. Green,et al.  Anomaly-free chiral theories in six dimensions , 1985 .

[36]  A. Birnbaum On the Foundations of Statistical Inference , 1962 .

[37]  M. Degroot,et al.  Information about Hyperparameters in Hierarchical Models , 1981 .

[38]  R. A. Gaskins,et al.  Nonparametric roughness penalties for probability densities , 2022 .

[39]  Hayes,et al.  Review of particle properties. , 1978, Physical review. D, Particles and fields.

[40]  John W. Pratt,et al.  Bayesian Interpretation of Standard Inference Statements , 1965 .

[41]  I. Good,et al.  Density Estimation and Bump-Hunting by the Penalized Likelihood Method Exemplified by Scattering and Meteorite Data , 1980 .

[42]  Kathrin Friedrich Arthur Stanley Eddington. , 1983 .

[43]  G. A. Barnard,et al.  Student: A Statistical Biography of William Sealy Gosset , 1990 .

[44]  E. S. Pearson "Student" as Statistician , 1939 .