The Robustness of a Hierarchical Model for Multinomials and Contingency Tables

Publisher Summary This chapter focuses on the robustness of a hierarchical model for multinomial and contingency tables. Hierarchical Bayesian models can be used in a completely Bayesian manner or in a manner that has been called semi-, or pseudo-, or quasi Bayesian. In the latter case, the hyperparameters, or possibly the hyperhyperparameters, etc., are estimated by non-Bayesian methods, or at least by some not purely Bayesian method such as by maximum likelihood. In the so-called non-Bayesian statistics, the use of the Ockham-Duns razor is sometimes called the principle of parsimony, and it encourages one to avoid having more parameters than are necessary. In hierarchical Bayesian methods, one similarly uses a principle of parsimony or hyper-razor. There are at least two different ways to test a model. One is by means of significance tests after observations are made. Another is by examining the robustness of a model, that is, by seeing if small changes in the model lead to small changes in the implications. Tests for robustness can sometimes be carried out by the device of imaginary results before making observations. When calculating a Bayes factor F1, reasonable robustness with respect to the choice of hyperhyperparameters has also been found.

[1]  I. Good C88. An approximation of value in the Bayesian analyses of contingency tables , 1981 .

[2]  H. Jeffreys An invariant form for the prior probability in estimation problems , 1946, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[3]  Wilfred Perks,et al.  Some observations on inverse probability including a new indifference rule , 1947 .

[4]  I. Good On the Application of Symmetric Dirichlet Distributions and their Mixtures to Contingency Tables , 1976 .

[5]  I. Good A Bayesian Significance Test for Multinomial Distributions , 1967 .

[6]  J. F. Crook,et al.  The Bayes/Non-Bayes Compromise and the Multinomial Distribution , 1974 .

[7]  David Lindley,et al.  THE ESTIMATION OF MANY PARAMETERS , 1970 .

[8]  I. Good On the Estimation of Small Frequencies in Contingency Tables , 1956 .

[9]  George E. P. Box,et al.  Sampling and Bayes' inference in scientific modelling and robustness , 1980 .

[10]  C44. Bayes's billiard-table argument extended to multinomials , 1979 .

[11]  D. Lindley,et al.  Bayes Estimates for the Linear Model , 1972 .

[12]  I. Good C94. When is g positive i n the mixed dirichlet approach to contingency tables , 1981 .

[13]  Irving John Good,et al.  The Surprise Index for the Multivariate Normal Distribution , 1956 .

[14]  I. Good Significance Tests in Parallel and in Series , 1958 .

[15]  I. Good C73. The diminishing significance of a p-value as the sample size increases , 1980 .

[16]  I. Good C95. The monte carl0 computation of bayes factors for contingency tables , 1981 .

[17]  I. Good Saddle-point Methods for the Multinomial Distribution , 1957 .

[18]  T. Ferguson Prior Distributions on Spaces of Probability Measures , 1974 .

[19]  Irving John Good,et al.  A Subjective Evaluation of Bode's Law and an ‘Objective’ Test for Approximate Numerical Rationality , 1969 .