Eliciting Dirichlet and Connor–Mosimann prior distributions for multinomial models

This paper addresses the task of eliciting an informative prior distribution for multinomial models. We first introduce a method of eliciting univariate beta distributions for the probability of each category, conditional on the probabilities of other categories. Two different forms of multivariate prior are derived from the elicited beta distributions. First, we determine the hyperparameters of a Dirichlet distribution by reconciling the assessed parameters of the univariate beta conditional distributions. Although the Dirichlet distribution is the standard conjugate prior distribution for multinomial models, it is not flexible enough to represent a broad range of prior information. Second, we use the beta distributions to determine the parameters of a Connor–Mosimann distribution, which is a generalization of a Dirichlet distribution and is also a conjugate prior for multinomial models. It has a larger number of parameters than the standard Dirichlet distribution and hence a more flexible structure. The elicitation methods are designed to be used with the aid of interactive graphical user-friendly software.

[1]  A. O'Hagan,et al.  Statistical Methods for Eliciting Probability Distributions , 2005 .

[2]  C. Read,et al.  Handbook of the normal distribution , 1982 .

[3]  Byron Hall Bayesian Inference , 2011 .

[4]  Robert H. Lochner,et al.  A Generalized Dirichlet Distribution in Bayesian Life Testing , 1975 .

[5]  M. Tremblay,et al.  Effects of measurement on obesity and morbidity. , 2008, Health reports.

[6]  R. Hankin A Generalization of the Dirichlet Distribution , 2010 .

[7]  D. Fan The distribution of the product of independent beta variables , 1991 .

[8]  J. Kadane,et al.  Experiences in elicitation , 1998 .

[9]  Jeremy E. Oakley,et al.  Uncertain Judgements: Eliciting Experts' Probabilities , 2006 .

[10]  Arjun K. Gupta,et al.  Handbook of beta distribution and its applications , 2004 .

[11]  Robert J. Connor,et al.  Concepts of Independence for Proportions with a Generalization of the Dirichlet Distribution , 1969 .

[12]  D. Lindley Kendall's Advanced Theory of Statistics, volume 2B, Bayesian Inference, 2nd edn , 2005 .

[13]  Laurence V. Madden,et al.  Some methods for eliciting expert knowledge of plant disease epidemics and their application in cluster sampling for disease incidence , 2002 .

[14]  George T. Duncan,et al.  Some properties of the dirichlet-multinomial distribution and its use in prior elicitation , 1987 .

[15]  Tzu-Tsung Wong,et al.  Generalized Dirichlet distribution in Bayesian analysis , 1998, Appl. Math. Comput..

[16]  Derek W. Bunn,et al.  Estimation of a Dirichlet prior distribution , 1978 .

[17]  H. Raiffa,et al.  Introduction to Statistical Decision Theory , 1996 .

[18]  Tom Leonard,et al.  Bayesian Estimation Methods for Two‐Way Contingency Tables , 1975 .

[19]  Jim Albert,et al.  Mixtures of Dirichlet Distributions and Estimation in Contingency Tables , 1982 .

[20]  W. Rayens,et al.  Dependence Properties of Generalized Liouville Distributions on the Simplex , 1994 .

[21]  Tzu-Tsung Wong A BAYESIAN APPROACH EMPLOYING GENERALIZED DIRICHLET PRIORS IN PREDICTING MICROCHIP YIELDS , 2005 .

[22]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[23]  John Aitchison,et al.  The Statistical Analysis of Compositional Data , 1986 .