Improved auxiliary mixture sampling for hierarchical models of non-Gaussian data

The article considers Bayesian analysis of hierarchical models for count, binomial and multinomial data using efficient MCMC sampling procedures. To this end, an improved method of auxiliary mixture sampling is proposed. In contrast to previously proposed samplers the method uses a bounded number of latent variables per observation, independent of the intensity of the underlying Poisson process in the case of count data, or of the number of experiments in the case of binomial and multinomial data. The bounded number of latent variables results in a more general error distribution, which is a negative log-Gamma distribution with arbitrary integer shape parameter. The required approximations of these distributions by Gaussian mixtures have been computed. Overall, the improvement leads to a substantial increase in efficiency of auxiliary mixture sampling for highly structured models. The method is illustrated for finite mixtures of generalized linear models and an epidemiological case study.

[1]  Ludwig Fahrmeir,et al.  A geoadditive Bayesian latent variable model for Poisson indicators , 2006 .

[2]  Christian P. Robert,et al.  Monte Carlo Statistical Methods (Springer Texts in Statistics) , 2005 .

[3]  S. Frühwirth-Schnatter,et al.  Auxiliary mixture sampling for parameter-driven models of time series of counts with applications to state space modelling , 2006 .

[4]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo in Practice: A Roundtable Discussion , 1998 .

[5]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[6]  Hoon Kim,et al.  Monte Carlo Statistical Methods , 2000, Technometrics.

[7]  Sylvia Frühwirth-Schnatter,et al.  Auxiliary mixture sampling with applications to logistic models , 2007, Comput. Stat. Data Anal..

[8]  C. Holmes,et al.  Bayesian auxiliary variable models for binary and multinomial regression , 2006 .

[9]  J. Hilbe.  Negative Binomial Regression: Preface , 2007 .

[10]  Siddhartha Chib,et al.  Stochastic Volatility with Leverage: Fast Likelihood Inference , 2004 .

[11]  C. Robert,et al.  Estimating Mixtures of Regressions , 2003 .

[12]  P. Green.  Discussion of 'Bayesian image restoration with two applications in spatial statistics' by J Besag, J C York & A Mollie , 1991 .

[13]  Geoffrey J. McLachlan,et al.  Finite Mixture Models , 2019, Annual Review of Statistics and Its Application.

[14]  D. McFadden.  Conditional logit analysis of qualitative choice behavior , 1972 .

[15]  Sylvia Frühwirth-Schnatter,et al.  Computational Statistics and Data Analysis Marginal Likelihoods for Non-gaussian Models Using Auxiliary Mixture Sampling , 2022 .

[16]  N. Shephard,et al.  Markov chain Monte Carlo methods for stochastic volatility models , 2002 .

[17]  Monica Chiogna,et al.  Dynamic generalized linear models with application to environmental epidemiology , 2002 .

[18]  Leonhard Knorr-Held,et al.  Disease Mapping of Stage‐Specific Cancer Incidence Data , 2002, Biometrics.

[19]  S. Chib,et al.  Bayesian analysis of binary and polychotomous response data , 1993 .

[20]  L Knorr-Held,et al.  Bayesian Detection of Clusters and Discontinuities in Disease Maps , 2000, Biometrics.

[21]  J. Besag,et al.  Bayesian image restoration, with two applications in spatial statistics , 1991 .

[22]  S. L. Scott.  Data augmentation, frequentist estimation, and the Bayesian analysis of multinomial logit models , 2011 .

[23]  Leonhard Held,et al.  Joint spatial analysis of gastrointestinal infectious diseases , 2006, Statistical methods in medical research.

[24]  L. Held,et al.  Towards joint disease mapping , 2005, Statistical methods in medical research.

[25]  H. Rue,et al.  On Block Updating in Markov Random Field Models for Disease Mapping , 2002 .

[26]  Charles J. Geyer,et al.  Practical Markov Chain Monte Carlo , 1992 .

[27]  Murray Aitkin,et al.  A general maximum likelihood analysis of overdispersion in generalized linear models , 1996, Stat. Comput..

[28]  N. Shephard,et al.  Stochastic volatility with leverage: Fast and efficient likelihood inference , 2007 .

[29]  Leonhard Held,et al.  Gaussian Markov Random Fields: Theory and Applications , 2005 .

[30]  N. Shephard.  Partial non-Gaussian state space , 1994 .

[31]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[32]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[33]  R. Tüchler.  Bayesian Variable Selection for Logistic Models Using Auxiliary Mixture Sampling , 2008 .

[34]  Manfred M. Fischer,et al.  Knowledge Spillovers across Europe. Evidence from a Poisson Spatial Interaction Model with Spatial Effects , 2015 .

[35]  P. Green,et al.  Bayesian Analysis of Poisson Mixtures , 2002 .

[36]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[37]  Claudia Czado,et al.  Does a Gibbs sampler approach to spatial Poisson regression models outperform a single site MH sampler? , 2008, Comput. Stat. Data Anal..

[38]  N. Shephard,et al.  Stochastic Volatility: Likelihood Inference And Comparison With Arch Models , 1996 .