Approximating the marginal likelihood in mixture models

In Chib (1995), a method for approximating marginal densities in a Bayesian setting is proposed, with one proeminent application being the estimation of the number of components in a normal mixture. As pointed out in Neal (1999) and Fruhwirth-Schnatter (2004), the approximation often fails short of providing a proper approximation to the true marginal densities because of the well-known label switching problem (Celeux et al., 2000). While there exist other alternatives to the derivation of approximate marginal densities, we reconsider the original proposal here and show as in Berkhof et al. (2003) and Lee et al. (2008) that it truly approximates the marginal densities once the label switching issue has been solved.

[1]  P. Green,et al.  On Bayesian Analysis of Mixtures with an Unknown Number of Components (with discussion) , 1997 .

[2]  G. Casella,et al.  Mixture models, latent variables and partitioned importance sampling , 2004 .

[3]  Ajay Jasra,et al.  Markov Chain Monte Carlo Methods and the Label Switching Problem in Bayesian Mixture Modeling , 2005 .

[4]  C. Robert,et al.  Computational and Inferential Difficulties with Mixture Posterior Distributions , 2000 .

[5]  Jean-Michel Marin,et al.  Bayesian Modelling and Inference on Mixtures of Distributions , 2005 .

[6]  Adrian F. M. Smith,et al.  Sampling-Based Approaches to Calculating Marginal Densities , 1990 .

[7]  J. Forster.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions - Discussion , 2003 .

[8]  G. Roberts,et al.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions , 2003 .

[9]  J. Diebolt,et al.  Estimation des paramètres d'un mélange par échantillonage bayésien , 1990 .

[10]  P. McCullagh,et al.  A theory of statistical models for Monte Carlo integration , 2003 .

[11]  C. Robert,et al.  Contemplating Evidence: properties, extensions of, and alternatives to Nested Sampling , 2008 .

[12]  W. Michael Conklin,et al.  Monte Carlo Methods in Bayesian Computation , 2001, Technometrics.

[13]  S. Chib.  Marginal Likelihood from the Gibbs Output , 1995 .

[14]  K. Roeder.  Density estimation with confidence sets exemplified by superclusters and voids in the galaxies , 1990 .

[15]  S. Frühwirth-Schnatter.  Estimating Marginal Likelihoods for Mixture and Markov Switching Models Using Bridge Sampling Techniques , 2004 .

[16]  Sylvia Frühwirth-Schnatter,et al.  Finite Mixture and Markov Switching Models , 2006 .

[17]  Jean-Michel Marin,et al.  Convergence of Adaptive Sampling Schemes , 2004 .

[18]  Jean-Michel Marin,et al.  Bayesian Inference on Mixtures of Distributions , 2008, 0804.2413.

[19]  R. Douc,et al.  Convergence of Adaptive Sampling Schemes , 2007, 0708.0711.

[20]  Iven Van Mechelen,et al.  A Bayesian approach to the selection and testing of mixture models , 2003 .