A transdimensional approximate Bayesian computation using the pseudo-marginal approach for model choice

When the likelihood functions are either unavailable analytically or are computationally cumbersome to evaluate, it is impossible to implement conventional Bayesian model choice methods. Instead, approximate Bayesian computation (ABC) or the likelihood-free method can be used in order to avoid direct evaluation of the intractable likelihoods. This paper proposes a new Markov chain Monte Carlo (MCMC) method for model choice. This method is based on the pseudo-marginal approach and is appropriate for situations where the likelihood functions for the competing models are intractable. This method proposes jumps between the models with different dimensionalities without matching the dimensionalities. Therefore, it enables the construction of a flexible proposal distribution. The proposal distribution used in this paper is convenient to implement and works well in the context of ABC. Because the posterior model probabilities can be estimated simultaneously, it is expected that the proposed method will be useful, especially when the number of competing models is large. In the simulation study, a comparison between the proposed and existing methods is presented. The method is then applied to the model choice problem for an exchange return model.

[1]  J.-M. Marin,et al.  Relevant statistics for Bayesian model choice , 2011, 1110.4700.

[2]  M. Newton Approximate Bayesian-inference With the Weighted Likelihood Bootstrap , 1994 .

[3]  Radford M. Neal Annealed importance sampling , 1998, Stat. Comput..

[4]  David Allingham,et al.  Bayesian estimation of quantile distributions , 2009, Stat. Comput..

[5]  C. Andrieu,et al.  The pseudo-marginal approach for efficient Monte Carlo computations , 2009, 0903.5480.

[6]  M. Beaumont Estimation of population growth or decline in genetically monitored populations. , 2003, Genetics.

[7]  Kjersti Aas,et al.  The Generalized Hyperbolic Skew Student’s t-Distribution , 2006 .

[8]  Guillaume Laval,et al.  Statistical Applications in Genetics and Molecular Biology Deviance Information Criteria for Model Selection in Approximate Bayesian Computation , 2011 .

[9]  Christophe Andrieu,et al.  Model criticism based on likelihood-free inference, with an application to protein network evolution , 2009, Proceedings of the National Academy of Sciences.

[10]  S. Chib,et al.  Marginal Likelihood From the Metropolis–Hastings Output , 2001 .

[11]  G. Roberts,et al.  Efficient construction of reversible jump Markov chain Monte Carlo proposal distributions , 2003 .

[12]  G. D. Rayner,et al.  Numerical maximum likelihood estimation for the g-and-k and generalized g-and-h distributions , 2002, Stat. Comput..

[13]  Anthony N. Pettitt,et al.  Likelihood-free Bayesian estimation of multivariate quantile distributions , 2011, Comput. Stat. Data Anal..

[14]  K. Mengersen,et al.  Robustness of ranking and selection rules using generalised g-and-k distributions , 1997 .

[15]  Paul Fearnhead,et al.  Constructing summary statistics for approximate Bayesian computation: semi‐automatic approximate Bayesian computation , 2012 .

[16]  S. Sisson,et al.  Likelihood-free Markov chain Monte Carlo , 2010, 1001.2058.

[17]  Kerrie Mengersen,et al.  Bayesian estimation ofg-and-k distributions using MCMC , 2005, Comput. Stat..

[18]  John Geweke,et al.  Federal Reserve Bank of Minneapolis Research Department Staff Report 249 Using Simulation Methods for Bayesian Econometric Models: Inference, Development, and Communication , 2022 .

[19]  L. Excoffier,et al.  Statistical evaluation of alternative models of human evolution , 2007, Proceedings of the National Academy of Sciences.

[20]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[21]  Richard G. Everitt,et al.  Likelihood-free estimation of model evidence , 2011 .

[22]  Daniel Wegmann,et al.  Bayesian Computation and Model Selection Without Likelihoods , 2010, Genetics.

[23]  Bradley P. Carlin,et al.  Bayesian measures of model complexity and fit , 2002 .

[24]  S. Chib Marginal Likelihood from the Gibbs Output , 1995 .

[25]  Gareth W. Peters,et al.  Likelihood-free Bayesian inference for α-stable models , 2012, Comput. Stat. Data Anal..

[26]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Michael P. H. Stumpf,et al.  Simulation-based model selection for dynamical systems in systems and population biology , 2009, Bioinform..

[28]  Jean-Marie Cornuet,et al.  Inferring population history with DIY ABC: a user-friendly approach to approximate Bayesian computation , 2008, Bioinform..

[29]  C. Robert,et al.  ABC likelihood-free methods for model choice in Gibbs random fields , 2008, 0807.2767.

[30]  P. Neal,et al.  Efficient order selection algorithms for integer‐valued ARMA processes , 2009 .

[31]  Arnaud Doucet,et al.  An adaptive sequential Monte Carlo method for approximate Bayesian computation , 2011, Statistics and Computing.

[32]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[33]  Jean-Michel Marin,et al.  Approximate Bayesian computational methods , 2011, Statistics and Computing.

[34]  J. Møller Discussion on the paper by Feranhead and Prangle , 2012 .

[35]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .