Coupling random inputs for parameter estimation in complex models

Complex stochastic models, such as individual-based models, are becoming increasingly popular. However this complexity can often mean that the likelihood is intractable. Performing parameter estimation on the model can then be difficult. One way of doing this when the complex model is relatively quick to simulate from is approximate Bayesian computation (ABC). Rejection-ABC algorithm is not always efficient so numerous other algorithms have been proposed. One such method is ABC with Markov chain Monte Carlo (ABC–MCMC). Unfortunately for some models this method does not perform well and some alternatives have been proposed including the fsMCMC algorithm (Neal and Huang, in: Scand J Stat 42:378–396, 2015) that explores the random inputs space as well unknown model parameters. In this paper we extend the fsMCMC algorithm and take advantage of the joint parameter and random input space in order to get better mixing of the Markov Chain. We also introduce a Gibbs step that conditions on the current accepted model and allows the parameters to move as well as the random inputs conditional on this accepted model. We show empirically that this improves the efficiency of the ABC–MCMC algorithm on a queuing model and an individual-based model of the group-living bird, the woodhoopoe.

[1]  V. Grimm,et al.  Proposing an information criterion for individual-based models developed in a pattern-oriented modelling framework , 2009 .

[2]  M. A. Plessis,et al.  Obligate cavity-roosting as a constraint on dispersal of green (red-billed) woodhoopoes: consequences for philopatry and the likelihood of inbreeding , 1992, Oecologia.

[3]  Peter Neal,et al.  Forward Simulation Markov Chain Monte Carlo with Applications to Stochastic Epidemic Models , 2015 .

[4]  Jean-Michel Marin,et al.  Approximate Bayesian computational methods , 2011, Statistics and Computing.

[5]  M. Beaumont Approximate Bayesian Computation in Evolution and Ecology , 2010 .

[6]  Michael A. Spence,et al.  Statistical issues in ecological simulation models , 2015 .

[7]  Michael A. Spence,et al.  Bayesian Inference on Individual-Based Models by Controlling the Random Inputs , 2014 .

[8]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Steven F. Railsback,et al.  Agent-Based and Individual-Based Modeling: A Practical Introduction , 2011 .

[10]  Denys Pommeret,et al.  Likelihood-free parallel tempering , 2011, Stat. Comput..

[11]  Peter Neal,et al.  Efficient likelihood-free Bayesian Computation for household epidemics , 2012, Stat. Comput..

[12]  Stephen Lee,et al.  Hybrid confidence regions based on data depth , 2012 .

[13]  K. Heggland,et al.  Estimating functions in indirect inference , 2004 .

[14]  Christian T. K.-H. Stadtländer,et al.  Individual-based modelling and ecology , 2012 .

[15]  Christophe Andrieu,et al.  Some discussions of D. Fearnhead and D. Prangle's Read Paper "Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation" , 2012 .

[16]  Ross McVinish,et al.  Population Monte Carlo Algorithm in High Dimensions , 2011 .

[17]  Mark M. Tanaka,et al.  Sequential Monte Carlo without likelihoods , 2007, Proceedings of the National Academy of Sciences.

[18]  Olivier François,et al.  Non-linear regression models for Approximate Bayesian Computation , 2008, Stat. Comput..

[19]  M. Feldman,et al.  Population growth of human Y chromosomes: a study of Y chromosome microsatellites. , 1999, Molecular biology and evolution.

[20]  Anthony N. Pettitt,et al.  Discussion of : constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation , 2012 .

[21]  J. Møller Discussion on the paper by Feranhead and Prangle , 2012 .

[22]  Anthony Lee,et al.  Variance bounding and geometric ergodicity of Markov chain Monte Carlo kernels for approximate Bayesian computation , 2012, 1210.6703.

[23]  Paul Fearnhead,et al.  Constructing summary statistics for approximate Bayesian computation: semi‐automatic approximate Bayesian computation , 2012 .

[24]  C. Andrieu,et al.  The pseudo-marginal approach for efficient Monte Carlo computations , 2009, 0903.5480.