Bayesian indirect inference using a parametric auxiliary model

Indirect inference (II) is a methodology for estimating the parameters of an intractable (generative) model on the basis of an alternative parametric (auxiliary) model that is both analytically and computationally easier to deal with. Such an approach has been well explored in the classical literature but has received substantially less attention in the Bayesian paradigm. The purpose of this paper is to compare and contrast a collection of what we call parametric Bayesian indirect inference (pBII) methods. One class of pBII methods uses approximate Bayesian computation (referred to here as ABC II) where the summary statistic is formed on the basis of the auxiliary model, using ideas from II. Another approach proposed in the literature, referred to here as parametric Bayesian indirect likelihood (pBIL), we show to be a fundamentally different approach to ABC II. We devise new theoretical results for pBIL to give extra insights into its behaviour and also its differences with ABC II. Furthermore, we examine in more detail the assumptions required to use each pBII method. The results, insights and comparisons developed in this paper are illustrated on simple examples and two other substantive applications. The first of the substantive examples involves performing inference for complex quantile distributions based on simulated data while the second is for estimating the parameters of a trivariate stochastic process describing the evolution of macroparasites within a host based on real data. We create a novel framework called Bayesian indirect likelihood (BIL) which encompasses pBII as well as general ABC methods so that the connections between the methods can be established.

[1]  A. Pettitt,et al.  Approximate Bayesian computation using indirect inference , 2011 .

[2]  A. Gallant,et al.  Which Moments to Match? , 1995, Econometric Theory.

[3]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[4]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[5]  D. Cox Tests of Separate Families of Hypotheses , 1961 .

[6]  Christopher C. Drovandi Bayesian algorithms with applications , 2012 .

[7]  B. T. Grenfell,et al.  Modelling variability in lymphatic filariasis: macrofilarial dynamics in the Brugia pahangi–cat model , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[8]  J. Møller,et al.  An efficient Markov chain Monte Carlo method for distributions with intractable normalising constants , 2006 .

[9]  H. Scheffé A Useful Convergence Theorem for Probability Distributions , 1947 .

[10]  G. D. Rayner,et al.  Numerical maximum likelihood estimation for the g-and-k and generalized g-and-h distributions , 2002, Stat. Comput..

[11]  Wenxin Jiang,et al.  The Indirect Method: Inference Based on Intermediate Statistics—A Synthesis and Examples , 2004 .

[12]  P. Billingsley,et al.  Convergence of Probability Measures , 1969 .

[13]  R Rogers,et al.  Studies with Brugia pahangi. I. Parasitological observations on primary infections of cats (Felis catus). , 1972, International journal for parasitology.

[14]  Anthony A. Smith,et al.  Estimating Nonlinear Time-Series Models Using Simulated Vector Autoregressions , 1993 .

[15]  Robert E. McCulloch,et al.  On the Determination of General Scientific Models With Application to Asset Pricing , 2009 .

[16]  Zoubin Ghahramani,et al.  MCMC for Doubly-intractable Distributions , 2006, UAI.

[17]  Christl A Donnelly,et al.  Robust parameter estimation techniques for stochastic within-host macroparasite models. , 2003, Journal of theoretical biology.

[18]  M. Blum Approximate Bayesian Computation: A Nonparametric Perspective , 2009, 0904.0635.

[19]  K. Heggland,et al.  Estimating functions in indirect inference , 2004 .

[20]  P. Diggle,et al.  Monte Carlo Methods of Inference for Implicit Statistical Models , 1984 .

[21]  C. Andrieu,et al.  The pseudo-marginal approach for efficient Monte Carlo computations , 2009, 0903.5480.

[22]  A. C. Davison,et al.  Statistical models: Name Index , 2003 .

[23]  R Rogers,et al.  Studies with Brugia pahangi. III: Histological changes in the affected lymph nodes of infected cats. , 1975, Annals of tropical medicine and parasitology.

[24]  Nanny Wermuth,et al.  An approximation to maximum likelihood estimates in reduced models , 1990 .

[25]  Dennis Kristensen,et al.  INDIRECT LIKELIHOOD INFERENCE , 2013 .

[26]  S. Sisson,et al.  A comparative review of dimension reduction methods in approximate Bayesian computation , 2012, 1202.3819.

[27]  S. Wood Statistical inference for noisy nonlinear ecological dynamic systems , 2010, Nature.

[28]  Anthony N. Pettitt,et al.  Likelihood-free Bayesian estimation of multivariate quantile distributions , 2011, Comput. Stat. Data Anal..

[29]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[30]  D A Denham,et al.  The number and distribution of Brugia pahangi in cats at different times after a primary infection. , 1982, Acta tropica.

[31]  M. Kendall Theoretical Statistics , 1956, Nature.