Efficient SMC2 schemes for stochastic kinetic models

Fitting stochastic kinetic models represented by Markov jump processes within the Bayesian paradigm is complicated by the intractability of the observed data likelihood. There has therefore been considerable attention given to the design of pseudo-marginal Markov chain Monte Carlo algorithms for such models. However, these methods are typically computationally intensive, often require careful tuning and must be restarted from scratch upon receipt of new observations. Sequential Monte Carlo (SMC) methods on the other hand aim to efficiently reuse posterior samples at each time point. Despite their appeal, applying SMC schemes in scenarios with both dynamic states and static parameters is made difficult by the problem of particle degeneracy. A principled approach for overcoming this problem is to move each parameter particle through a Metropolis-Hastings kernel that leaves the target invariant. This rejuvenation step is key to a recently proposed SMC$^2$ algorithm, which can be seen as the pseudo-marginal analogue of an idealised scheme known as iterated batch importance sampling. Computing the parameter weights in SMC$^2$ requires running a particle filter over dynamic states to unbiasedly estimate the intractable observed data likelihood contributions at each time point. In this paper, we propose to use an auxiliary particle filter inside the SMC$^2$ scheme. Our method uses two recently proposed constructs for sampling conditioned jump processes and we find that the resulting inference schemes typically require fewer state particles than when using a simple bootstrap filter. Using two applications, we compare the performance of the proposed approach with various competing methods, including two global MCMC schemes.

[1]  A. M. Johansen,et al.  The Iterated Auxiliary Particle Filter , 2015, 1511.06286.

[2]  Theodoros Kypraios,et al.  Efficient Bayesian inference for partially observed stochastic epidemics and a new class of semi-parametric time series models , 2007 .

[3]  Andreas Hellander,et al.  A Hierarchy of Approximations of the Master Equation Scaled by a Size Parameter , 2008, J. Sci. Comput..

[4]  P. Moral Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[5]  Gavin J. Gibson,et al.  Estimating parameters in stochastic compartmental models using Markov chain methods , 1998 .

[6]  Nicholas G. Polson,et al.  Particle Learning and Smoothing , 2010, 1011.1098.

[7]  N. Ling The Mathematical Theory of Infectious Diseases and its applications , 1978 .

[8]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[9]  Paul Fearnhead,et al.  Computational methods for complex stochastic systems: a review of some alternatives to MCMC , 2008, Stat. Comput..

[10]  Richard J Boys,et al.  Bayesian inference for stochastic epidemic models with time-inhomogeneous removal rates , 2007, Journal of mathematical biology.

[11]  Pierre E. Jacob,et al.  Sequential Bayesian inference for implicit hidden Markov models and current limitations , 2015, 1505.04321.

[12]  Fredrik Lindsten,et al.  Particle gibbs with ancestor sampling , 2014, J. Mach. Learn. Res..

[13]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[14]  M. Plummer,et al.  CODA: convergence diagnosis and output analysis for MCMC , 2006 .

[15]  Darren J Wilkinson,et al.  Bayesian inference for Markov jump processes with informative observations , 2014, Statistical applications in genetics and molecular biology.

[16]  A. Arkin,et al.  Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. , 1998, Genetics.

[17]  Michael Ludkovski,et al.  Sequential Bayesian inference in hidden Markov stochastic kinetic models with application to detection and response to seasonal epidemics , 2013, Statistics and Computing.

[18]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[19]  Darren J. Wilkinson,et al.  Bayesian inference for a discretely observed stochastic kinetic model , 2008, Stat. Comput..

[20]  Rob Deardon,et al.  Computational Statistics and Data Analysis Simulation-based Bayesian Inference for Epidemic Models , 2022 .

[21]  Christopher C Drovandi,et al.  Alive SMC2: Bayesian model selection for low‐count time series models with intractable likelihoods , 2016, Biometrics.

[22]  Darren J Wilkinson,et al.  Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo , 2011, Interface Focus.

[23]  G. Roberts,et al.  Bayesian inference for partially observed stochastic epidemics , 1999 .

[24]  A. Doucet,et al.  The correlated pseudomarginal method , 2015, Journal of the Royal Statistical Society: Series B (Statistical Methodology).