Efficient $$\hbox {SMC}^2$$SMC2 schemes for stochastic kinetic models

Fitting stochastic kinetic models represented by Markov jump processes within the Bayesian paradigm is complicated by the intractability of the observed-data likelihood. There has therefore been considerable attention given to the design of pseudo-marginal Markov chain Monte Carlo algorithms for such models. However, these methods are typically computationally intensive, often require careful tuning and must be restarted from scratch upon receipt of new observations. Sequential Monte Carlo (SMC) methods on the other hand aim to efficiently reuse posterior samples at each time point. Despite their appeal, applying SMC schemes in scenarios with both dynamic states and static parameters is made difficult by the problem of particle degeneracy. A principled approach for overcoming this problem is to move each parameter particle through a Metropolis-Hastings kernel that leaves the target invariant. This rejuvenation step is key to a recently proposed $$\hbox {SMC}^2$$SMC2 algorithm, which can be seen as the pseudo-marginal analogue of an idealised scheme known as iterated batch importance sampling. Computing the parameter weights in $$\hbox {SMC}^2$$SMC2 requires running a particle filter over dynamic states to unbiasedly estimate the intractable observed-data likelihood up to the current time point. In this paper, we propose to use an auxiliary particle filter inside the $$\hbox {SMC}^2$$SMC2 scheme. Our method uses two recently proposed constructs for sampling conditioned jump processes, and we find that the resulting inference schemes typically require fewer state particles than when using a simple bootstrap filter. Using two applications, we compare the performance of the proposed approach with various competing methods, including two global MCMC schemes.

[1]  P. Moral Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[2]  A. M. Johansen,et al.  The Iterated Auxiliary Particle Filter , 2015, 1511.06286.

[3]  Theodoros Kypraios,et al.  Efficient Bayesian inference for partially observed stochastic epidemics and a new class of semi-parametric time series models , 2007 .

[4]  Anthony Lee,et al.  Parallel Resampling in the Particle Filter , 2013, 1301.4019.

[5]  Alexander Grey,et al.  The Mathematical Theory of Infectious Diseases and Its Applications , 1977 .

[6]  Theodore Kypraios,et al.  Modelling and Bayesian analysis of the Abakaliki smallpox data. , 2016, Epidemics.

[7]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[8]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[9]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[10]  Michael K. Pitt,et al.  Auxiliary Variable Based Particle Filters , 2001, Sequential Monte Carlo Methods in Practice.

[11]  Darren J Wilkinson,et al.  Bayesian inference for Markov jump processes with informative observations , 2014, Statistical applications in genetics and molecular biology.

[12]  P. Fearnhead Markov chain Monte Carlo, Sufficient Statistics, and Particle Filters , 2002 .

[13]  P. Moral,et al.  The Alive Particle Filter and Its Use in Particle Markov Chain Monte Carlo , 2015 .

[14]  Richard J Boys,et al.  Bayesian inference for stochastic epidemic models with time-inhomogeneous removal rates , 2007, Journal of mathematical biology.

[15]  Andras Fulop,et al.  Efficient Learning via Simulation: A Marginalized Resample-Move Approach , 2012 .

[16]  Pierre E. Jacob,et al.  Sequential Bayesian inference for implicit hidden Markov models and current limitations , 2015, 1505.04321.

[17]  Fredrik Lindsten,et al.  Particle gibbs with ancestor sampling , 2014, J. Mach. Learn. Res..

[18]  G. Storvik Particle filters in state space models with the presence of unknown static parameters YYYY No org found YYY , 2000 .

[19]  D. Wilkinson,et al.  Bayesian Inference for Stochastic Kinetic Models Using a Diffusion Approximation , 2005, Biometrics.

[20]  H. Andersson,et al.  Stochastic Epidemic Models and Their Statistical Analysis , 2000 .

[21]  Gavin J. Gibson,et al.  Estimating parameters in stochastic compartmental models using Markov chain methods , 1998 .

[22]  Christopher C Drovandi,et al.  Alive SMC2: Bayesian model selection for low‐count time series models with intractable likelihoods , 2016, Biometrics.

[23]  Anthony Lee,et al.  Twisted particle filters , 2012, 1210.0220.

[24]  Jean-Michel Marin,et al.  On Particle Learning , 2010, 1006.0554.

[25]  S. J. Koopman Discussion of `Particle Markov chain Monte Carlo methods – C. Andrieu, A. Doucet and R. Holenstein’ [Review of: Particle Markov chain Monte Carlo methods] , 2010 .

[26]  Rob Deardon,et al.  Computational Statistics and Data Analysis Simulation-based Bayesian Inference for Epidemic Models , 2022 .

[27]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[28]  Paul Fearnhead,et al.  Computational methods for complex stochastic systems: a review of some alternatives to MCMC , 2008, Stat. Comput..

[29]  M. Plummer,et al.  CODA: convergence diagnosis and output analysis for MCMC , 2006 .

[30]  N. Chopin A sequential particle filter method for static models , 2002 .

[31]  N. Ling The Mathematical Theory of Infectious Diseases and its applications , 1978 .

[32]  W. Gilks,et al.  Following a moving target—Monte Carlo inference for dynamic Bayesian models , 2001 .

[33]  Darren J. Wilkinson,et al.  Bayesian inference for a discretely observed stochastic kinetic model , 2008, Stat. Comput..

[34]  A. Arkin,et al.  Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. , 1998, Genetics.

[35]  Darren J Wilkinson,et al.  Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo , 2011, Interface Focus.

[36]  Pieralberto Guarniero,et al.  The iterated auxiliary particle filter and applications to state space models and diffusion processes. , 2017 .

[37]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[38]  Ralph S. Silva,et al.  On Some Properties of Markov Chain Monte Carlo Simulation Methods Based on the Particle Filter , 2012 .

[39]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[40]  Nicholas G. Polson,et al.  Particle Learning and Smoothing , 2010, 1011.1098.

[41]  J. Rosenthal,et al.  On the efficiency of pseudo-marginal random walk Metropolis algorithms , 2013, The Annals of Statistics.

[42]  Andreas Hellander,et al.  A Hierarchy of Approximations of the Master Equation Scaled by a Size Parameter , 2008, J. Sci. Comput..

[43]  G. Roberts,et al.  Bayesian inference for partially observed stochastic epidemics , 1999 .

[44]  A. Doucet,et al.  The correlated pseudomarginal method , 2015, Journal of the Royal Statistical Society: Series B (Statistical Methodology).

[45]  Darren J. Wilkinson Stochastic Modelling for Systems Biology , 2006 .

[46]  P. Fearnhead,et al.  Exact filtering for partially observed continuous time models , 2004 .

[47]  Michael Ludkovski,et al.  Sequential Bayesian Inference for Detection and Response to Seasonal Epidemics , 2013, Online Journal of Public Health Informatics.

[48]  Johan Dahlin,et al.  Accelerating pseudo-marginal Metropolis-Hastings by correlating auxiliary variables , 2015, 1511.05483.