Inference for SDE Models via Approximate Bayesian Computation

Models defined by stochastic differential equations (SDEs) allow for the representation of random variability in dynamical systems. The relevance of this class of models is growing in many applied research areas and is already a standard tool to model, for example, financial, neuronal, and population growth dynamics. However, inference for multidimensional SDE models is still very challenging, both computationally and theoretically. Approximate Bayesian computation (ABC) allows to perform Bayesian inference for models which are sufficiently complex that the likelihood function is either analytically unavailable or computationally prohibitive to evaluate. A computationally efficient ABC-MCMC algorithm is proposed, halving the running time in our simulations. Focus here is on the case where the SDE describes latent dynamics in state-space models; however, the methodology is not limited to the state-space framework. We consider simulation studies for a pharmacokinetics/pharmacodynamics model and for stochastic chemical reactions and we provide a Matlab package that implements our ABC-MCMC algorithm.

[1]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[2]  B. Øksendal.  Stochastic Differential Equations , 1985 .

[3]  B. Øksendal.  Stochastic differential equations : an introduction with applications , 1987 .

[4]  D. Talay.  Numerical solution of stochastic differential equations , 1994 .

[5]  D. Bates,et al.  Approximations to the Log-Likelihood Function in the Nonlinear Mixed-Effects Model , 1995 .

[6]  Radford M. Neal.  Sampling from multimodal distributions using tempered transitions , 1996, Stat. Comput..

[7]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[8]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[9]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[11]  Darren J. Wilkinson.  Stochastic Modelling for Systems Biology , 2006 .

[12]  K. Lindsay,et al.  Seeing the Wood for the Trees: A Critical Evaluation of Methods to Estimate the Parameters of Stochastic Differential Equations , 2006 .

[13]  G. Roberts,et al.  Retrospective exact simulation of diffusion sample paths with applications , 2006 .

[14]  Discussion sur "Exact and computationally efficient likelihood-based estimation for discretely observed diffusion processes" (by A Beskos, O. Papaspiliopoulos, G. Roberts, P. Farnhead, ) , 2006 .

[15]  P. Fearnhead,et al.  Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion) , 2006 .

[16]  E L Ionides,et al.  Inference for nonlinear dynamical systems , 2006, Proceedings of the National Academy of Sciences.

[17]  J. Berger.  The case for objective Bayesian analysis , 2006 .

[18]  M. Plummer,et al.  CODA: convergence diagnosis and output analysis for MCMC , 2006 .

[19]  H. Sørensen.  Parametric Inference for Diffusion Processes Observed at Discrete Points in Time: a Survey , 2004 .

[20]  S. Coles,et al.  Inference for Stereological Extremes , 2007 .

[21]  Sophie Donnet,et al.  Parametric inference for mixed models defined by stochastic differential equations , 2008 .

[22]  Desmond J. Higham,et al.  Modeling and Simulating Chemical Reactions , 2008, SIAM Rev..

[23]  David Welch,et al.  Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems , 2009, Journal of The Royal Society Interface.

[24]  Aaron A. King,et al.  Time series analysis via mechanistic models , 2008, 0802.0021.

[25]  Estimation for the change point of the volatility in a stochastic differential equation , 2009, 0906.3108.

[26]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[27]  Erika Cule,et al.  ABC-SysBio—approximate Bayesian computation in Python with GPU support , 2010, Bioinform..

[28]  Darren J. Wilkinson,et al.  Markov Chain Monte Carlo Algorithms for SDE Parameter Estimation , 2010, Learning and Inference in Computational Systems Biology.

[29]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[30]  Andrew Gelman,et al.  Handbook of Markov Chain Monte Carlo , 2011 .

[31]  Nicolas Chopin,et al.  SMC2: an efficient algorithm for sequential analysis of state space models , 2011, 1101.1528.

[32]  Dennis Prangle,et al.  Summary statistics and sequential methods for approximate Bayesian computation , 2011 .

[33]  Yanan Fan,et al.  Likelihood-Free MCMC , 2011 .

[34]  Darren J Wilkinson,et al.  Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo , 2011, Interface Focus.

[35]  Paul Fearnhead,et al.  Constructing summary statistics for approximate Bayesian computation: semi‐automatic approximate Bayesian computation , 2012 .

[36]  J. Møller.  Discussion on the paper by Feranhead and Prangle , 2012 .

[37]  Jean-Michel Marin,et al.  Approximate Bayesian computational methods , 2011, Statistics and Computing.

[38]  Heikki Haario,et al.  Efficient MCMC for Climate Model Parameter Estimation: Parallel Adaptive Chains and Early Rejection , 2012 .

[39]  Lawrence M. Murray.  Bayesian State-Space Modelling on High-Performance Hardware Using LibBi , 2013, 1306.3277.