Bayesian parameter inference for stochastic biochemical network models using particle Markov chain Monte Carlo

Computational systems biology is concerned with the development of detailed mechanistic models of biological processes. Such models are often stochastic and analytically intractable, containing uncertain parameters that must be estimated from time course data. In this article, we consider the task of inferring the parameters of a stochastic kinetic model defined as a Markov (jump) process. Inference for the parameters of complex nonlinear multivariate stochastic process models is a challenging problem, but we find here that algorithms based on particle Markov chain Monte Carlo turn out to be a very effective computationally intensive approach to the problem. Approximations to the inferential model based on stochastic differential equations (SDEs) are considered, as well as improvements to the inference scheme that exploit the SDE structure. We apply the methodology to a Lotka–Volterra system and a prokaryotic auto-regulatory network.

[1]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[2]  D. Latchman.  Gene Regulation: A Eukaryotic Perspective , 1990 .

[3]  D. Gillespie.  A rigorous derivation of the chemical master equation , 1992 .

[4]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[5]  M. Sørensen,et al.  Martingale estimation functions for discretely observed diffusion processes , 1995 .

[6]  A. Pedersen.  A new approach to maximum likelihood estimation for stochastic differential equations based on discrete observations , 1995 .

[7]  G. Kitagawa.  Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[8]  N. Shephard,et al.  Likelihood INference for Discretely Observed Non-linear Diffusions , 2001 .

[9]  A. Arkin,et al.  Stochastic kinetic analysis of developmental pathway bifurcation in phage lambda-infected Escherichia coli cells. , 1998, Genetics.

[10]  M. Pitt,et al.  Filtering via Simulation: Auxiliary Particle Filters , 1999 .

[11]  D. Gillespie.  The chemical Langevin equation , 2000 .

[12]  Bjørn Eraker.  MCMC Analysis of Diffusion Models With Application to Finance , 2001 .

[13]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[14]  Michael A. West,et al.  Combined Parameter and State Estimation in Simulation-Based Filtering , 2001, Sequential Monte Carlo Methods in Practice.

[15]  G. Roberts,et al.  On inference for partially observed nonlinear diffusion models using the Metropolis–Hastings algorithm , 2001 .

[16]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[17]  D. Balding,et al.  Approximate Bayesian computation in population genetics. , 2002, Genetics.

[18]  H. Kitano,et al.  Computational systems biology , 2002, Nature.

[19]  A. Gallant,et al.  Numerical Techniques for Maximum Likelihood Estimation of Continuous-Time Diffusion Processes , 2002 .

[20]  P. Swain,et al.  Stochastic Gene Expression in a Single Cell , 2002, Science.

[21]  Paul Marjoram,et al.  Markov chain Monte Carlo without likelihoods , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[22]  M. Beaumont.  Estimation of population growth or decline in genetically monitored populations. , 2003, Genetics.

[23]  P. Moral.  Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[24]  Darren J. Wilkinson,et al.  Parallel Bayesian Computation , 2005 .

[25]  D. Wilkinson,et al.  Bayesian Inference for Stochastic Kinetic Models Using a Diffusion Approximation , 2005, Biometrics.

[26]  Darren J. Wilkinson.  Stochastic Modelling for Systems Biology , 2006 .

[27]  Darren J. Wilkinson,et al.  Bayesian sequential inference for nonlinear multivariate diffusions , 2006, Stat. Comput..

[28]  B. Delyon,et al.  Simulation of conditioned diffusion and application to parameter estimation , 2006 .

[29]  P. Fearnhead,et al.  Exact and computationally efficient likelihood‐based estimation for discretely observed diffusion processes (with discussion) , 2006 .

[30]  E L Ionides,et al.  Inference for nonlinear dynamical systems , 2006, Proceedings of the National Academy of Sciences.

[31]  M. Plummer,et al.  CODA: convergence diagnosis and output analysis for MCMC , 2006 .

[32]  H. Sørensen.  Parametric Inference for Diffusion Processes Observed at Discrete Points in Time: a Survey , 2004 .

[33]  O. Stramer,et al.  Asymptotics of an Efficient Monte Carlo Estimation for the Transition Density of Diffusion Processes , 2007 .

[34]  A. Doucet,et al.  A Tutorial on Particle Filtering and Smoothing: Fifteen years later , 2008 .

[35]  Paul Fearnhead,et al.  Computational methods for complex stochastic systems: a review of some alternatives to MCMC , 2008, Stat. Comput..

[36]  Darren J. Wilkinson,et al.  Bayesian inference for a discretely observed stochastic kinetic model , 2008, Stat. Comput..

[37]  Ralph S. Silva,et al.  Particle filtering within adaptive Metropolis-Hastings sampling , 2009, 0911.0230.

[38]  Christophe Andrieu,et al.  Particle Markov Chain Monte Carlo for Efficient Numerical Simulation , 2009 .

[39]  Edward L. Ionides,et al.  Plug-and-play inference for disease dynamics: measles in large and small populations as a case study , 2009, Journal of The Royal Society Interface.

[40]  C. Andrieu,et al.  The pseudo-marginal approach for efficient Monte Carlo computations , 2009, 0903.5480.

[41]  D. Wilkinson.  Stochastic modelling for quantitative description of heterogeneous biological systems , 2009, Nature Reviews Genetics.

[42]  Robert Kohn,et al.  Auxiliary particle ltering within adaptive Metropolis-Hastings sampling , 2010, 1006.1914.

[43]  S. Wood.  Statistical inference for noisy nonlinear ecological dynamic systems , 2010, Nature.

[44]  Darren J. Wilkinson,et al.  Markov Chain Monte Carlo Algorithms for SDE Parameter Estimation , 2010, Learning and Inference in Computational Systems Biology.

[45]  A. Doucet,et al.  Particle Markov chain Monte Carlo methods , 2010 .

[46]  O. Stramer,et al.  Bayesian inference for irreducible diffusion processes using the pseudo-marginal approach , 2011 .

[47]  Paul Fearnhead,et al.  Markov Chain Monte Carlo for Exact Inference for Diffusions , 2011, 1102.5541.

[48]  Darren J. Wilkinson,et al.  Parameter inference for stochastic kinetic models of bacterial gene regulation: A Bayesian Approach to Systems Biology , 2011 .