A higher-order numerical framework for stochastic simulation of chemical reaction systems

BackgroundIn this paper, we present a framework for improving the accuracy of fixed-step methods for Monte Carlo simulation of discrete stochastic chemical kinetics. Stochasticity is ubiquitous in many areas of cell biology, for example in gene regulation, biochemical cascades and cell-cell interaction. However most discrete stochastic simulation techniques are slow. We apply Richardson extrapolation to the moments of three fixed-step methods, the Euler, midpoint and θ-trapezoidal τ-leap methods, to demonstrate the power of stochastic extrapolation. The extrapolation framework can increase the order of convergence of any fixed-step discrete stochastic solver and is very easy to implement; the only condition for its use is knowledge of the appropriate terms of the global error expansion of the solver in terms of its stepsize. In practical terms, a higher-order method with a larger stepsize can achieve the same level of accuracy as a lower-order method with a smaller one, potentially reducing the computational time of the system.ResultsBy obtaining a global error expansion for a general weak first-order method, we prove that extrapolation can increase the weak order of convergence for the moments of the Euler and the midpoint τ-leap methods, from one to two. This is supported by numerical simulations of several chemical systems of biological importance using the Euler, midpoint and θ-trapezoidal τ-leap methods. In almost all cases, extrapolation results in an improvement of accuracy. As in the case of ordinary and stochastic differential equations, extrapolation can be repeated to obtain even higher-order approximations.ConclusionsExtrapolation is a general framework for increasing the order of accuracy of any fixed-step stochastic solver. This enables the simulation of complicated systems in less time, allowing for more realistic biochemical problems to be solved.

[1]  X. Q. Liu,et al.  Weak Approximations and Extrapolations of Stochastic Differential Equations with Jumps , 2000, SIAM J. Numer. Anal..

[2]  Linda R. Petzold,et al.  Improved leap-size selection for accelerated stochastic simulation , 2003 .

[3]  Hong Li,et al.  Efficient formulation of the stochastic simulation algorithm for chemically reacting systems. , 2004, The Journal of chemical physics.

[4]  Jordi Villà-Freixa,et al.  Simulation methods with extended stability for stiff biochemical Kinetics , 2009, BMC Systems Biology.

[5]  D. Wilkinson Stochastic modelling for quantitative description of heterogeneous biological systems , 2009, Nature Reviews Genetics.

[6]  F. Schlögl Chemical reaction models for non-equilibrium phase transitions , 1972 .

[7]  C. Daub,et al.  BMC Systems Biology , 2007 .

[8]  Jörg Stelling,et al.  Counter-intuitive stochastic behavior of simple gene circuits with negative feedback. , 2010, Biophysical journal.

[9]  Ernst Hairer,et al.  Solving Ordinary Differential Equations I: Nonstiff Problems , 2009 .

[10]  D. V. Widder,et al.  Review: J. A. Shohat and J. D. Tamarkin, The problem of moments , 1945 .

[11]  T. Elston,et al.  Stochasticity in gene expression: from theories to phenotypes , 2005, Nature Reviews Genetics.

[12]  Kevin Burrage,et al.  Look before you leap: a confidence-based method for selecting species criticality while avoiding negative populations in τ-leaping. , 2011, The Journal of chemical physics.

[13]  Masanori Koyama,et al.  Weak Error Analysis of Numerical Methods for Stochastic Models of Population Processes , 2011, Multiscale Model. Simul..

[14]  Yucheng Hu,et al.  Highly accurate tau-leaping methods with random corrections. , 2009, The Journal of chemical physics.

[15]  D. Gillespie,et al.  Avoiding negative populations in explicit Poisson tau-leaping. , 2005, The Journal of chemical physics.

[16]  Jun S. Liu,et al.  Monte Carlo strategies in scientific computing , 2001 .

[17]  K. Zygalakis,et al.  Fast stochastic simulation of biochemical reaction systems by alternative formulations of the chemical Langevin equation. , 2010, The Journal of chemical physics.

[18]  W. Fontana,et al.  Small Numbers of Big Molecules , 2002, Science.

[19]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[20]  W. Huisinga,et al.  Solving the chemical master equation for monomolecular reaction systems analytically , 2006, Journal of mathematical biology.

[21]  Michael B. Giles,et al.  Multilevel Monte Carlo Path Simulation , 2008, Oper. Res..

[22]  Tatiana T Marquez-Lago,et al.  Binomial tau-leap spatial stochastic simulation algorithm for applications in chemical kinetics. , 2007, The Journal of chemical physics.

[23]  A. Kebaier,et al.  Statistical Romberg extrapolation: A new variance reduction method and applications to option pricing , 2005, math/0602529.

[24]  Bin Min THE WEAK CONVERGENCE ANALYSIS OF TAU-LEAPING METHODS: REVISITED , 2011 .

[25]  Linda R Petzold,et al.  Efficient step size selection for the tau-leaping simulation method. , 2006, The Journal of chemical physics.

[26]  S. Jonathan Chapman,et al.  Analysis of a Stochastic Chemical System Close to a SNIPER Bifurcation of Its Mean-Field Model , 2008, SIAM J. Appl. Math..

[27]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[28]  Friedrich Schl gl Chemical Reaction Models for Non-Equilibrium Phase Transitions , 2005 .

[29]  Tiejun Li,et al.  Analysis of Explicit Tau-Leaping Schemes for Simulating Chemically Reacting Systems , 2007, Multiscale Model. Simul..

[30]  Tiejun Li,et al.  The weak convergence analysis of tau-leaping methods: revisited , 2011 .

[31]  H. Othmer,et al.  A stochastic analysis of first-order reaction networks , 2005, Bulletin of mathematical biology.

[32]  David F. Anderson,et al.  Error analysis of tau-leap simulation methods , 2009, 0909.4790.

[33]  D. Gillespie Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[34]  Jeffrey W. Smith,et al.  Stochastic Gene Expression in a Single Cell , .

[35]  Stochastic Taylor expansions for the expectation of functionals of diffusion processes , 2013, 1310.6169.

[36]  Bin Min,et al.  A weak second order tau-leaping method for chemical kinetic systems. , 2011, The Journal of chemical physics.

[37]  Tim Hesterberg,et al.  Monte Carlo Strategies in Scientific Computing , 2002, Technometrics.

[38]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[39]  Muruhan Rathinam,et al.  Consistency and Stability of Tau-Leaping Schemes for Chemical Reaction Systems , 2005, Multiscale Model. Simul..

[40]  Dan ie l T. Gil lespie A rigorous derivation of the chemical master equation , 1992 .

[41]  Vahid Shahrezaei,et al.  Analytical distributions for stochastic gene expression , 2008, Proceedings of the National Academy of Sciences.

[42]  E. Hairer,et al.  Solving ordinary differential equations I (2nd revised. ed.): nonstiff problems , 1993 .

[43]  D. A. Mcquarrie Stochastic approach to chemical kinetics , 1967, Journal of Applied Probability.

[44]  D. Vlachos,et al.  Binomial distribution based tau-leap accelerated stochastic simulation. , 2005, The Journal of chemical physics.

[45]  Desmond J. Higham,et al.  Multilevel Monte Carlo for Continuous Time Markov Chains, with Applications in Biochemical Kinetics , 2011, Multiscale Model. Simul..

[46]  Stefan Rolewicz,et al.  On a problem of moments , 1968 .

[47]  D. Talay,et al.  Expansion of the global error for numerical schemes solving stochastic differential equations , 1990 .

[48]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[49]  A. Arkin,et al.  It's a noisy business! Genetic regulation at the nanomolar scale. , 1999, Trends in genetics : TIG.

[50]  Roger B. Sidje,et al.  Multiscale Modeling of Chemical Kinetics via the Master Equation , 2008, Multiscale Model. Simul..

[51]  Jonathan C. Mattingly,et al.  A weak trapezoidal method for a class of stochastic differential equations , 2009, 0906.3475.

[52]  K. Burrage,et al.  Binomial leap methods for simulating stochastic chemical kinetics. , 2004, The Journal of chemical physics.