A constrained Langevin approximation for chemical reaction networks

Continuous-time Markov chain models are often used to describe the stochastic dynamics of networks of reacting chemical species, especially in the growing field of systems biology. These Markov chain models are often studied by simulating sample paths in order to generate Monte-Carlo estimates. However, discrete-event stochastic simulation of these models rapidly becomes computationally intensive. Consequently, more tractable diffusion approximations are commonly used in numerical computation, even for modest-sized networks. However, existing approximations either do not respect the constraint that chemical concentrations are never negative (linear noise approximation) or are typically only valid until the concentration of some chemical species first becomes zero (Langevin approximation). In this paper, we propose an approximation for such Markov chains via reflected diffusion processes that respect the fact that concentrations of chemical species are never negative. We call this a constrained Langevin approximation because it behaves like the Langevin approximation in the interior of the positive orthant, to which it is constrained by instantaneous reflection at the boundary of the orthant. An additional advantage of our approximation is that it can be written down immediately from the chemical reactions. This contrasts with the linear noise approximation, which involves a twostage procedure—first solve a deterministic reaction rate ordinary differential equation, followed by a stochastic differential equation for fluctuations around those solutions. Our approximation also captures the interaction of nonlinearities in the reaction rate function with the driving noise. In simulations, we have found the computation time for our approximation to be at least comparable to, and often better than, that for the linear noise approximation. Under mild assumptions, we first prove that our proposed approximation is well defined for all time. Then we prove that it can be obtained as the weak limit of a sequence of jump-diffusion processes that behave like the Langevin approximation in the interior of the positive orthant and like a rescaled version of the Markov chain on the boundary of the orthant. For this limit the-

[1]  Darren J. Wilkinson Stochastic Modelling for Systems Biology , 2006 .

[2]  Mireille Bossy,et al.  A symmetrized Euler scheme for an efficient approximation of reflected diffusions , 2004, Journal of Applied Probability.

[3]  David F. Anderson,et al.  Continuous Time Markov Chain Models for Chemical Reaction Networks , 2011 .

[4]  D. W. Stroock,et al.  Multidimensional Diffusion Processes , 1979 .

[5]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[6]  D. Gillespie Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[7]  D. Gillespie,et al.  Linear noise approximation is valid over limited times for any chemical system that is sufficiently large. , 2012, IET systems biology.

[8]  T. Kurtz Strong approximation theorems for density dependent Markov chains , 1978 .

[9]  Kevin Burrage,et al.  Stochastic approaches for modelling in vivo reactions , 2004, Comput. Biol. Chem..

[10]  Y. Wong,et al.  Positivity preserving chemical Langevin equations , 2008 .

[11]  Desmond J. Higham,et al.  An Algorithmic Introduction to Numerical Simulation of Stochastic Differential Equations , 2001, SIAM Rev..

[12]  P. Major,et al.  An approximation of partial sums of independent RV'-s, and the sample DF. I , 1975 .

[13]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[14]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[15]  R. J. Williams,et al.  An invariance principle for semimartingale reflecting Brownian motions in domains with piecewise smooth boundaries. , 2007, 0704.0405.

[16]  N. Kampen,et al.  a Power Series Expansion of the Master Equation , 1961 .

[17]  G. Maruyama Continuous Markov processes and stochastic equations , 1955 .

[18]  K. Ramanan,et al.  On the submartingale problem for reflected diffusions in domains with piecewise smooth boundaries , 2014, 1412.0729.

[19]  T. Kurtz Approximation of Population Processes , 1987 .

[20]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[21]  Keijo Ruohonen,et al.  Developing Itô stochastic differential equation models for neuronal signal transduction pathways , 2006, Comput. Biol. Chem..

[22]  P. Dupuis,et al.  SDEs with Oblique Reflection on Nonsmooth Domains , 2008 .

[23]  Péter Major,et al.  The approximation of partial sums of independent RV's , 1976 .

[24]  Jia-gang Wang The Asymptotic Behavior of Locally Square Integrable Martingales , 1995 .

[25]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[26]  Gianluca Setti,et al.  Design and Analysis of Biomolecular Circuits , 2011 .

[27]  T. Kurtz The Relationship between Stochastic and Deterministic Models for Chemical Reactions , 1972 .

[28]  LUKASZ SZPRUCH,et al.  Comparing Hitting Time Behavior of Markov Jump Processes and Their Diffusion Approximations , 2010, Multiscale Model. Simul..

[29]  D. Lépingle Sur le comportement asymptotique des martingales locales , 1978 .

[30]  Thomas Wilhelm,et al.  The smallest chemical reaction system with bistability , 2009, BMC Systems Biology.

[31]  A. Arkin,et al.  Stochastic mechanisms in gene expression. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Xiongzhi Chen Brownian Motion and Stochastic Calculus , 2008 .

[33]  Guido Sanguinetti,et al.  The complex chemical Langevin equation. , 2014, The Journal of chemical physics.

[34]  Dan ie l T. Gil lespie A rigorous derivation of the chemical master equation , 1992 .

[35]  Desmond J. Higham,et al.  On Constrained Langevin Equations and (Bio)Chemical Reaction Networks , 2019, Multiscale Model. Simul..

[36]  Desmond J. Higham,et al.  Modeling and Simulating Chemical Reactions , 2008, SIAM Rev..

[37]  T. Kurtz Limit theorems and diffusion approximations for density dependent Markov chains , 1976 .

[38]  L. Rogers,et al.  Diffusions, Markov processes, and martingales , 1979 .

[39]  J. Steele,et al.  ITÔ CALCULUS , 2003 .

[40]  D. Gillespie The chemical Langevin equation , 2000 .

[41]  B. Mélykúti Theoretical advances in the modelling and interrogation of biochemical reaction systems: alternative formulations of the chemical Langevin equation and optimal experiment design for model discrimination , 2010 .

[42]  P. Dupuis,et al.  On oblique derivative problems for fully nonlinear second-order elliptic partial differential equations on nonsmooth domains , 1990 .

[43]  E. Platen An introduction to numerical methods for stochastic differential equations , 1999, Acta Numerica.