Approximate Numerical Integration of the Chemical Master Equation for Stochastic Reaction Networks

Numerical solution of the chemical master equation for stochastic reaction networks typically suffers from the state space explosion problem due to the curse of dimensionality and from stiffness due to multiple time scales. The dimension of the state space equals the number of molecular species involved in the reaction network and the size of the system of differential equations equals the number of states in the corresponding continuous-time Markov chain, which is usually enormously huge and often even infinite. Thus, efficient numerical solution approaches must be able to handle huge, possibly infinite and stiff systems of differential equations efficiently. We present an approximate numerical integration approach that combines a dynamical state space truncation procedure with efficient numerical integration schemes for systems of ordinary differential equations including adaptive step size selection based on local error estimates. The efficiency and accuracy is demonstrated by numerical examples.

[1]  C. Loan,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix , 1978 .

[2]  K. Burrage,et al.  A Krylov-based finite state projection algorithm for solving the chemical master equation arising in the discrete modelling of biological systems , 2006 .

[3]  Yiannis Kaznessis,et al.  Accurate hybrid stochastic simulation of a system of coupled chemical or biochemical reactions. , 2005, The Journal of chemical physics.

[4]  Werner Sandmann,et al.  Numerical Approximation of Rare Event Probabilities in Biochemically Reacting Systems , 2013, CMSB.

[5]  A. B. Bortz,et al.  A new algorithm for Monte Carlo simulation of Ising spin systems , 1975 .

[6]  Cosmin Safta,et al.  Hybrid discrete/continuum algorithms for stochastic reaction networks , 2015, J. Comput. Phys..

[7]  C. Rao,et al.  Stochastic chemical kinetics and the quasi-steady-state assumption: Application to the Gillespie algorithm , 2003 .

[8]  Werner Sandmann,et al.  Streamlined formulation of adaptive explicit-implicit tau-leaping with automatic tau selection , 2009, Proceedings of the 2009 Winter Simulation Conference (WSC).

[9]  Lawrence F. Shampine,et al.  Solving ODEs with MATLAB , 2002 .

[10]  Hana El-Samad,et al.  Reversible-equivalent-monomolecular tau: A leaping method for "small number and stiff" stochastic chemical systems , 2007, J. Comput. Phys..

[11]  J. Dormand,et al.  A family of embedded Runge-Kutta formulae , 1980 .

[12]  Xiaodong Cai,et al.  Unbiased tau-leap methods for stochastic simulation of chemically reacting systems. , 2008, The Journal of chemical physics.

[13]  Linda R Petzold,et al.  Efficient step size selection for the tau-leaping simulation method. , 2006, The Journal of chemical physics.

[14]  Ian J. Laurenzi,et al.  An analytical solution of the stochastic master equation for reversible bimolecular reaction kinetics , 2000 .

[15]  D. Gillespie A rigorous derivation of the chemical master equation , 1992 .

[16]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[17]  J. Lambert Numerical Methods for Ordinary Differential Equations , 1991 .

[18]  T. Kurtz The Relationship between Stochastic and Deterministic Models for Chemical Reactions , 1972 .

[19]  Linda R Petzold,et al.  Adaptive explicit-implicit tau-leaping method with automatic tau selection. , 2007, The Journal of chemical physics.

[20]  Paulette Clancy,et al.  A "partitioned leaping" approach for multiscale modeling of chemical reaction dynamics. , 2006, The Journal of chemical physics.

[21]  Qing Nie,et al.  Modeling Robustness Tradeoffs in Yeast Cell Polarization Induced by Spatial Gradients , 2008, PloS one.

[22]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[23]  Tobias Jahnke,et al.  Solving chemical master equations by adaptive wavelet compression , 2010, J. Comput. Phys..

[24]  Werner Sandmann,et al.  Computational Probability for Systems Biology , 2008, FMSB.

[25]  Parosh Aziz Abdulla,et al.  Fast Adaptive Uniformization of the Chemical Master Equation , 2010 .

[26]  A. Bretscher,et al.  Polarization of cell growth in yeast. I. Establishment and maintenance of polarity states. , 2000, Journal of cell science.

[27]  Werner Sandmann,et al.  Approximate adaptive uniformization of continuous-time Markov chains , 2018, Applied Mathematical Modelling.

[28]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[29]  Tobias Jahnke,et al.  An Adaptive Wavelet Method for the Chemical Master Equation , 2009, SIAM J. Sci. Comput..

[30]  Werner Sandmann,et al.  Efficient calculation of rare event probabilities in Markovian queueing networks , 2011, VALUETOOLS.

[31]  Werner Sandmann,et al.  Discrete-time stochastic modeling and simulation of biochemical networks , 2008, Comput. Biol. Chem..

[32]  Ernst Hairer,et al.  Solving Ordinary Differential Equations I: Nonstiff Problems , 2009 .

[33]  W. Huisinga,et al.  Solving the chemical master equation for monomolecular reaction systems analytically , 2006, Journal of mathematical biology.

[34]  Edmundo de Souza e Silva,et al.  State space exploration in Markov models , 1992, SIGMETRICS '92/PERFORMANCE '92.

[35]  Per Lötstedt,et al.  Hybrid method for the chemical master equation , 2007 .

[36]  Tianhai Tian,et al.  A multi-scaled approach for simulating chemical reaction systems. , 2004, Progress in biophysics and molecular biology.

[37]  Cleve B. Moler,et al.  Nineteen Dubious Ways to Compute the Exponential of a Matrix, Twenty-Five Years Later , 1978, SIAM Rev..

[38]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[39]  Nagiza F. Samatova,et al.  The sorting direct method for stochastic simulation of biochemical systems with varying reaction execution behavior , 2006, Comput. Biol. Chem..

[40]  K. Burrage,et al.  Stochastic chemical kinetics and the total quasi-steady-state assumption: application to the stochastic simulation algorithm and chemical master equation. , 2008, The Journal of chemical physics.

[41]  Hong Li,et al.  Efficient formulation of the stochastic simulation algorithm for chemically reacting systems. , 2004, The Journal of chemical physics.

[42]  Muruhan Rathinam,et al.  Stiffness in stochastic chemically reacting systems: The implicit tau-leaping method , 2003 .

[43]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[44]  Roger B. Sidje,et al.  Multiscale Modeling of Chemical Kinetics via the Master Equation , 2008, Multiscale Model. Simul..

[45]  J. Rawlings,et al.  Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics , 2002 .

[46]  E. Hairer,et al.  Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems , 2010 .

[47]  Werner Sandmann,et al.  A Numerical Aggregation Algorithm for the Enzyme-Catalyzed Substrate Conversion , 2006, CMSB.

[48]  Linda Petzold,et al.  Logarithmic Direct Method for Discrete Stochastic Simulation of Chemically Reacting Systems ∗ , 2006 .

[49]  K. Burrage,et al.  Binomial leap methods for simulating stochastic chemical kinetics. , 2004, The Journal of chemical physics.

[50]  Min K. Roh,et al.  State-dependent doubly weighted stochastic simulation algorithm for automatic characterization of stochastic biochemical rare events. , 2011, The Journal of chemical physics.

[51]  Upinder S. Bhalla,et al.  Adaptive stochastic-deterministic chemical kinetic simulations , 2004, Bioinform..

[52]  D. Gillespie Approximate accelerated stochastic simulation of chemically reacting systems , 2001 .

[53]  E Weinan,et al.  Nested stochastic simulation algorithms for chemical kinetic systems with multiple time scales , 2007, J. Comput. Phys..

[54]  Werner Sandmann,et al.  Sequential estimation for prescribed statistical accuracy in stochastic simulation of biological systems. , 2009, Mathematical biosciences.

[55]  Brian Munsky,et al.  A multiple time interval finite state projection algorithm for the solution to the chemical master equation , 2007, J. Comput. Phys..