Analytical Derivation of Moment Equations in Stochastic Chemical Kinetics.

The master probability equation captures the dynamic behavior of a variety of stochastic phenomena that can be modeled as Markov processes. Analytical solutions to the master equation are hard to come by though because they require the enumeration of all possible states and the determination of the transition probabilities between any two states. These two tasks quickly become intractable for all but the simplest of systems. Instead of determining how the probability distribution changes in time, we can express the master probability distribution as a function of its moments, and, we can then write transient equations for the probability distribution moments. In 1949, Moyal defined the derivative, or jump, moments of the master probability distribution. These are measures of the rate of change in the probability distribution moment values, i.e. what the impact is of any given transition between states on the moment values. In this paper we present a general scheme for deriving analytical moment equations for any N-dimensional Markov process as a function of the jump moments. Importantly, we propose a scheme to derive analytical expressions for the jump moments for any N-dimensional Markov process. To better illustrate the concepts, we focus on stochastic chemical kinetics models for which we derive analytical relations for jump moments of arbitrary order. Chemical kinetics models are widely used to capture the dynamic behavior of biological systems. The elements in the jump moment expressions are a function of the stoichiometric matrix and the reaction propensities, i.e the probabilistic reaction rates. We use two toy examples, a linear and a non-linear set of reactions, to demonstrate the applicability and limitations of the scheme. Finally, we provide an estimate on the minimum number of moments necessary to obtain statistical significant data that would uniquely determine the dynamics of the underlying stochastic chemical kinetic system. The first two moments only provide limited information, especially when complex, non-linear dynamics are involved.

[1]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[2]  Stochastic theory of second-order chemical reactions , 1978 .

[3]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[4]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[5]  P. Swain,et al.  Stochastic Gene Expression in a Single Cell , 2002, Science.

[6]  Vassilios Sotiropoulos,et al.  Multiscale Hy3S: Hybrid stochastic simulation for supercomputers , 2006, BMC Bioinformatics.

[7]  Yiannis N. Kaznessis,et al.  Models for synthetic biology , 2007, BMC Systems Biology.

[8]  Yang Cao,et al.  Sensitivity analysis of discrete stochastic systems. , 2005, Biophysical journal.

[9]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[10]  Ashutosh Kumar Singh,et al.  Moment closure techniques for stochastic models in population biology , 2006, 2006 American Control Conference.

[11]  Vassilios Sotiropoulos,et al.  SynBioSS: the synthetic biology modeling suite , 2008, Bioinform..

[12]  D G Vlachos,et al.  Overcoming stiffness in stochastic simulation stemming from partial equilibrium: a multiscale Monte Carlo algorithm. , 2005, The Journal of chemical physics.

[13]  Vassilios Sotiropoulos,et al.  An adaptive time step scheme for a system of stochastic differential equations with multiple multiplicative noise: chemical Langevin equation, a proof of concept. , 2008, The Journal of chemical physics.

[14]  A. Mohammad-Djafari.  A Matlab Program to Calculate the Maximum Entropy Distributions , 2001, physics/0111126.

[15]  Vassilios Sotiropoulos,et al.  Synthetic tetracycline-inducible regulatory networks: computer-aided design of dynamic phenotypes , 2007, BMC Systems Biology.

[16]  Yiannis N Kaznessis,et al.  Optimization of a stochastically simulated gene network model via simulated annealing. , 2006, Biophysical journal.

[17]  Linda R Petzold,et al.  Efficient step size selection for the tau-leaping simulation method. , 2006, The Journal of chemical physics.

[18]  D. Gillespie.  The chemical Langevin equation , 2000 .

[19]  Yiannis N Kaznessis,et al.  Model-driven designs of an oscillating gene network. , 2005, Biophysical journal.

[20]  Drew Endy,et al.  Determination of cell fate selection during phage lambda infection , 2008, Proceedings of the National Academy of Sciences.

[21]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[22]  Muruhan Rathinam,et al.  Stiffness in stochastic chemically reacting systems: The implicit tau-leaping method , 2003 .

[23]  H. Salis,et al.  Computer-aided design of modular protein devices: Boolean AND gene activation , 2006, Physical biology.

[24]  S. Swain.  Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences , 1984 .

[25]  城塚 正,et al.  Chemical Engineering Scienceについて , 1962 .

[26]  C. Gillespie.  Moment-closure approximations for mass-action models. , 2009, IET systems biology.

[27]  Linda R Petzold,et al.  The slow-scale stochastic simulation algorithm. , 2005, The Journal of chemical physics.

[28]  J. E. Moyal.  Stochastic Processes and Statistical Physics , 1949 .

[29]  J. Hespanha,et al.  Stochastic models for chemically reacting systems using polynomial stochastic hybrid systems , 2005 .

[30]  Yiannis N. Kaznessis,et al.  Multi-scale models for gene network engineering , 2006 .

[31]  Joe Brewer,et al.  Kronecker products and matrix calculus in system theory , 1978 .

[32]  J. Goutsias.  Classical versus stochastic kinetics modeling of biochemical reaction systems. , 2007, Biophysical journal.

[33]  Yiannis Kaznessis,et al.  Accurate hybrid stochastic simulation of a system of coupled chemical or biochemical reactions. , 2005, The Journal of chemical physics.

[34]  Prodromos Daoutidis,et al.  Model Reduction of Multiscale Chemical Langevin Equations: A Numerical Case Study , 2009, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[35]  D. Gillespie.  Markov Processes: An Introduction for Physical Scientists , 1991 .

[36]  Yiannis N. Kaznessis,et al.  Forward engineering of synthetic bio-logical and gates , 2008 .

[37]  D. A. Mcquarrie.  Stochastic approach to chemical kinetics , 1967, Journal of Applied Probability.

[38]  W. Ebeling.  Stochastic Processes in Physics and Chemistry , 1995 .

[39]  Adam P Arkin,et al.  Fifteen minutes of fim: control of type 1 pili expression in E. coli. , 2002, Omics : a journal of integrative biology.

[40]  G. Gibson,et al.  Novel moment closure approximations in stochastic epidemics , 2005, Bulletin of mathematical biology.

[41]  Chang Hyeong Lee,et al.  A moment closure method for stochastic reaction networks. , 2009, The Journal of chemical physics.

[42]  Yiannis N Kaznessis,et al.  An equation-free probabilistic steady-state approximation: dynamic application to the stochastic simulation of biochemical reaction networks. , 2005, The Journal of chemical physics.