Solving Stochastic Reaction Networks with Maximum Entropy Lagrange Multipliers

The time evolution of stochastic reaction networks can be modeled with the chemical master equation of the probability distribution. Alternatively, the numerical problem can be reformulated in terms of probability moment equations. Herein we present a new alternative method for numerically solving the time evolution of stochastic reaction networks. Based on the assumption that the entropy of the reaction network is maximum, Lagrange multipliers are introduced. The proposed method derives equations that model the time derivatives of these Lagrange multipliers. We present detailed steps to transform moment equations to Lagrange multiplier equations. In order to demonstrate the method, we present examples of non-linear stochastic reaction networks of varying degrees of complexity, including multistable and oscillatory systems. We find that the new approach is as accurate and significantly more efficient than Gillespie’s original exact algorithm for systems with small number of interacting species. This work is a step towards solving stochastic reaction networks accurately and efficiently.

[1]  D. Sherrington.  Stochastic Processes in Physics and Chemistry , 1983 .

[2]  Thomas Wilhelm,et al.  The smallest chemical reaction system with bistability , 2009, BMC Systems Biology.

[3]  D. A. Mcquarrie.  Stochastic approach to chemical kinetics , 1967, Journal of Applied Probability.

[4]  G. Gibson,et al.  Novel moment closure approximations in stochastic epidemics , 2005, Bulletin of mathematical biology.

[5]  Vassilios Sotiropoulos,et al.  Analytical Derivation of Moment Equations in Stochastic Chemical Kinetics. , 2011, Chemical engineering science.

[6]  F. Schlögl,et al.  On thermodynamics near a steady state , 1971 .

[7]  Deena R. Schmidt,et al.  Steady-state fluctuations of a genetic feedback loop: an exact solution. , 2012, The Journal of chemical physics.

[8]  Brian Munsky,et al.  Reduction and solution of the chemical master equation using time scale separation and finite state projection. , 2006, The Journal of chemical physics.

[9]  Hong Li,et al.  Efficient formulation of the stochastic simulation algorithm for chemically reacting systems. , 2004, The Journal of chemical physics.

[10]  J. Dormand,et al.  A family of embedded Runge-Kutta formulae , 1980 .

[11]  ZICS: an application for calculating the stationary probability distribution of stochastic reaction networks , 2018, 1806.06428.

[12]  Huaiyu Zhu.  On Information and Sufficiency , 1997 .

[13]  Marina Bosch,et al.  Elements Of Chemical Reaction Engineering , 2016 .

[14]  W. Huisinga,et al.  Solving the chemical master equation for monomolecular reaction systems analytically , 2006, Journal of mathematical biology.

[15]  Ashutosh Kumar Singh,et al.  Moment closure techniques for stochastic models in population biology , 2006, 2006 American Control Conference.

[16]  Darren J. Wilkinson,et al.  Moment closure based parameter inference of stochastic kinetic models , 2013, Stat. Comput..

[17]  Michael A. Gibson,et al.  Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels , 2000 .

[18]  Yiannis N. Kaznessis,et al.  ZI-Closure Scheme: A Method to Solve and Study Stochastic Reaction Networks , 2017 .

[19]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[20]  J. N. Kapur.  Maximum-entropy models in science and engineering , 1992 .

[21]  Elijah Roberts,et al.  Approximation and inference methods for stochastic biochemical kinetics—a tutorial review , 2017 .

[22]  Yiannis N. Kaznessis,et al.  A closure scheme for chemical master equations , 2013, Proceedings of the National Academy of Sciences.

[23]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[24]  John Lygeros,et al.  Generalized maximum entropy estimation , 2017, J. Mach. Learn. Res..

[25]  G. Nicolis,et al.  Chemical instabilities and sustained oscillations. , 1971, Journal of theoretical biology.

[26]  D. Gillespie.  A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[27]  Michail Vlysidis,et al.  A linearization method for probability moment equations , 2018, Comput. Chem. Eng..

[28]  J. Goutsias.  Quasiequilibrium approximation of fast reaction kinetics in stochastic biochemical systems. , 2005, The Journal of chemical physics.

[29]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[30]  John C. Butcher,et al.  A stability property of implicit Runge-Kutta methods , 1975 .

[31]  Jayajit Das,et al.  Purely stochastic binary decisions in cell signaling models without underlying deterministic bistabilities , 2007, Proceedings of the National Academy of Sciences.

[32]  J. Goutsias,et al.  Markovian dynamics on complex reaction networks , 2012, 1205.5524.

[33]  Ramon Grima,et al.  A study of the accuracy of moment-closure approximations for stochastic chemical kinetics. , 2012, The Journal of chemical physics.

[34]  P. H. Constantino,et al.  Maximum Entropy Prediction of Non-Equilibrium Stationary Distributions for Stochastic Reaction Networks with Oscillatory Dynamics. , 2017, Chemical engineering science.

[35]  Guido Sanguinetti,et al.  Comparison of different moment-closure approximations for stochastic chemical kinetics. , 2015, The Journal of chemical physics.

[36]  David Holcman,et al.  Stochastic Processes, Multiscale Modeling, and Numerical Methods for Computational Cellular Biology , 2017 .

[37]  Vassilios Sotiropoulos,et al.  An adaptive time step scheme for a system of stochastic differential equations with multiple multiplicative noise: chemical Langevin equation, a proof of concept. , 2008, The Journal of chemical physics.

[38]  Y. Kaznessis,et al.  Efficient Moment Matrix Generation for Arbitrary Chemical Networks. , 2012, Chemical engineering science.

[39]  Michael P H Stumpf,et al.  Multivariate moment closure techniques for stochastic kinetic models. , 2015, The Journal of chemical physics.

[40]  C. Gillespie.  Moment-closure approximations for mass-action models. , 2009, IET systems biology.

[41]  G. Nicolis,et al.  Chemical instabilities and relaxation oscillations. , 1971, Journal of theoretical biology.

[42]  Eduardo Sontag,et al.  Untangling the wires: A strategy to trace functional interactions in signaling and gene networks , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[43]  Irwin Oppenheim,et al.  Master Equations and Markov Processes , 1965 .

[44]  J. Rawlings,et al.  Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics , 2002 .

[45]  Joakim Munkhammar,et al.  Polynomial probability distribution estimation using the method of moments , 2017, PloS one.

[46]  P. H. Constantino,et al.  Modeling stochasticity in biochemical reaction networks , 2016 .

[47]  Michael P H Stumpf,et al.  A general moment expansion method for stochastic kinetic models. , 2013, The Journal of chemical physics.

[48]  J. Lygeros,et al.  Moment-based inference predicts bimodality in transient gene expression , 2012, Proceedings of the National Academy of Sciences.

[49]  D. Gillespie.  Markov Processes: An Introduction for Physical Scientists , 1991 .