Distribution Approximations for the Chemical Master Equation: Comparison of the Method of Moments and the System Size Expansion

The stochastic nature of chemical reactions has resulted in an increasing research interest in discrete-state stochastic models and their analysis. A widely used approach is the description of the temporal evolution of such systems in terms of a chemical master equation (CME). In this paper we study two approaches for approximating the underlying probability distributions of the CME. The first approach is based on an integration of the statistical moments and the reconstruction of the distribution based on the maximum entropy principle. The second approach relies on an analytical approximation of the probability distribution of the CME using the system size expansion, considering higher order terms than the linear noise approximation. We consider gene expression networks with unimodal and multimodal protein distributions to compare the accuracy of the two approaches. We find that both methods provide accurate approximations to the distributions of the CME while having different benefits and limitations in applications.

[1]  Darren J. Wilkinson.  Stochastic Modelling for Systems Biology , 2006 .

[2]  Philipp Thomas,et al.  Communication: limitations of the stochastic quasi-steady-state approximation in open biochemical reaction networks. , 2011, The Journal of chemical physics.

[3]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[4]  P. Swain,et al.  Intrinsic and extrinsic contributions to stochasticity in gene expression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Dianne P. O'Leary,et al.  Adaptive change of basis in entropy-based moment closures for linear kinetic equations , 2013, J. Comput. Phys..

[6]  D. Sherrington.  Stochastic Processes in Physics and Chemistry , 1983 .

[7]  P. Whittle.  On the Use of the Normal Approximation in the Treatment of Stochastic Processes , 1957 .

[8]  G. Gibson,et al.  Novel moment closure approximations in stochastic epidemics , 2005, Bulletin of mathematical biology.

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  Rafail V. Abramov,et al.  The multidimensional maximum entropy moment problem: a review of numerical methods , 2010 .

[11]  Stefan Engblom,et al.  Computing the moments of high dimensional solutions of the master equation , 2006, Appl. Math. Comput..

[12]  Verena Wolf,et al.  Reconstruction of Multimodal Distributions for Hybrid Moment-based Chemical Kinetics, Supporting Information , 2014 .

[13]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[14]  Wolf Verena,et al.  Reconstruction of Multimodal Distributions for Hybrid Moment-based Chemical Kinetics , 2014 .

[15]  L. Mead,et al.  Maximum entropy in the problem of moments , 1984 .

[16]  C. Gillespie.  Moment-closure approximations for mass-action models. , 2009, IET systems biology.

[17]  R. Grima,et al.  How reliable is the linear noise approximation of gene regulatory networks? , 2013, BMC Genomics.

[18]  E. O’Shea,et al.  Living with noisy genes: how cells function reliably with inherent variability in gene expression. , 2007, Annual review of biophysics and biomolecular structure.

[19]  V. Climenhaga.  Markov chains and mixing times , 2013 .

[20]  Thomas A. Henzinger,et al.  Fast Adaptive Uniformization of the Chemical Master Equation , 2009 .

[21]  Philipp Thomas,et al.  Approximate probability distributions of the master equation. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[22]  Jeffrey W. Smith,et al.  Stochastic Gene Expression in a Single Cell , 2022 .

[23]  Kevin R. Sanft,et al.  Legitimacy of the stochastic Michaelis-Menten approximation. , 2011, IET systems biology.

[24]  D. Gillespie,et al.  A diffusional bimolecular propensity function. , 2009, The Journal of chemical physics.

[25]  R. Grima,et al.  An effective rate equation approach to reaction kinetics in small volumes: theory and application to biochemical reactions in nonequilibrium steady-state conditions. , 2010, The Journal of chemical physics.

[26]  Michael P H Stumpf,et al.  A general moment expansion method for stochastic kinetic models. , 2013, The Journal of chemical physics.

[27]  Philipp Thomas,et al.  Computation of biochemical pathway fluctuations beyond the linear noise approximation using iNA , 2012, 2012 IEEE International Conference on Bioinformatics and Biomedicine.

[28]  Yin Zhang,et al.  A Fast Newton Algorithm for Entropy Maximization in Phase Determination , 2001, SIAM Rev..

[29]  Daniel T Gillespie,et al.  Stochastic simulation of chemical kinetics. , 2007, Annual review of physical chemistry.

[30]  Guido Sanguinetti,et al.  Comparison of different moment-closure approximations for stochastic chemical kinetics. , 2015, The Journal of chemical physics.

[31]  Johan Paulsson,et al.  Mesoscopic kinetics and its applications in protein synthesis , 2005 .

[32]  N. Popović,et al.  Phenotypic switching in gene regulatory networks , 2014, Proceedings of the National Academy of Sciences.

[33]  James H. Matis,et al.  On interacting bee/mite populations: a stochastic model with analysis using cumulant truncation , 2002, Environmental and Ecological Statistics.

[34]  Ramon Grima,et al.  A study of the accuracy of moment-closure approximations for stochastic chemical kinetics. , 2012, The Journal of chemical physics.

[35]  L. Comtet,et al.  Advanced Combinatorics: The Art of Finite and Infinite Expansions , 1974 .

[36]  A. Arkin,et al.  Stochastic mechanisms in gene expression. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Fabian J Theis,et al.  Method of conditional moments (MCM) for the Chemical Master Equation , 2013, Journal of Mathematical Biology.

[38]  P. Swain,et al.  Strategies for cellular decision-making , 2009, Molecular systems biology.

[39]  João Pedro Hespanha,et al.  Approximate Moment Dynamics for Chemically Reacting Systems , 2011, IEEE Transactions on Automatic Control.

[40]  Luca Bortolussi,et al.  Hybrid behaviour of Markov population models , 2012, Inf. Comput..

[41]  J. Elf,et al.  Fast evaluation of fluctuations in biochemical networks with the linear noise approximation. , 2003, Genome research.

[42]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[43]  G. Castellani,et al.  Active Degradation Explains the Distribution of Nuclear Proteins during Cellular Senescence , 2015, PloS one.

[44]  Peter Buchholz,et al.  A Unified Approach to the Moments Based Distribution Estimation - Unbounded Support , 2005, EPEW/WS-FM.

[45]  Verena Wolf,et al.  SHAVE: stochastic hybrid analysis of markov population models , 2011, HSCC '11.

[46]  Verena Wolf,et al.  Model Reconstruction for Moment-Based Stochastic Chemical Kinetics , 2015, ACM Trans. Model. Comput. Simul..

[47]  Vahid Shahrezaei,et al.  Analytical distributions for stochastic gene expression , 2008, Proceedings of the National Academy of Sciences.

[48]  Guido Sanguinetti,et al.  Validity conditions for moment closure approximations in stochastic chemical kinetics. , 2014, The Journal of chemical physics.

[49]  J.P. Hespanha,et al.  Lognormal Moment Closures for Biochemical Reactions , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.