Finding analytic stationary solutions to the chemical master equation by gluing state spaces at one or two states recursively

Noise is often indispensable to key cellular activities, such as gene expression, necessitating the use of stochastic models to capture its dynamics. The chemical master equation (CME) is a commonly used stochastic model that describes how the probability distribution of a chemically reacting system varies with time. Knowing analytic solutions to the CME can have benefits, such as expediting simulations of multiscale biochemical reaction networks and aiding the design of distributional responses. However, analytic solutions are rarely known. A recent method of computing analytic stationary solutions relies on gluing simple state spaces together recursively at one or two states. We explore the capabilities of this method and introduce algorithms to derive analytic stationary solutions to the CME. We first formally characterise state spaces that can be constructed by performing single-state gluing of paths, cycles or both sequentially. We then study stochastic biochemical reaction networks that consist of reversible, elementary reactions with two-dimensional state spaces. We also discuss extending the method to infinite state spaces and designing stationary distributions that satisfy user-specified constraints. Finally, we illustrate the aforementioned ideas using examples that include two interconnected transcriptional components and chemical reactions with two-dimensional state spaces. Subject Areas Systems biology, synthetic biology, biomathematics, bioengineering

[1]  Yutaka Hori,et al.  A population‐based temporal logic gate for timing and recording chemical events , 2016, Molecular systems biology.

[2]  Richard M. Murray,et al.  A stochastic framework for the design of transient and steady state behavior of biochemical reaction networks , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[3]  D. Vecchio,et al.  Biomolecular Feedback Systems , 2014 .

[4]  João P. Hespanha,et al.  Equilibrium distributions of simple biochemical reaction systems for time-scale separation in stochastic reaction networks , 2014, Journal of The Royal Society Interface.

[5]  Domitilla Del Vecchio,et al.  Modular Composition of Gene Transcription Networks , 2014, PLoS Comput. Biol..

[6]  P. Pfaffelhuber,et al.  The Stationary Distribution of a Markov Jump Process Glued Together from Two State Spaces at Two Vertices , 2014, 1401.6400.

[7]  P. Pfaffelhuber,et al.  The stationary distribution of a Markov jump process on a state space glued together from two state spaces at two vertices , 2014 .

[8]  Domitilla Del Vecchio,et al.  Stochastic analysis of retroactivity in transcriptional networks through singular perturbation , 2012, 2012 American Control Conference (ACC).

[9]  R. Weiss,et al.  Foundations for the design and implementation of synthetic genetic circuits , 2012, Nature Reviews Genetics.

[10]  M. Elowitz,et al.  Functional roles for noise in genetic circuits , 2010, Nature.

[11]  Priscilla E. M. Purnick,et al.  The second wave of synthetic biology: from modules to systems , 2009, Nature Reviews Molecular Cell Biology.

[12]  C. Gardiner Stochastic Methods: A Handbook for the Natural and Social Sciences , 2009 .

[13]  David F. Anderson,et al.  Product-Form Stationary Distributions for Deficiency Zero Chemical Reaction Networks , 2008, Bulletin of mathematical biology.

[14]  Jehoshua Bruck,et al.  Synthesizing Stochasticity in Biochemical Systems , 2007, 2007 44th ACM/IEEE Design Automation Conference.

[15]  W. Huisinga,et al.  Solving the chemical master equation for monomolecular reaction systems analytically , 2006, Journal of mathematical biology.

[16]  Nicholas J. Guido,et al.  A bottom-up approach to gene regulation , 2006, Nature.

[17]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[18]  H. Othmer,et al.  A stochastic analysis of first-order reaction networks , 2005, Bulletin of mathematical biology.

[19]  J. Goutsias Quasiequilibrium approximation of fast reaction kinetics in stochastic biochemical systems. , 2005, The Journal of chemical physics.

[20]  C. Rao,et al.  Stochastic chemical kinetics and the quasi-steady-state assumption: Application to the Gillespie algorithm , 2003 .

[21]  J. Rawlings,et al.  Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics , 2002 .

[22]  P. Swain,et al.  Intrinsic and extrinsic contributions to stochasticity in gene expression , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[23]  D. Gillespie The chemical Langevin equation , 2000 .

[24]  Kathryn Fraughnaugh,et al.  Introduction to graph theory , 1997, Networks.

[25]  Paul C. Fife,et al.  Mathematical Aspects of Reacting and Diffusing Systems , 1979 .

[26]  D. Gillespie Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[27]  D. Gillespie A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[28]  H. Haken Exact stationary solution of the master equation for systems far from thermal equilibrium in detailed balance , 1974 .

[29]  D. A. Mcquarrie Stochastic approach to chemical kinetics , 1967, Journal of Applied Probability.

[30]  P. Staff,et al.  Stochastic Approach to First-Order Chemical Reaction Kinetics , 1966 .

[31]  Anthony F. Bartholomay,et al.  Stochastic models for chemical reactions: I. Theory of the unimolecular reaction process , 1958 .

[32]  I. Adan,et al.  Circular Markov chains , 1996 .

[33]  Dan ie l T. Gil lespie A rigorous derivation of the chemical master equation , 1992 .

[34]  M. Feinberg Chemical reaction network structure and the stability of complex isothermal reactors—I. The deficiency zero and deficiency one theorems , 1987 .

[35]  W. Mcpherson,et al.  A Course In General Chemistry , 1913 .

[36]  Jeffrey W. Smith,et al.  Stochastic Gene Expression in a Single Cell , 2022 .