Order Reduction of the Chemical Master Equation via Balanced Realisation

We consider a Markov process in continuous time with a finite number of discrete states. The time-dependent probabilities of being in any state of the Markov chain are governed by a set of ordinary differential equations, whose dimension might be large even for trivial systems. Here, we derive a reduced ODE set that accurately approximates the probabilities of subspaces of interest with a known error bound. Our methodology is based on model reduction by balanced truncation and can be considerably more computationally efficient than solving the chemical master equation directly. We show the applicability of our method by analysing stochastic chemical reactions. First, we obtain a reduced order model for the infinitesimal generator of a Markov chain that models a reversible, monomolecular reaction. Later, we obtain a reduced order model for a catalytic conversion of substrate to a product (a so-called Michaelis-Menten mechanism), and compare its dynamics with a rapid equilibrium approximation method. For this example, we highlight the savings on the computational load obtained by means of the reduced-order model. Furthermore, we revisit the substrate catalytic conversion by obtaining a lower-order model that approximates the probability of having predefined ranges of product molecules. In such an example, we obtain an approximation of the output of a model with 5151 states by a reduced model with 16 states. Finally, we obtain a reduced-order model of the Brusselator.

[1]  A. Antoulas,et al.  A Survey of Model Reduction by Balanced Truncation and Some New Results , 2004 .

[2]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[3]  R. Kálmán Mathematical description of linear dynamical systems , 1963 .

[4]  John Odentrantz,et al.  Markov Chains: Gibbs Fields, Monte Carlo Simulation, and Queues , 2000, Technometrics.

[5]  L. A. Segel,et al.  The Quasi-Steady-State Assumption: A Case Study in Perturbation , 1989, SIAM Rev..

[6]  Philipp Thomas,et al.  Communication: limitations of the stochastic quasi-steady-state approximation in open biochemical reaction networks. , 2011, The Journal of chemical physics.

[7]  I. Prigogine,et al.  On symmetry-breaking instabilities in dissipative systems , 1967 .

[8]  S. Rinaldi,et al.  Positive Linear Systems: Theory and Applications , 2000 .

[9]  James Lam,et al.  Internal positivity preserved model reduction , 2010, Int. J. Control.

[10]  Tatiana T Marquez-Lago,et al.  Reduction of chemical reaction networks through delay distributions. , 2013, The Journal of chemical physics.

[11]  Tatiana T. Marquez-Lago,et al.  Exact Probability Distributions of Selected Species in Stochastic Chemical Reaction Networks , 2014, Bulletin of mathematical biology.

[12]  Olaf Wolkenhauer,et al.  Stochastic approaches in systems biology , 2010, Wiley interdisciplinary reviews. Systems biology and medicine.

[13]  L. Allen An introduction to stochastic processes with applications to biology , 2003 .

[14]  J. Rawlings,et al.  Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics , 2002 .

[15]  M. Khammash,et al.  The finite state projection algorithm for the solution of the chemical master equation. , 2006, The Journal of chemical physics.

[16]  James Lam,et al.  Positivity-preserving H∞ model reduction for positive systems , 2011, Autom..

[17]  K. Burrage,et al.  A Krylov-based finite state projection algorithm for solving the chemical master equation arising in the discrete modelling of biological systems , 2006 .

[18]  Andre Leier,et al.  Exact model reduction with delays: closed-form distributions and extensions to fully bi-directional monomolecular reactions , 2014, Journal of The Royal Society Interface.

[19]  Ian Postlethwaite,et al.  Multivariable Feedback Control: Analysis and Design , 1996 .

[20]  Tobias Damm,et al.  A symmetry approach for balanced truncation of positive linear systems , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[21]  Chi-Tsong Chen,et al.  Linear System Theory and Design , 1995 .

[22]  C. P. Therapos,et al.  Balancing transformations for unstable nonminimal linear systems , 1989 .

[23]  I. Prigogine,et al.  Symmetry Breaking Instabilities in Dissipative Systems. II , 1968 .

[24]  Enrique S. Quintana-Ortí,et al.  Model Reduction Based on Spectral Projection Methods , 2005 .

[25]  L. Silverman,et al.  Model reduction via balanced state space representations , 1982 .

[26]  Rafael Mayo,et al.  Parallel Algorithms for Balanced Truncation Model Reduction of Sparse Systems , 2004, PARA.

[27]  Y. Saad Analysis of some Krylov subspace approximations to the matrix exponential operator , 1992 .

[28]  Jörg Stelling,et al.  Counter-intuitive stochastic behavior of simple gene circuits with negative feedback. , 2010, Biophysical journal.

[29]  Tobias Jahnke,et al.  On Reduced Models for the Chemical Master Equation , 2011, Multiscale Model. Simul..

[30]  J. Doyle,et al.  Robust and optimal control , 1995, Proceedings of 35th IEEE Conference on Decision and Control.

[31]  Vikram Sunkara,et al.  Analysis and numerics of the chemical master equation , 2013 .

[32]  Dan ie l T. Gil lespie A rigorous derivation of the chemical master equation , 1992 .

[33]  Kevin R. Sanft,et al.  Legitimacy of the stochastic Michaelis-Menten approximation. , 2011, IET systems biology.

[34]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[35]  Chang Hyeong Lee,et al.  An analytical approach to solutions of master equations for stochastic nonlinear reactions , 2012, Journal of Mathematical Chemistry.

[36]  B. Moore Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[37]  K. Burrage,et al.  Computational approaches for modeling intrinsic noise and delays in genetic regulatory networks , 2010 .

[38]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[39]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[40]  Linda R Petzold,et al.  The subtle business of model reduction for stochastic chemical kinetics. , 2009, The Journal of chemical physics.

[41]  Mi-Ching Tsai,et al.  Robust and Optimal Control , 2014 .

[42]  Wilhelm Huisinga,et al.  Hybrid Stochastic-Deterministic Solution of the Chemical Master Equation , 2012, Multiscale Model. Simul..