Infinite level-dependent QBD processes and matrix-analytic solutions for stochastic chemical kinetics

Systems of stochastic chemical kinetics are modeled as infinite level-dependent quasi-birth-and-death (LDQBD) processes. For these systems, in contrast to many other applications, levels have an increasing number of states as the level number increases and the probability mass may reside arbitrarily far away from lower levels. Ideas from Lyapunov theory are combined with existing matrix-analytic formulations to obtain accurate approximations to the stationary probability distribution when the infinite LDQBD process is ergodic. Results of numerical experiments on a set of problems are provided.

[1]  Holger Hermanns,et al.  Bounding the equilibrium distribution of Markov population models , 2010, Numer. Linear Algebra Appl..

[2]  A. T. Bharucha-Reid.  Elements of the Theory of Markov Processes and Their Applications , 1962 .

[3]  Danielle Liu,et al.  The censored Markov chain and the best augmentation , 1996, Journal of Applied Probability.

[4]  K. Singer,et al.  Application of the Theory of Stochastic Processes to the Study of Irreproducible Chemical Reactions and Nucleation Processes , 1953 .

[5]  P. Glynn,et al.  Bounding Stationary Expectations of Markov Processes , 2008 .

[6]  William J. Stewart,et al.  Introduction to the numerical solution of Markov Chains , 1994 .

[7]  P. Taylor,et al.  Some properties of the rate operators in level dependent quasi-birth-and-death processes with a countable number of phases , 1996 .

[8]  P J Staff.  A stochastic development of the reversible Michaelis-Menten mechanism. , 1970, Journal of theoretical biology.

[9]  Peter G. Taylor,et al.  Calculating the equilibrium distribution in level dependent quasi-birth-and-death processes , 1995 .

[10]  Hendrik Baumann,et al.  Numerical solution of level dependent quasi-birth-and-death processes , 2010, ICCS.

[11]  Richard L. Tweedie,et al.  Truncation approximations of invariant measures for Markov chains , 1998, Journal of Applied Probability.

[12]  D. A. Mcquarrie.  Stochastic approach to chemical kinetics , 1967, Journal of Applied Probability.

[13]  W. Ebeling.  Stochastic Processes in Physics and Chemistry , 1995 .

[14]  Eugene Seneta,et al.  Augmented truncations of infinite stochastic matrices , 1987 .

[15]  Ofer Biham,et al.  Stochastic simulations of genetic switch systems. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[16]  T. Hanschke,et al.  A matrix continued fraction algorithm for the multiserver repeated order queue , 1999 .

[17]  P. Jacobs,et al.  Finite birth-and-death models in randomly changing environments , 1984, Advances in Applied Probability.

[18]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[19]  Tugrul Dayar,et al.  On the Effects of Using the Grassmann-Taksar-Heyman Method in Iterative Aggregation-Disaggregation , 1996, SIAM J. Sci. Comput..

[20]  R. Tweedie.  Sufficient conditions for regularity, recurrence and ergodicity of Markov processes , 1975, Mathematical Proceedings of the Cambridge Philosophical Society.

[21]  Peter G. Taylor,et al.  Truncation and augmentation of level-independent QBD processes , 2002 .

[22]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[23]  George H. Weiss,et al.  Stochastic and Deterministic Formulation of Chemical Rate Equations , 1969 .

[24]  Winfried K. Grassmann,et al.  Regenerative Analysis and Steady State Distributions for Markov Chains , 1985, Oper. Res..

[25]  J. Collins,et al.  Construction of a genetic toggle switch in Escherichia coli , 2000, Nature.

[26]  T. Kurtz.  The Relationship between Stochastic and Deterministic Models for Chemical Reactions , 1972 .

[27]  Marcel F. Neuts,et al.  Matrix-Geometric Solutions in Stochastic Models , 1981 .

[28]  M. Thattai,et al.  Intrinsic noise in gene regulatory networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Tom Burr,et al.  Introduction to Matrix Analytic Methods in Stochastic Modeling , 2001, Technometrics.

[30]  Stefan Engblom,et al.  Computing the moments of high dimensional solutions of the master equation , 2006, Appl. Math. Comput..