Comparing Hitting Time Behavior of Markov Jump Processes and Their Diffusion Approximations

Markov jump processes can provide accurate models in many applications, notably chemical and biochemical kinetics, and population dynamics. Stochastic differential equations offer a computationally efficient way to approximate these processes. It is therefore of interest to establish results that shed light on the extent to which the jump and diffusion models agree. In this work we focus on mean hitting time behavior in a thermodynamic limit. We study three simple types of reactions where analytical results can be derived, and we find that the match between mean hitting time behavior of the two models is vastly different in each case. In particular, for a degradation reaction we find that the relative discrepancy decays extremely slowly, namely, as the inverse of the logarithm of the system size. After giving some further computational results, we conclude by pointing out that studying hitting times allows the Markov jump and stochastic differential equation regimes to be compared in a manner that avoids ...

[1]  David R. Appleton,et al.  Modelling Biological Populations in Space and Time , 1993 .

[2]  V. Zhdanov.  Transient stochastic bistable kinetics of gene transcription during the cellular growth , 2006 .

[3]  Darren J. Wilkinson.  Stochastic Modelling for Systems Biology , 2006 .

[4]  David McMillen,et al.  Biochemical Network Stochastic Simulator (BioNetS): software for stochastic modeling of biochemical networks , 2004, BMC Bioinformatics.

[5]  Linda R Petzold,et al.  The slow-scale stochastic simulation algorithm. , 2005, The Journal of chemical physics.

[6]  Wulfram Gerstner,et al.  Noise in Integrate-and-Fire Neurons: From Stochastic Input to Escape Rates , 2000, Neural Computation.

[7]  D. Gillespie,et al.  Deterministic limit of stochastic chemical kinetics. , 2009, The journal of physical chemistry. B.

[8]  Desmond J. Higham,et al.  Switching and Diffusion Models for Gene Regulation Networks , 2009, Multiscale Model. Simul..

[9]  Linda R. Petzold,et al.  Stochastic Modeling of Gene Regulatory Networks y , 2005 .

[10]  H. Othmer,et al.  A stochastic analysis of first-order reaction networks , 2005, Bulletin of mathematical biology.

[11]  Desmond J. Higham,et al.  Chemical Master Equation and Langevin regimes for a gene transcription model , 2007, Theor. Comput. Sci..

[12]  Desmond J. Higham.  A Matrix Perturbation View of the Small World Phenomenon , 2007, SIAM Rev..

[13]  S. Karlin,et al.  A second course in stochastic processes , 1981 .

[14]  D. Gillespie.  The Chemical Langevin and Fokker−Planck Equations for the Reversible Isomerization Reaction† , 2002 .

[15]  E Weinan,et al.  Nested stochastic simulation algorithms for chemical kinetic systems with multiple time scales , 2007, J. Comput. Phys..

[16]  S. Swain.  Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences , 1984 .

[17]  Tianhai Tian,et al.  Stochastic Modeling of Gene Regulatory Networks , 2011 .

[18]  Desmond J. Higham,et al.  Modeling and Simulating Chemical Reactions , 2008, SIAM Rev..

[19]  Kenneth Dixon,et al.  Introduction to Stochastic Modeling , 2011 .

[20]  D. Gillespie.  Exact Stochastic Simulation of Coupled Chemical Reactions , 1977 .

[21]  D. Gillespie.  Markov Processes: An Introduction for Physical Scientists , 1991 .

[22]  J. Glaz.  Probabilities and Moments for Absorption in Finite Homogeneous Birth-Death Processes , 1979 .

[23]  T. Kurtz,et al.  Submitted to the Annals of Applied Probability ASYMPTOTIC ANALYSIS OF MULTISCALE APPROXIMATIONS TO REACTION NETWORKS , 2022 .

[24]  D. Gillespie,et al.  Stochastic Modeling of Gene Regulatory Networks † , 2005 .

[25]  Desmond J. Higham,et al.  Greedy pathlengths and small world graphs , 2006 .

[26]  D. Gillespie.  A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[27]  D. Owen.  Handbook of Mathematical Functions with Formulas , 1965 .

[28]  X. Mao,et al.  Stochastic Differential Equations and Applications , 1998 .

[29]  Tiejun Li,et al.  Analysis of Explicit Tau-Leaping Schemes for Simulating Chemically Reacting Systems , 2007, Multiscale Model. Simul..

[30]  Olli Yli-Harja,et al.  Stochastic Differential Equation Model for Cerebellar Granule Cell Excitability , 2008, PLoS Comput. Biol..

[31]  D. Gillespie.  The chemical Langevin equation , 2000 .

[32]  C. W. Gardiner,et al.  Handbook of stochastic methods - for physics, chemistry and the natural sciences, Second Edition , 1986, Springer series in synergetics.

[33]  Introduction to Asymptotics: A Treatment using Nonstandard Analysis , 1997 .

[34]  Desmond J. Higham,et al.  Chemical master versus chemical langevin for first-order reaction networks , 2008 .

[35]  T. Kurtz.  Approximation of Population Processes , 1987 .