Almost sure convergence of numerical approximations for Piecewise Deterministic Markov Processes

Hybrid systems, and Piecewise Deterministic Markov Processes in particular, are widely used to model and numerically study systems exhibiting multiple time scales in biochemical reaction kinetics and related areas. In this paper an almost sure convergence analysis for numerical simulation algorithms for Piecewise Deterministic Markov Processes is presented. The discussed numerical methods arise through discretising a constructive method defining these processes. The stochastic problem of simulating the random, path-dependent jump times of such processes is reformulated as a hitting time problem for a system of ordinary differential equations with random threshold. Then deterministic continuous methods (methods with dense output) are serially employed to solve these problems numerically. We show that the almost sure convergence rate of the stochastic algorithm is identical to the order of the embedded deterministic method. We illustrate our theoretical findings by numerical examples from mathematical neuroscience, Piecewise Deterministic Markov Processes are used as biophysically accurate stochastic models of neuronal membranes.

[1]  A. Bellen,et al.  Numerical methods for delay differential equations , 2003 .

[2]  K. Pakdaman,et al.  Fluid limit theorems for stochastic hybrid systems with application to neuron models , 2010, Advances in Applied Probability.

[3]  John Lygeros,et al.  Toward a General Theory of Stochastic Hybrid Systems , 2006 .

[4]  Nicola Bruti-Liberati,et al.  Strong approximations of stochastic differential equations with jumps , 2007 .

[5]  Georgios Kalantzis,et al.  Hybrid stochastic simulations of intracellular reaction-diffusion systems , 2009, Comput. Biol. Chem..

[6]  D. Gillespie.  A General Method for Numerically Simulating the Stochastic Time Evolution of Coupled Chemical Reactions , 1976 .

[7]  J. R. Clay,et al.  Relationship between membrane excitability and single channel open-close kinetics. , 1983, Biophysical journal.

[8]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[9]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[10]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[11]  L. Shampine,et al.  Event location for ordinary differential equations , 2000 .

[12]  S Zeiser,et al.  Simulation of genetic networks modelled by piecewise deterministic Markov processes. , 2008, IET systems biology.

[13]  Hong Li,et al.  Algorithms and Software for Stochastic Simulation of Biochemical Reacting Systems , 2008, Biotechnology progress.

[14]  Ian C. Bruce,et al.  Implementation Issues in Approximate Methods for Stochastic Hodgkin–Huxley Models , 2007, Annals of Biomedical Engineering.

[15]  Xuerong Mao,et al.  Stochastic Differential Equations With Markovian Switching , 2006 .

[16]  T. Faniran.  Numerical Solution of Stochastic Differential Equations , 2015 .

[17]  Mark H. A. Davis.  Piecewise‐Deterministic Markov Processes: A General Class of Non‐Diffusion Stochastic Models , 1984 .

[18]  Martin Georg Riedler,et al.  Spatio-temporal stochastic hybrid models of biological excitable membranes , 2011 .

[19]  Yiannis Kaznessis,et al.  Accurate hybrid stochastic simulation of a system of coupled chemical or biochemical reactions. , 2005, The Journal of chemical physics.

[20]  M. V. Tretyakov,et al.  Stochastic Numerics for Mathematical Physics , 2004, Scientific Computation.

[21]  W. Huisinga,et al.  Hybrid stochastic and deterministic simulations of calcium blips. , 2007, Biophysical journal.

[22]  F. Krogh,et al.  Solving Ordinary Differential Equations , 2019, Programming for Computations - Python.

[23]  Evelyn Buckwar,et al.  An exact stochastic hybrid model of excitable membranes including spatio-temporal evolution , 2011, Journal of mathematical biology.

[24]  J. J. Westman,et al.  State dependent jump models in optimal control , 1999, Proceedings of the 38th IEEE Conference on Decision and Control (Cat. No.99CH36304).

[25]  E. Hairer,et al.  Solving Ordinary Differential Equations II: Stiff and Differential-Algebraic Problems , 2010 .

[26]  J. Rawlings,et al.  Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics , 2002 .

[27]  勇一 作村,et al.  Biophysics of Computation , 2001 .

[28]  Craig B. Borkowf,et al.  Random Number Generation and Monte Carlo Methods , 2000, Technometrics.

[29]  Evelyn Buckwar,et al.  Runge-Kutta methods for jump-diffusion differential equations , 2011, J. Comput. Appl. Math..

[30]  Jay T. Rubinstein,et al.  Comparison of Algorithms for the Simulation of Action Potentials with Stochastic Sodium Channels , 2002, Annals of Biomedical Engineering.

[31]  Helmut Werner,et al.  Gewöhnliche Differentialgleichungen , 1986, Hochschultext.

[32]  M. Jacobsen.  Point Process Theory and Applications: Marked Point and Piecewise Deterministic Processes , 2005 .

[33]  Wilhelm Huisinga,et al.  ADAPTIVE SIMULATION OF HYBRID STOCHASTIC AND DETERMINISTIC MODELS FOR BIOCHEMICAL SYSTEMS , 2005 .