Approximation Methods for Hybrid Diffusion Systems with State-Dependent Switching Processes: Numerical Algorithms and Existence and Uniqueness of Solutions

Focusing on hybrid diffusions in which continuous dynamics and discrete events coexist, this work is concerned with approximation of solutions for hybrid stochastic differential equations with a state-dependent switching process. Iterative algorithms are developed. The continuous-state-dependent switching process presents added difficulties in analyzing the numerical procedures. Weak convergence of the algorithms is established by a martingale problem formulation first. This weak convergence result is then used as a bridge to obtain strong convergence. In this process, the existence and uniqueness of the solution of the switching diffusions with continuous-state-dependent switching are obtained. In contrast to existing results of solutions of stochastic differential equations in which the Picard iterations are utilized, Euler's numerical schemes are considered here. Moreover, decreasing-stepsize algorithms together with their weak convergence are given. Numerical experiments are also provided for demonstr...

[1]  R. Z. Khasminskii,et al.  Singularly Perturbed Switching Diffusions: Rapid Switchings and Fast Diffusions , 1999 .

[2]  D. Elworthy.  ASYMPTOTIC METHODS IN THE THEORY OF STOCHASTIC DIFFERENTIAL EQUATIONS , 1992 .

[3]  X. Mao,et al.  Stochastic Differential Equations and Applications , 1998 .

[4]  Q. Zhang,et al.  Stock Trading: An Optimal Selling Rule , 2001, SIAM J. Control. Optim..

[5]  G. Kallianpur.  Stochastic differential equations and diffusion processes , 1981 .

[6]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[7]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[8]  R. H. Liu,et al.  Recursive Algorithms for Stock Liquidation: A Stochastic Optimization Approach , 2002, SIAM J. Optim..

[9]  Harold J. Kushner,et al.  Approximation and Weak Convergence Methods for Random Processes , 1984 .

[10]  G. Milstein.  Numerical Integration of Stochastic Differential Equations , 1994 .

[11]  David D. Sworder,et al.  Estimation Problems in Hybrid Systems , 1999 .

[12]  Gang George Yin,et al.  Asymptotic Properties of Hybrid Diffusion Systems , 2007, SIAM J. Control. Optim..

[13]  Xuerong Mao,et al.  Stochastic Differential Equations With Markovian Switching , 2006 .

[14]  Andrew L. Rukhin,et al.  Continuous-Time Markov Chains and Applications: A Singular Perturbation Approach , 2001, Technometrics.

[15]  X. Mao,et al.  Asymptotic stability in distribution of stochastic differential equations with Markovian switching , 2003 .

[16]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[17]  Kai Liu.  Stochastic Stability of Differential Equations in Abstract Spaces , 2019 .

[18]  P. Kloeden,et al.  Numerical Solution of Stochastic Differential Equations , 1992 .

[19]  L. Rogers.  Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[20]  Kai Lai Chung,et al.  Markov Chains with Stationary Transition Probabilities , 1961 .

[21]  X. Mao.  Stability of stochastic differential equations with Markovian switching , 1999 .

[22]  Andrew M. Stuart,et al.  Strong Convergence of Euler-Type Methods for Nonlinear Stochastic Differential Equations , 2002, SIAM J. Numer. Anal..

[23]  Gang George Yin,et al.  Weak Convergence of Hybrid Filtering Problems Involving Nearly Completely Decomposable Hidden Markov Chains , 2002, SIAM J. Control. Optim..

[24]  Gopal K. Basak,et al.  Stability of a Random diffusion with linear drift , 1996 .

[25]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .