Large deviation methods for stochastic reachability

In this paper, we propose to find upper/lower bounds for different measures that characterize the reachability problem defined in the context of stochastic hybrid systems, using the theory of large deviations. For stochastic hybrid processes, criteria for large deviation results are given using properties of their infinitesimal generators‥ This represents just the first step towards applying large deviation methods for stochastic hybrid systems for treating new topics like robust control, metastability, performance analysis.

[1]  John Lygeros,et al.  Approximation of General Stochastic Hybrid Systems by Switching Diffusions with Random Hybrid Jumps , 2008, HSCC.

[2]  John Lygeros,et al.  On reachability and minimum cost optimal control , 2004, Autom..

[3]  P. Dupuis,et al.  Large deviations for Markov processes with discontinuous statistics , 1991 .

[4]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[5]  Xenofon D. Koutsoukos,et al.  Computational Methods for Verification of Stochastic Hybrid Systems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[6]  Henk A. P. Blom,et al.  Probabilistic reachability analysis for large scale stochastic hybrid systems , 2007, 2007 46th IEEE Conference on Decision and Control.

[7]  B. Matkowsky,et al.  The Exit Problem for Randomly Perturbed Dynamical Systems , 1977 .

[8]  George Yin,et al.  Asymptotic Expansions of Transition Densities for Hybrid Jump-diffusions , 2004 .

[9]  Bernard J. Matkowsky,et al.  First-order dynamics driven by rapid Markovian jumps , 1989 .

[10]  W. Fleming.  Exit probabilities and optimal stochastic control , 1977 .

[11]  John Lygeros,et al.  New insights on stochastic reachability , 2007, 2007 46th IEEE Conference on Decision and Control.

[12]  S. Varadhan,et al.  Asymptotic evaluation of certain Markov process expectations for large time , 1975 .

[13]  John Lygeros,et al.  Stochastic hybrid systems: Theory and safety critical applications , 2006 .

[14]  W. Fleming,et al.  Asymptotic expansions for Markov processes with lévy generators , 1989 .

[15]  S. Varadhan.  Large Deviations and Applications , 1984 .

[16]  Liming Wu.  A deviation inequality for non-reversible Markov processes , 2000 .

[17]  N. Krylov,et al.  Large deviations for occupation times of Markov processes with L2 semigroups , 2007, 0707.4469.

[18]  C. Knessl,et al.  An Asymptotic Theory of Large Deviations for Markov Jump Processes , 1985 .

[19]  M. Freidlin,et al.  Random Perturbations of Dynamical Systems , 1984 .

[20]  H. P..  Annales de l'Institut Henri Poincaré , 1931, Nature.