New insights on stochastic reachability

In this paper, we give new characterizations of the stochastic reachability problem for stochastic hybrid systems in the language of different theories that can be employed in studying stochastic processes (Markov processes, potential theory, optimal control). These characterizations are further used to obtain the probabilities involved in the context of stochastic reachability as viscosity solutions of some variational inequalities.

[1]  S. Sastry,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[2]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[3]  Holger Hermanns,et al.  Functional Abstractions of stochastic Hybrid Systems , 2006, ADHS.

[4]  Vassili N. Kolokoltsov,et al.  On Markov processes with decomposable pseudo-differential generators , 2004 .

[5]  John Lygeros,et al.  Reachability Questions in Piecewise Deterministic Markov Processes , 2003, HSCC.

[6]  G. A. Hunt.  Markoff processes and potentials II , 1957 .

[7]  Henk A. P. Blom,et al.  Stochastic Hybrid Processes with Hybrid Jumps , 2003, ADHS.

[8]  Jean-Luc Ville.  Étude critique de la notion de collectif , 1939 .

[9]  J. Lygeros,et al.  General stochastic hybrid systems: modelling and optimal control , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[10]  J. Doob.  Stochastic processes , 1953 .

[11]  S. Ethier,et al.  Markov Processes: Characterization and Convergence , 2005 .

[12]  Manuela L. Bujorianu,et al.  Extended Stochastic Hybrid Systems and Their Reachability Problem , 2004, HSCC.

[13]  Lepeltier,et al.  A PROBABILISTIC APPROACH TO THE REDUITE IN OPTIMAL STOPPING , 2008 .

[14]  M. Brelot.  Classical potential theory and its probabilistic counterpart , 1986 .

[15]  Goran Peskir,et al.  Optimal Stopping and Dynamic Programming , 2008 .

[16]  J. Hespanha,et al.  Stochastic models for chemically reacting systems using polynomial stochastic hybrid systems , 2005 .

[17]  van der Arjan Schaft,et al.  Stochastic Hybrid Systems: Theory and Safety Critical Applications , 2006 .

[18]  John Lygeros,et al.  Towars a Theory of Stochastic Hybrid Systems , 2000, HSCC.

[19]  John Lygeros,et al.  Stochastic Hybrid Models: An Overview , 2003, ADHS.

[20]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[21]  Bruno Bassan,et al.  Regularity of the value function and viscosity solutions in optimal stopping problems for general Markov processes , 2002 .