A Toolbox of Hamilton-Jacobi Solvers for Analysis of Nondeterministic Continuous and Hybrid Systems

Hamilton-Jacobi partial differential equations have many applications in the analysis of nondeterministic continuous and hybrid systems. Unfortunately, analytic solutions are seldom available and numerical approximation requires a great deal of programming infrastructure. In this paper we describe the first publicly available toolbox for approximating the solution of such equations, and discuss three examples of how these equations can be used in system analysis: cost to go, stochastic differential games, and stochastic hybrid systems. For each example we briefly summarize the relevant theory, describe the toolbox implementation, and provide results.

[1]  Ronald Fedkiw,et al.  Level set methods and dynamic implicit surfaces , 2002, Applied mathematical sciences.

[2]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[3]  Thomas A. Henzinger,et al.  Hybrid Systems: Computation and Control , 1998, Lecture Notes in Computer Science.

[4]  H. Ishii.  On uniqueness and existence of viscosity solutions of fully nonlinear second‐order elliptic PDE's , 1989 .

[5]  P. Souganidis,et al.  Differential Games and Representation Formulas for Solutions of Hamilton-Jacobi-Isaacs Equations. , 1983 .

[6]  P. Varaiya,et al.  Differential games , 1971 .

[7]  S. Osher.  A level set formulation for the solution of the Dirichlet problem for Hamilton-Jacobi equations , 1993 .

[8]  M. K. Ghosh,et al.  Ergodic Control of Switching Diffusions , 1997 .

[9]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[10]  Alexandre M. Bayen,et al.  A time-dependent Hamilton-Jacobi formulation of reachable sets for continuous dynamic games , 2005, IEEE Transactions on Automatic Control.

[11]  J. Hespanha.  A model for stochastic hybrid systems with application to communication networks , 2005 .

[12]  T. Başar,et al.  Stochastic and differential games : theory and numerical methods , 1999 .

[13]  Marc Mangel,et al.  Decision and control in uncertain resource systems , 1986 .

[14]  Alexander Vladimirsky,et al.  Ordered Upwind Methods for Static Hamilton-Jacobi Equations: Theory and Algorithms , 2003, SIAM J. Numer. Anal..

[15]  Stanley Osher,et al.  Fast Sweeping Algorithms for a Class of Hamilton-Jacobi Equations , 2003, SIAM J. Numer. Anal..

[16]  João Pedro Hespanha,et al.  Stochastic Hybrid Systems: Application to Communication Networks , 2004, HSCC.

[17]  P. Saint-Pierre,et al.  Optimal times for constrained nonlinear control problems without local controllability , 1997 .

[18]  P. Souganidis.  Two-Player, Zero-Sum Differential Games and Viscosity Solutions , 1999 .

[19]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[20]  H. Kushner.  Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[21]  Alberto L. Sangiovanni-Vincentelli,et al.  Optimal Control Using Bisimulations: Implementation , 2001, HSCC.

[22]  Ian M. Mitchell,et al.  A Toolbox of Level Set Methods , 2005 .

[23]  J. Filar,et al.  Control of singularly perturbed hybrid stochastic systems , 1996, Proceedings of 35th IEEE Conference on Decision and Control.

[24]  Alexandre M. Bayen,et al.  Computational techniques for the verification of hybrid systems , 2003, Proc. IEEE.