Approximation of the Value Function for a Class of Differential Games with Target

We consider the approximation of a class of differential games with target by stochastic games. We use Kruzkov transformation to obtain discounted costs. The approximation is based on a space discretization of the state space and leads to consider the value function of the differential game as the limit of the value function of a sequence of stochastic games. To prove the convergence, we use the notion of viscosity solution for partial differential equations. This allows us to make assumptions only on the continuity of the value function and not on its differentiability. This technique of proof has been used before by M. Bardi, M. Falcone and P. Soravia for another kind of discretization. Under the additional hypothesis that the value function is Lipschitz continuous, we prove that the rate of convergence of this scheme is of order $\sqrt{h}$ where $h$ is the space parameter of discretization.\\ Some numerical experiments are presented in order to test the algorithm for a problem with discontinuous solution.

[1]  B. Alziary de Roquefort Jeux différentiels et approximation numérique de fonctions valeur. 1re partie : étude théorique , 1991 .

[2]  H. Ishii Perron’s method for Hamilton-Jacobi equations , 1987 .

[3]  H. Ishii,et al.  Approximate solutions of the bellman equation of deterministic control theory , 1984 .

[4]  Mabel M. Tidball,et al.  Zero Sum Differential Games With Stopping Times: Some Results About its Numerical Resolution , 1994 .

[5]  R. González,et al.  On Deterministic Control Problems: An Approximation Procedure for the Optimal Cost I. The Stationary Problem , 1985 .

[6]  I. Dolcetta On a discrete approximation of the Hamilton-Jacobi equation of dynamic programming , 1983 .

[7]  M. Bardi,et al.  A PDE framework for games of pursuit-evasion type , 1989 .

[8]  M. Falcone,et al.  Discrete approximation of the minimal time function for systems with regular optimal trajectories , 1990 .

[9]  Leonard D. Berkovitz Differential games of generalized pursuit and evasion , 1986 .

[10]  M. Bardi,et al.  Approximation of differential games of pursuit-evasion by discrete-time games , 1991 .

[11]  T. E. S. Raghavan,et al.  Algorithms for stochastic games — A survey , 1991, ZOR Methods Model. Oper. Res..

[12]  H. Brezis Analyse fonctionnelle : théorie et applications , 1983 .

[13]  R. L. V. Gonzalez,et al.  Sur l'ordre de convergence des solutions discrétisées en temps et en espace de l'équation de Hamilton-Jacobi , 1992 .

[14]  M. Falcone,et al.  Fully Discrete Schemes for the Value Function of Pursuit-Evasion Games , 1994 .

[15]  P. Lions Generalized Solutions of Hamilton-Jacobi Equations , 1982 .

[16]  M. Falcone,et al.  An approximation scheme for the minimum time function , 1990 .