Zero-Sum Stochastic Differential Games Without the Isaacs Condition: Random Rules of Priority and Intermediate Hamiltonians

For a zero-sum stochastic game which does not satisfy the Isaacs condition, we provide a value function representation for an Isaacs-type equation whose Hamiltonian lies in between the lower and upper Hamiltonians, as a convex combination of the two. For the general case (i.e. the convex combination is time and state dependent) our representation amounts to a random change of the rules of the game, to allow each player at any moment to see the other player's action or not, according to a coin toss with probabilities of heads and tails given by the convex combination appearing in the PDE. If the combination is state independent, then the rules can be set all in advance, in a deterministic way. This means that tossing the coin along the game, or tossing it repeatedly right at the beginning leads to the same value. The representations are asymptotic, over time discretizations. Space discretization is possible as well, leading to similar results.

[1]  Mihai Sîrbu,et al.  Stochastic Perron's Method for Hamilton-Jacobi-Bellman Equations , 2012, SIAM J. Control. Optim..

[2]  Erhan Bayraktar,et al.  Stochastic Perron’s method and verification without smoothness using viscosity comparison: Obstacle problems and Dynkin games , 2011 .

[3]  Differential Games of inf-sup Type and Isaacs Equations , 2005 .

[4]  G. Barles,et al.  Discontinuous solutions of deterministic optimal stopping time problems , 1987 .

[5]  A. I. Subbotin,et al.  Game-Theoretical Control Problems , 1987 .

[6]  D. W. Stroock,et al.  Multidimensional Diffusion Processes , 1979 .

[7]  S Mihai,et al.  STOCHASTIC PERRON'S METHOD AND ELEMENTARY STRATEGIES FOR ZERO-SUM DIFFERENTIAL GAMES ∗ , 2014 .

[8]  P. Varaiya,et al.  Differential Games , 1994 .

[9]  Mihai Sîrbu.  Asymptotic Perron's Method and Simple Markov Strategies in Stochastic Games and Control , 2015, SIAM J. Control. Optim..

[10]  M. Nisio,et al.  Stochastic differential games and viscosity solutions of Isaacs equations , 1988, Nagoya Mathematical Journal.

[11]  Erhan Bayraktar,et al.  Stochastic Perron's method and verification without smoothness using viscosity comparison: The linear case , 2012 .

[12]  R. Elliott.  The Existence of Value in Stochastic Differential Games , 1976 .

[13]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1991 .

[14]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.