Nonzero-Sum Risk Sensitive Stochastic Games for Continuous Time Markov Chains

We study nonzero-sum stochastic games for continuous time Markov chains on a denumerable state space with risk sensitive discounted and ergodic cost criteria. For the discounted cost criterion we first show that the corresponding system of coupled HJB equations has an appropriate solution. Then under an additional additive structure on the transition rate matrix and payoff functions, we establish the existence of a Nash equilibrium in Markov strategies. For the ergodic cost criterion we assume a Lyapunov type stability assumption and a small cost condition. Under these assumptions we show that the corresponding system of coupled HJB equations admits a solution which leads to the existence of Nash equilibrium in stationary strategies.

[1]  K. Suresh Kumar,et al.  Risk-Sensitive Ergodic Control of Continuous Time Markov Processes With Denumerable State Space , 2015 .

[2]  M. K. Ghosh,et al.  Risk-sensitive control of continuous time Markov chains , 2014, 1409.4032.

[3]  K. Suresh Kumar,et al.  Risk-Sensitive Control of Pure Jump Process on Countable Space with Near Monotone Cost , 2013 .

[4]  O. Hernández-Lerma,et al.  Zero-sum games for continuous-time jump Markov processes in Polish spaces: discounted payoffs , 2007, Advances in Applied Probability.

[5]  Lukasz Stettner,et al.  Infinite Horizon Risk Sensitive Control of Discrete Time Markov Processes under Minorization Property , 2007, SIAM J. Control. Optim..

[6]  Xianping Guo,et al.  Nonzero-sum games for continuous-time Markov chains with unbounded discounted payoffs , 2005, Journal of Applied Probability.

[7]  S. Hamadène,et al.  BSDEs and risk-sensitive control, zero-sum and nonzero-sum game problems of stochastic functional differential equations , 2003 .

[8]  Xianping Guo,et al.  Nonzero-sum games for continuous-time Markov chains with unbounded transition and average payoff rates , 2003 .

[9]  Lukasz Stettner,et al.  Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon , 1999, SIAM J. Control. Optim..

[10]  Rolando Cavazos-Cadena,et al.  Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions , 1999, Math. Methods Oper. Res..

[11]  S. Marcus,et al.  Risk sensitive control of Markov processes in countable state space , 1996 .

[12]  M. Klompstra Nash equilibria in risk-sensitive dynamic games , 1995, Proceedings of 1995 American Control Conference - ACC'95.

[13]  M. James,et al.  Risk-sensitive control and dynamic games for partially observed discrete-time nonlinear systems , 1994, IEEE Trans. Autom. Control..

[14]  Uriel G. Rothblum,et al.  Multiplicative Markov Decision Chains , 1984, Math. Oper. Res..

[15]  C. J. Himmelberg,et al.  Existence of p-equilibrium and optimal stationary strategies in stochastic games , 1976 .

[16]  Rhodes,et al.  Optimal stochastic linear systems with exponential performance criteria and their relation to deterministic differential games , 1973 .

[17]  R. Howard,et al.  Risk-Sensitive Markov Decision Processes , 1972 .

[18]  V. Benes Existence of Optimal Strategies Based on Specified Information, for a Class of Stochastic Decision Problems , 1970 .

[19]  J. Warga,et al.  Functions of Relaxed Controls , 1967 .

[20]  R. Bellman Dynamic programming. , 1957, Science.

[21]  K. Fan Fixed-point and Minimax Theorems in Locally Convex Topological Linear Spaces. , 1952, Proceedings of the National Academy of Sciences of the United States of America.