Ergodic risk-sensitive stochastic differential games with reflecting diffusions in a bounded domain

Abstract In this article, we study risk-sensitive stochastic differential games for controlled reflecting diffusion processes in a smooth bounded domain. We analyze the ergodic cost evaluation criterion for both nonzero-sum games and zero-sum games. Using principal eigenvalue approach, we establish the existence of Nash/saddle-point equilibria for relevant cases.

[1]  K. Fan.  Fixed-point and Minimax Theorems in Locally Convex Topological Linear Spaces. , 1952, Proceedings of the National Academy of Sciences of the United States of America.

[2]  S. Agmon,et al.  Estimates near the boundary for solutions of elliptic partial differential equations satisfying general boundary conditions. I , 1959 .

[3]  H. Weinberger,et al.  Maximum principles in differential equations , 1967 .

[4]  V. Benes.  Existence of Optimal Strategies Based on Specified Information, for a Class of Stochastic Decision Problems , 1970 .

[5]  D. Iglehart,et al.  Multiple channel queues in heavy traffic. I , 1970, Advances in Applied Probability.

[6]  C. J. Himmelberg,et al.  Existence of p-equilibrium and optimal stationary strategies in stochastic games , 1976 .

[7]  D. Gilbarg,et al.  Elliptic Partial Differential Equa-tions of Second Order , 1977 .

[8]  A. Lemoine.  State of the Art---Networks of Queues: A Survey of Weak Convergence Results , 1978 .

[9]  H. Amann.  Dual semigroups and second order linear elliptic boundary value problems , 1983 .

[10]  Alain Bensoussan,et al.  Impulse Control and Quasi-Variational Inequalities , 1984 .

[11]  An ergodic control problem for reflected diffusion with jump , 1984 .

[12]  P. Lions,et al.  Stochastic differential equations with reflecting boundary conditions , 1984 .

[13]  Martin I. Reiman,et al.  Open Queueing Networks in Heavy Traffic , 1984, Math. Oper. Res..

[14]  H. Kushner,et al.  Optimal and approximately optimal control policies for queues in heavy traffic , 1989 .

[15]  Zhang Hanqin,et al.  MULTIPLE CHANNEL QUEUES IN HEAVY TRAFFIC , 1990 .

[16]  L. F. Martins,et al.  Routing and singular control for queueing networks in heavy traffic , 1990 .

[17]  M. K. Ghosh,et al.  Stochastic Games with Average Payoff Criterion , 1998 .

[18]  P. Malliavin.  Infinite dimensional analysis , 1993 .

[19]  L. F. Martins,et al.  Limit theorems for pathwise average cost per unit time problems for controlled queues in heavy traffic , 1993 .

[20]  M. K. Ghosh,et al.  Stochastic differential games: Occupation measure based approach , 1996 .

[21]  Giuseppe Di Fazio.  Oblique derivative problem for elliptic equations in non-divergence form with VMO coefficients , 1996 .

[22]  J. Filar,et al.  Competitive Markov Decision Processes , 1996 .

[23]  M. K. Ghosh,et al.  Zero-sum stochastic differential games with reflecting diffusions , 1997 .

[24]  H. Amann,et al.  A Priori Bounds and Multiple Solutions for Superlinear Indefinite Elliptic Problems , 1998 .

[25]  M. K. Ghosh,et al.  A Stochastic Differential Game in the Orthrant , 2002 .

[26]  Vivek S. Borkar,et al.  Ergodic Control for Constrained Diffusions: Characterization Using HJB Equations , 2004, SIAM J. Control. Optim..

[27]  J. Menaldi,et al.  Remarks on Risk-Sensitive Control Problems , 2005 .

[28]  M. K. Ghosh,et al.  A nonzero-sum stochastic differential game in the orthant , 2005 .

[29]  Juraj Húska.  Harnack inequality and exponential separation for oblique derivative problems on Lipschitz domains , 2006 .

[30]  S. Patrizi.  Principal Eigenvalues for Isaacs Operators with Neumann Boundary Conditions , 2008, 0802.0452.

[31]  H. Berestycki,et al.  Reaction-diffusionequations for population dynamics with forced speed II -cylindrical-type domains , 2009 .

[32]  V. Borkar,et al.  Risk-Sensitive Control with Near Monotone Cost , 2010 .

[33]  Mrinal K. Ghosh,et al.  Zero-Sum Risk-Sensitive Stochastic Differential Games , 2012, Math. Oper. Res..

[34]  A. Arapostathis,et al.  Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula , 2013, 1312.5834.

[35]  Y. Kamarianakis.  Ergodic control of diffusion processes , 2013 .

[36]  A. Arapostathis,et al.  Infinite horizon risk-sensitive control of diffusions without any blanket stability assumptions , 2016, 1601.00258.

[37]  Risk-sensitive control of reflected diffusion processes on orthrant , 2017, 1701.01213.

[38]  A. Biswas,et al.  Zero-Sum Stochastic Differential Games with Risk-Sensitive Cost , 2017, 1704.02689.

[39]  M. K. Ghosh,et al.  Risk-sensitive stochastic differential games with reflecting diffusions , 2018 .

[40]  Mrinal K. Ghosh,et al.  Nonzero-Sum Risk-Sensitive Stochastic Games on a Countable State Space , 2016, Math. Oper. Res..

[41]  A. Arapostathis,et al.  Strict monotonicity of principal eigenvalues of elliptic operators in Rd and risk-sensitive control , 2017, Journal de Mathématiques Pures et Appliquées.

[42]  Vivek S. Borkar,et al.  A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on ℝd , 2019, SIAM J. Control. Optim..

[43]  M. K. Ghosh,et al.  Nonzero-sum risk-sensitive stochastic differential games with discounted costs , 2020 .