Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon

In this paper we study existence of solutions to the Bellman equation corresponding to risk-sensitive ergodic control of discrete-time Markov processes using three different approaches. Also, for particular classes of systems, asymptotics for vanishing risk factor is investigated, showing that in the limit the optimal value for an average cost per unit time is obtained.

[1]  Rolando Cavazos-Cadena,et al.  Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions , 1999, Math. Methods Oper. Res..

[2]  D. Stroock.  An Introduction to the Theory of Large Deviations , 1984 .

[3]  W. Fleming,et al.  Risk-Sensitive Control of Finite State Machines on an Infinite Horizon I , 1997 .

[4]  M. J. Sobel,et al.  Discounted MDP's: distribution functions and exponential utility maximization , 1987 .

[5]  Wolfgang J. Runggaldier,et al.  Connections between stochastic control and dynamic games , 1996, Math. Control. Signals Syst..

[6]  H. Nagai.  Bellman equations of risk sensitive control , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[7]  T. Runolfsson,et al.  Stationary risk-sensitive LQG control and its relation to LQG and H-infinity control , 1990, 29th IEEE Conference on Decision and Control.

[8]  S. Marcus,et al.  Risk sensitive control of Markov processes in countable state space , 1996 .

[9]  W. Fleming,et al.  Risk-Sensitive Control on an Infinite Time Horizon , 1995 .

[10]  O. Hernández-Lerma.  Adaptive Markov Control Processes , 1989 .

[11]  Toshio Odanaka,et al.  ADAPTIVE CONTROL PROCESSES , 1990 .

[12]  P. Whittle.  Risk-sensitive linear/quadratic/gaussian control , 1981, Advances in Applied Probability.

[13]  S. Varadhan,et al.  Asymptotic evaluation of certain Markov process expectations for large time , 1975 .

[14]  K. Glover,et al.  State-space formulae for all stabilizing controllers that satisfy an H(infinity)-norm bound and relations to risk sensitivity , 1988 .