Infinite Horizon Risk Sensitive Control of Discrete Time Markov Processes under Minorization Property

Risk sensitive control of Markov processes satisfying the minorization property is studied using splitting techniques. Existence of solutions to the multiplicative Poisson equation is shown. Approximation by uniformly ergodic controlled Markov processes is introduced, which allows us to show the existence of solutions to the infinite horizon risk sensitive Bellman equation.

[1]  S. Pliska,et al.  Risk-Sensitive Dynamic Asset Management , 1999 .

[2]  L. Stettner.  Duality and Risk Sensitive Portfolio Optimization , 2003 .

[3]  S. Marcus,et al.  Risk sensitive control of Markov processes in countable state space , 1996 .

[4]  W. Fleming,et al.  Risk-Sensitive Control of Finite State Machines on an Infinite Horizon I , 1997 .

[5]  E. Fernandez-Gaucherand,et al.  Controlled Markov chains with exponential risk-sensitive criteria: modularity, structured policies and applications , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[6]  E. Fernández-Gaucherand,et al.  Controlled Markov chains with risk-sensitive criteria: some (counter) examples , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[7]  Kellen Petersen August.  Real Analysis , 2009 .

[8]  Rolando Cavazos-Cadena.  Solution to the risk-sensitive average cost optimality equation in a class of Markov decision processes with finite state space , 2003, Math. Methods Oper. Res..

[9]  S. Meyn,et al.  Large Deviations Asymptotics and the Spectral Theory of Multiplicatively Regular Markov Processes , 2005, math/0509310.

[10]  S. Meyn,et al.  Spectral theory and limit theorems for geometrically ergodic Markov processes , 2002, math/0209200.

[11]  Huyên Pham,et al.  A large deviations approach to optimal long term investment , 2003, Finance Stochastics.

[12]  Rolando Cavazos-Cadena,et al.  Controlled Markov chains with risk-sensitive criteria: Average cost, optimality equations, and optimal solutions , 1999, Math. Methods Oper. Res..

[13]  Daniel Hernández-Hernández,et al.  Solution to the risk-sensitive average optimality equation in communicating Markov decision chains with finite state space: An alternative approach , 2003, Math. Methods Oper. Res..

[14]  S. Meyn,et al.  Phase transitions and metastability in Markovian and molecular systems , 2004 .

[15]  Lukasz Stettner,et al.  Risk-Sensitive Control of Discrete-Time Markov Processes with Infinite Horizon , 1999, SIAM J. Control. Optim..

[16]  V. Borkar,et al.  A further remark on dynamic programming for partially observed Markov processes , 2004 .

[17]  Ł. Stettner,et al.  Infinite horizon risk sensitive control of discrete time Markov processes with small risk , 2000 .

[18]  P. Meyer.  Probability and potentials , 1966 .

[19]  Sean P. Meyn,et al.  Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost , 2002, Math. Oper. Res..