Analysis of a risk-sensitive control problem for hidden Markov chains

In this paper the risk-sensitive control of partially observed Markov decision processes is considered. The replacement problem is analyzed in this context, and the structure of risk sensitive optimal controllers is given.

[1]  Mathukumalli Vidyasagar,et al.  Optimal rejection of persistent bounded disturbances , 1986 .

[2]  A. Arapostathis,et al.  Analysis of an adaptive control scheme for a partially observed controlled Markov chain , 1990, 29th IEEE Conference on Decision and Control.

[3]  Ari Arapostathis,et al.  On the average cost optimality equation and the structure of optimal policies for partially observable Markov decision processes , 1991, Ann. Oper. Res..

[4]  Matthew R. James,et al.  Asymptotic analysis of nonlinear stochastic risk-sensitive control and differential games , 1992, Math. Control. Signals Syst..

[5]  W. Fleming,et al.  Risk sensitive optimal control and differential games , 1992 .

[6]  Ari Arapostathis,et al.  Analysis of an adaptive control scheme for a partially observed controlled Markov chain , 1990 .

[7]  T. Runolfsson The equivalence between infinite-horizon optimal control of stochastic systems with exponential-of-integral performance index and stochastic differential games , 1994, IEEE Trans. Autom. Control..

[8]  S.,et al.  Risk-Sensitive Control and Dynamic Games for Partially Observed Discrete-Time Nonlinear Systems , 1994 .

[9]  M. James,et al.  Robust and Risk-Sensitive Output Feedback Control for Finite State Machines and Hidden Markov Models , 1994 .

[10]  W. Fleming,et al.  Risk-Sensitive Control on an Infinite Time Horizon , 1995 .

[11]  S. Marcus,et al.  Risk sensitive control of Markov processes in countable state space , 1996 .

[12]  S. Marcus,et al.  Robust Control of Markov Decision Processes and Connection to Risk-sensitive Control , 1996 .

[13]  W. Fleming,et al.  Risk-Sensitive Control of Finite State Machines on an Infinite Horizon I , 1997 .

[14]  Daniel Hernández-Hernández,et al.  Risk Sensitive Markov Decision Processes , 1997 .

[15]  E. Fernández-Gaucherand,et al.  Risk-sensitive optimal control of hidden Markov models: structural results , 1997, IEEE Trans. Autom. Control..

[16]  R. Elliott,et al.  Certain nonlinear partially observable stochastic optimal control problems with explicit control laws equivalent to LEQG/LQG problems , 1997, IEEE Trans. Autom. Control..

[17]  Andrzej Świe,et al.  Risk-sensitive Control and Diierential Games in Innnite Dimensions 1 , .