A new risk-sensitive maximum principle

In this paper, a new maximum principle for the risk-sensitive control problem is established. One important feature of this result is that it applies to systems in which the diffusion term may depend on the control. Such control dependence gives rise to interesting phenomena not observed in the usual setting where control independence of the diffusion term is assumed. In particular, there is an additional second order adjoint equation and additional terms in the maximum condition that involve this second order process as well as the risk-sensitive parameter. Moreover, contrary to a conventional maximum principle, the first-order adjoint equation involved in our maximum principle is a nonlinear equation. An advantage of considering this new type of adjoint equation is that the risk-sensitive maximum principle derived is similar in form to its risk-neutral counterpart. The approach is based on the logarithmic transformation and the relationship between the adjoint variables and the value function. As an example, a linear-quadratic risk-sensitive problem is solved using the maximum principle derived.

[1]  Xun Yu Zhou,et al.  Optimal risk and dividend control for a company with a debt liability , 1998 .

[2]  X. Zhou.  On the necessary conditions of optimal controls for stochastic partial differential equations , 1993 .

[3]  Andrew E. B. Lim,et al.  Mean-Variance Portfolio Selection with Random Parameters in a Complete Market , 2002, Math. Oper. Res..

[4]  Zhou Yu.  A unified treatment of maximum principle and dynamic programming in stochastic controls , 1991 .

[5]  N. Krylov.  Controlled Diffusion Processes , 1980 .

[6]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[7]  C. Charalambous,et al.  Minimum principle for partially observable nonlinear risk-sensitive control problems using measure-valued decompositions , 1996 .

[8]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..

[9]  John B. Moore,et al.  Multiple-objective risk-sensitive control and its small noise limit , 2003, Autom..

[10]  P. Whittle.  A risk-sensitive maximum principle: the case of imperfect state observation , 1991 .

[11]  X. Zhou,et al.  Stochastic Controls: Hamiltonian Systems and HJB Equations , 1999 .

[12]  Xun Yu Zhou.  Sufficient conditions of optimality for stochastic systems with controllable diffusions , 1996, IEEE Trans. Autom. Control..

[13]  U. Haussmann,et al.  A stochastic maximum principle for optimal control of diffusions , 1986 .

[14]  J. Ma,et al.  Forward-Backward Stochastic Differential Equations and their Applications , 2007 .

[15]  Alain Bensoussan.  Stochastic Control of Partially Observable Systems: Linear filtering theory , 1992 .

[16]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[17]  P. Whittle.  A risk-sensitive maximum principle , 1990 .

[18]  H. Kushner.  Necessary conditions for continuous parameter stochastic optimization problems , 1972 .

[19]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[20]  S. Peng,et al.  Adapted solution of a backward stochastic differential equation , 1990 .

[21]  Matthew R. James,et al.  Asymptotic analysis of nonlinear stochastic risk-sensitive control and differential games , 1992, Math. Control. Signals Syst..

[22]  Charalambos D. Charalambous,et al.  On the application of minimum principle for solving partially observable risk-sensitive control problems , 1996 .