Necessary conditions for optimality in relaxed stochastic control problems

In this paper, we are concerned with optimal control problems where the system is driven by a stochastic differential equation of the Ito type. We study the relaxed model for which an optimal solution exists. This is an extension of the initial control problem, where admissible controls are measure valued processes. Using Ekeland's variational principle and some stability properties of the corresponding state equation and adjoint processes, we establish necessary conditions for optimality satisfied by an optimal relaxed control. This is the first version of the stochastic maximum principle that covers relaxed controls.

[1]  Brahim Mezerdi,et al.  The maximum principle for optimal control of diffusions with non-smooth coefficients , 1996 .

[2]  Harold J. Kushner,et al.  Existence results for optimal stochastic controls , 1975 .

[3]  Optimal control of partially observed diffusions via the separation principle , 1982 .

[4]  Robert J. Elliott,et al.  The second order minimum principle and adjoint process , 1994 .

[5]  U. Haussmann.  General necessary conditions for optimal control of stochastic systems , 1976 .

[6]  N. Krylov.  Controlled Diffusion Processes , 1980 .

[7]  I. Karatzas,et al.  The Stochastic Maximum Principle for Linear, Convex Optimal Control with Random Coefficients , 1995 .

[8]  S. Peng.  A general stochastic maximum principle for optimal control problems , 1990 .

[9]  Alain Bensoussan,et al.  Maximum principle and dynamic programming approaches of the optimal control of partially observed diffusions , 1983 .

[10]  Mark H. A. Davis.  On the Existence of Optimal Policies in Stochastic Control , 1973 .

[11]  Brahim Mezerdi,et al.  Pathwise uniqueness and approximation of solutions of stochastic differential equations , 1998 .

[12]  KarouiNicole El,et al.  Compactification methods in the control of degenerate diffusions: existence of an optimal control , 1987 .

[13]  R. V. Gamkrelidze,et al.  Principles of optimal control theory , 1977 .

[14]  H. Kushner.  Necessary conditions for continuous parameter stochastic optimization problems , 1972 .

[15]  Robert J. Elliott,et al.  The variational principle and stochastic optimal control , 1980 .

[16]  I. Ekeland.  On the variational principle , 1974 .

[17]  U. Haussmann,et al.  The stochastic maximum principle for a singular control problem , 1994 .

[18]  Brahim MEZERDI,et al.  Approximation in optimal control of diffusion processes , 2000 .

[19]  A. Bensoussan.  Lectures on stochastic control , 1982 .

[20]  Arthur Stoddart,et al.  Existence of optimal controls , 1967 .

[21]  Robert J. Elliott,et al.  The optimal control of diffusions , 1990 .

[22]  Mezerdi Brahim,et al.  Necessary conditions for optimality for a diffusion with a non-smooth drift , 1988 .

[23]  J. Jacod,et al.  Sur un type de convergence intermédiaire entre la convergence en loi et la convergence en probabilité , 1981 .

[24]  Bohdan Maslowski,et al.  A stochastic maximum principle for optimal control of diffusions , 1988, Acta Applicandae Mathematicae.