Optimal controls for diffusion in Rd—A min-max max-min formula for the minimal cost growth rate

We study the infinite horizon optimal control problem for a system whose dynamics are described by the stochastic differential equation dx, = Wu u,) dt + 4x,) da,> x0 given. (1.1) Let e be the o-algebra generated by (j,jO G s G r; then an admissible control is an {*}t,, adapted process in R” which satisfies the constraint u, E Wx,), t 2 0. ‘In the last relation x + U(x) is a measurable set valued mapping from Rd to R”. To every control corresponds the cost flow

[1]  Robert J. Elliott The Optimal Control of a Stochastic System , 1977 .

[2]  Arie Leizarowitz Controlled diffusion processes on infinite horizon with the overtaking criterion , 1988 .

[3]  D A Carlson On the existence of catching-up optimal solutions for Lagrange problems defined on unbounded intervals , 1986 .

[4]  Tjalling C. Koopmans,et al.  On the concept of optimal economic growth , 1963 .

[5]  V. Borkar On Minimum Cost Per Unit Time Control of Markov Chains , 1984 .

[6]  D. Gale On Optimal Development in a Multi-Sector Economy , 1967 .

[7]  V. Benes Existence of Optimal Stochastic Control Laws , 1971 .

[8]  M. Robin Long-term average cost control problems for continuous time Markov processes: A survey , 1983 .

[9]  Alain Haurie,et al.  On Existence of Overtaking Optimal Trajectories Over an Infinite Time Horizon , 1976, Math. Oper. Res..

[10]  R. M. Cox Stationary and discounted control of diffusion processes , 1984 .

[11]  Y. Kogan On Optimal Control of a Non-Terminating Diffusion Process with Reflection , 1969 .

[12]  von Weizäscker,et al.  Existence of Optimal Programs of Accumulation for an Infinite Time Horizon , 1965 .

[13]  A. Miele,et al.  Optimal take-off trajectories in the presence of windshear , 1986 .

[14]  Ioannis Karatzas,et al.  STATIONARY CONTROL OF BROWNIAN MOTION IN SEVERAL DIMENSIONS , 1985 .

[15]  D. W. Stroock,et al.  Multidimensional Diffusion Processes , 1979 .

[16]  N. Ikeda,et al.  A comparison theorem for solutions of stochastic differential equations and its applications , 1977 .

[17]  A. Leizarowitz Infinite horizon stochastic regulation and tracking with the overtaking criterion , 1987 .

[18]  Mark H. A. Davis Martingale methods in stochastic control , 1979 .

[19]  Robert Tarres Asymptotic Evolution of a Stochastic Control Problem , 1985 .