Deterministic Near-Optimal Controls. Part II: Dynamic Programming and Viscosity Solution Approach

Near-optimization is as sensible and important as optimization for both theory and applications. This paper concerns dynamic near-optimization, or near-optimal controls, for systems governed by deterministic ordinary differential equations, and uses dynamic programming to study the near-optimality. Since nonsmoothness is inherent in this subject, the viscosity solution approach is employed to investigate the problem. The dynamic programming equation is derived in terms of e-superdifferential/subdifferential. The relationships among the adjoint functions, the value functions, and the Hamiltonian along near-optimal trajectories are revealed. Verification theorems with which near-optimal feedback controls can be constructed are obtained.

[1]  I. Ekeland.  On the variational principle , 1974 .

[2]  Frank H. Clarke,et al.  The relationship between the maximum principle and dynamic programming , 1987 .

[3]  Suresh P. Sethi,et al.  Hierarchical controls in stochastic manufacturing systems with convex costs , 1994 .

[4]  B. Heimann,et al.  Fleming, W. H./Rishel, R. W., Deterministic and Stochastic Optimal Control. New York‐Heidelberg‐Berlin. Springer‐Verlag. 1975. XIII, 222 S, DM 60,60 , 1979 .

[5]  P. Lions,et al.  Viscosity solutions of Hamilton-Jacobi equations , 1983 .

[6]  Ulrich G. Haussmann.  A Probabilistic Approach to the Generalized Hessian , 1992, Math. Oper. Res..

[7]  F. Clarke.  Necessary conditions for nonsmooth problems in-optimal control and the calculus of variations , 1991 .

[8]  R. Bellman.  Dynamic programming. , 1957, Science.

[9]  X. Zhou.  Maximum principle, dynamic programming, and their connection in deterministic control , 1990 .

[10]  P. Lions,et al.  Hamilton-Jacobi equations in infinite dimensions I. Uniqueness of viscosity solutions , 1985 .

[11]  Ulrich G. Haussmann.  Generalized Solutions of the Hamilton-Jacobi Equation of Stochastic Control , 1994 .

[12]  I. Ekeland,et al.  Generic Fréchet-differentiability and perturbed optimization problems in Banach spaces , 1976 .

[13]  Piermarco Cannarsa,et al.  Some characterizations of optimal trajectories in control theory , 1991 .

[14]  X. Zhou.  Verification Theorems within the Framework of Viscosity Solutions , 1993 .

[15]  L. Berkovitz.  Optimal Control Theory , 1974 .

[16]  W. Fleming,et al.  Controlled Markov processes and viscosity solutions , 1992 .

[17]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[18]  P. Lions.  Optimal control of diffusion processes and hamilton–jacobi–bellman equations part 2 : viscosity solutions and uniqueness , 1983 .

[19]  P. Lions.  Generalized Solutions of Hamilton-Jacobi Equations , 1982 .

[20]  Xun Yu Zhou,et al.  Deterministic near-optimal control, part 1: Necessary and sufficient conditions for near-optimality , 1995 .

[21]  E. Barron,et al.  The Pontryagin maximum principle from dynamic programming and viscosity solutions to first-order partial differential equations , 1986 .

[22]  X. Zhou,et al.  Stochastic dynamic job shops and hierarchical production planning , 1994, IEEE Transactions on Automatic Control.

[23]  Zhou Yu.  A unified treatment of maximum principle and dynamic programming in stochastic controls , 1991 .

[24]  H. Frankowska.  Hamilton-Jacobi equations: Viscosity solutions and generalized gradients , 1989 .