Subgradients of Optimal-Value Functions in Dynamic Programming: The Case of Convex Systems Without Optimal Paths

We study the first-order behaviour of the optimal-value function associated to a convex dynamic programming problem. The optimization process takes place in a certain environment characterized by some perturbation parameters affecting the transition costs and/or the evolution law of the dynamic system. An important aspect of this work is that we do not assume the existence of optimal paths to the unperturbed problem.

[1]  Approximate Euler-Lagrange inclusion, approximate transversality condition, and sensitivity analysis of convex parametric problems of calculus of variations , 1994 .

[2]  Jochen W. Schmidt On tridiagonal linear complementarity problems , 1987 .

[3]  P. Laurent Approximation et optimisation , 1972 .

[4]  Alberto Seeger,et al.  Epsilon-Maximum Principle of Pontryagin Type and Perturbation Analysis of Convex Optimal Control Problems , 1996 .

[5]  R. Rockafellar Conjugate Duality and Optimization , 1987 .

[6]  Luigi Montrucchio,et al.  Lipschitz continuous policy functions for strongly concave optimization problems , 1987 .

[7]  V. F. Demʹi︠a︡nov,et al.  Nonsmooth optimization and related topics , 1989 .

[8]  Herbert Moskowitz,et al.  Information and Decision Systems for Production Planning , 1975 .

[9]  Siegfried Dietze,et al.  Determination of shape preserving interpolants with minimal curvature via dual programs , 1988 .

[10]  Juan Enrique Martínez-Legaz,et al.  A formula on the approximate subdifferential of the difference of convex functions , 1992, Bulletin of the Australian Mathematical Society.

[11]  A Dual Method for Smoothing Histograms Using Nonnegative C1-Splines , 1992 .

[12]  G. Danninger Role of copositivity in optimality criteria for nonconvex optimization problems , 1992 .

[13]  Mohamed Moussaoui,et al.  Sensitivity Analysis of Optimal Value Functions of Convex Parametric Programs with Possibly Empty Solution Sets , 1994, SIAM J. Optim..

[14]  Constantin Zălinescu,et al.  STABILITY FOR A CLASS OF NONLINEAR OPTIMIZATION PROBLEMS AND APPLICATIONS , 1989 .

[15]  Jean-Jacques Strodiot,et al.  ε-Optimal solutions in nondifferentiable convex programming and some related questions , 1983, Math. Program..

[16]  Manuel S. Santos Smoothness of the Policy Function in Discrete Time Economic Models , 1991 .

[17]  Michael Krätzschmar A decomposition-dualization approach for solving constrained convex minimization problems with applications to discretized obstacle problems , 1989 .