A DESCENT NUMERICAL METHOD FOR OPTIMIZATION PROBLEMS WITH NONDIFFERENTIABLE COST FUNCTIONALS

In this paper we consider the numerical solution of convex optimization problems with nondifferentiable cost functionals. We propose a new algorithm, the $\varepsilon $-subradient method, a large step, double iterative algorithm which converges rapidly under very general assumptions. We discuss the application of the algorithm in some problems of nonlinear programming and optimal control and we show that the $\varepsilon $-subgradient method contains as a special case a minimax algorithm due to Pshenichnyi [5].

[1]  L. Kantorovich,et al.  Functional analysis in normed spaces , 1952 .

[2]  L. Neustadt.  The existence of optimal controls in the absence of convexity conditions , 1963 .

[3]  R. Rockafellar,et al.  On the subdifferentiability of convex functions , 1965 .

[4]  Yu. M. Ermol’ev.  Methods of solution of nonlinear extremal problems , 1966 .

[5]  R. Rockafellar.  Characterization of the subdifferentials of convex functions , 1966 .

[6]  J. Danskin.  The Theory of Max-Min, with Applications , 1966 .

[7]  V. F. Dem'yanov.  On the solution of several minimax problems. I , 1966 .

[8]  Arthur R. Butz.  Iterative Saddle Point Techniques , 1967 .

[9]  H. Witsenhausen.  A minimax control problem for sampled linear systems , 1968 .

[10]  D. Luenberger.  Optimization by Vector Space Methods , 1968 .

[11]  E. Levitin.  A general minimization method for unsmooth extremal problems , 1969 .

[12]  Lucien W. Neustadt,et al.  A General Theory of Extremals , 1969, J. Comput. Syst. Sci..

[13]  D. Luenberger.  Control problems with kinks , 1970 .

[14]  Sanjoy K. Mitter,et al.  Conjugate convex functions, duality, and optimal control problems I: Systems governed by ordinary differential equations , 1970, Information Sciences.

[15]  R. Rockafellar,et al.  Conjugate convex functions in optimal control and the calculus of variations , 1970 .

[16]  D. Bertsekas,et al.  Steepest Descent for Optimization Problems with Nondifferentiable Cost Functionals , 1971 .

[17]  D. Bertsekas.  Control of uncertain systems with a set-membership description of the uncertainty , 1971 .

[18]  Roland A. Minch.  Applications of symmetric derivatives in mathematical programming , 1971, Math. Program..

[19]  C. M. Shetty,et al.  Optimality Criteria in Nonlinear Programming Without Differentiability , 1971, Oper. Res..

[20]  D. Bertsekas.  Stochastic optimization problems with nondifferentiable cost functionals with an application in stochastic programming , 1972, CDC 1972.

[21]  D. Bertsekas.  Stochastic optimization problems with nondifferentiable cost functionals , 1973 .

[22]  E. Polak.  Introduction to linear and nonlinear programming , 1973 .