Nonmonotone bundle-type scheme for convex nonsmooth minimization

In this paper, we present a general scheme for bundle-type algorithms which includes a nonmonotone line search procedure and for which global convergence can be proved. Some numerical examples are reported, showing that the nonmonotonicity can be beneficial from a computational point of view.

[1]  Manlio Gaudioso,et al.  Quadratic approximations in convex nondifferentiable optimization , 1991 .

[2]  A. Auslender.  Numerical methods for nondifferentiable convex optimization , 1987 .

[3]  K. Kiwiel.  Methods of Descent for Nondifferentiable Optimization , 1985 .

[4]  Robert Mifflin,et al.  An Algorithm for Constrained Optimization with Semismooth Functions , 1977, Math. Oper. Res..

[5]  Jong-Shi Pang,et al.  Minimization of Locally Lipschitzian Functions , 1991, SIAM J. Optim..

[6]  Manlio Gaudioso,et al.  A bundle type approach to the unconstrained minimization of convex nonsmooth functions , 1982, Math. Program..

[7]  Krzysztof C. Kiwiel,et al.  An aggregate subgradient method for nonsmooth convex minimization , 1983, Math. Program..

[8]  V. F. Demʹi︠a︡nov,et al.  Introduction to minimax , 1976 .

[9]  P. Wolfe.  Note on a method of conjugate subgradients for minimizing nondifferentiable functions , 1974 .

[10]  L. Grippo,et al.  A nonmonotone line search technique for Newton's method , 1986 .

[11]  Jochem Zowe,et al.  A Version of the Bundle Idea for Minimizing a Nonsmooth Function: Conceptual Idea, Convergence Analysis, Numerical Results , 1992, SIAM J. Optim..

[12]  A. Adamian,et al.  Approximation theory for linear-quadratic-Guassian optimal control of flexible structures , 1991 .

[13]  Masao Fukushima,et al.  A descent algorithm for nonsmooth convex optimization , 1984, Math. Program..

[14]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[15]  C. Lemaréchal.  An extension of davidon methods to non differentiable problems , 1975 .

[16]  K. Kiwiel.  An ellipsoid trust region bundle method for nonsmooth convex minimization , 1989 .

[17]  V. F. Dem'yanov,et al.  Nondifferentiable Optimization , 1985 .

[18]  Krzysztof C. Kiwiel,et al.  Proximity control in bundle methods for convex nondifferentiable minimization , 1990, Math. Program..

[19]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .

[20]  R. Mifflin.  A modification and an extension of Lemarechal’s algorithm for nonsmooth minimization , 1982 .

[21]  L. Grippo,et al.  A class of nonmonotone stabilization methods in unconstrained optimization , 1991 .