A Proximity Control Algorithm to Minimize Nonsmooth and Nonconvex Functions

We present a new proximity control bundle algorithm to minimize nonsmooth and nonconvex locally Lipschitz functions. In contrast with the traditional oracle-based methods in nonsmooth program- ming, our method is model-based and can accommodate cases where several Clarke subgradients can be computed at reasonable cost. We propose a new way to manage the proximity control parameter, which allows us to handle nonconvex objectives. We prove global convergence of our method in the sense that every accumulation point of the sequence of serious steps is critical. Our method is tested on a variety of examples in H∞-controller synthesis.

[1]  Antonio Fuduli,et al.  A DC piecewise affine model and a bundling technique in nonconvex nonsmooth minimization , 2004, Optim. Methods Softw..

[2]  Pierre Apkarian,et al.  Second-order nonsmooth optimization for H∞ synthesis , 2007, Numerische Mathematik.

[3]  Krzysztof C. Kiwiel,et al.  Proximity control in bundle methods for convex nondifferentiable minimization , 1990, Math. Program..

[4]  Philip Wolfe,et al.  Note on a method of conjugate subgradients for minimizing nondifferentiable functions , 1974, Math. Program..

[5]  Krzysztof C. Kiwiel,et al.  An aggregate subgradient method for nonsmooth convex minimization , 1983, Math. Program..

[6]  P. Wolfe.  Note on a method of conjugate subgradients for minimizing nondifferentiable functions , 1974 .

[7]  J. Zowe.  The BT-Algorithm for Minimizing a Nonsmooth Functional Subject to Linear Constraints , 1989 .

[8]  Pierre Apkarian,et al.  Spectral bundle methods for non-convex maximum eigenvalue functions: first-order methods , 2005, Math. Program..

[9]  Jochem Zowe,et al.  A Version of the Bundle Idea for Minimizing a Nonsmooth Function: Conceptual Idea, Convergence Analysis, Numerical Results , 1992, SIAM J. Optim..

[10]  Claude Lemaréchal,et al.  Lagrangian Relaxation , 2000, Computational Combinatorial Optimization.

[11]  F. Clarke.  Optimization And Nonsmooth Analysis , 1983 .

[12]  Claude Lemaréchal,et al.  Convergence of some algorithms for convex minimization , 1993, Math. Program..

[13]  Pierre Apkarian,et al.  IQC analysis and synthesis via nonsmooth optimization , 2006, Syst. Control. Lett..

[14]  Helga Schramm,et al.  Eine Kombination von Bundle- und Trust-region-Verfahren zur Lösung nichtdifferenzierbarer Optimierungsprobleme , 1989 .

[15]  Henry Wolkowicz,et al.  Indefinite Trust Region Subproblems and Nonsymmetric Eigenvalue Perturbations , 1995, SIAM J. Optim..

[16]  S. Boyd,et al.  A regularity result for the singular values of a transfer matrix and a quadratically convergent algorithm for computing its L ∞ -norm , 1990 .

[17]  Josef Stoer,et al.  Numerische Mathematik 1 , 1989 .

[18]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[19]  Antonio Fuduli,et al.  Minimizing Nonconvex Nonsmooth Functions via Cutting Planes and Proximity Control , 2003, SIAM J. Optim..

[20]  Samir Elhedhli,et al.  Nondifferentiable Optimization , 2009, Encyclopedia of Optimization.

[21]  Pierre Apkarian,et al.  Spectral bundle methods for non-convex maximum eigenvalue functions: second-order methods , 2005, Math. Program..

[22]  Jan Vlcek,et al.  A bundle-Newton method for nonsmooth unconstrained minimization , 1998, Math. Program..

[23]  Jean Charles Gilbert,et al.  Numerical Optimization: Theoretical and Practical Aspects , 2003 .

[24]  Pierre Apkarian,et al.  Nonsmooth Optimization for Multidisk Hoo Synthesis , 2006, Eur. J. Control.

[25]  P. Apkarian,et al.  Nonsmooth H ∞ synthesis , 2005 .

[26]  Pierre Apkarian,et al.  Controller Design via Nonsmooth Multi-Directional Search , 2004 .

[27]  K. Kiwiel.  Methods of Descent for Nondifferentiable Optimization , 1985 .

[28]  Pierre Apkarian,et al.  Nonsmooth H∞ synthesis , 2005, IEEE Trans. Autom. Control..

[29]  Pierre Apkarian,et al.  Controller Design via Nonsmooth Multidirectional Search , 2006, SIAM J. Control. Optim..

[30]  E. Polak.  On the mathematical foundations of nondifferentiable optimization in engineering design , 1987 .

[31]  Warren Hare,et al.  Computing proximal points of nonconvex functions , 2008, Math. Program..