An interior-point piecewise linear penalty method for nonlinear programming

We present an interior-point penalty method for nonlinear programming (NLP), where the merit function consists of a piecewise linear penalty function and an ℓ2-penalty function. The piecewise linear penalty function is defined by a set of break points that correspond to pairs of values of the barrier function and the infeasibility measure at a subset of previous iterates and this set is updated at every iteration. The ℓ2-penalty function is a traditional penalty function defined by a single penalty parameter. At every iteration the step direction is computed from a regularized Newton system of the first-order equations of the barrier problem proposed in Chen and Goldfarb (Math Program 108:1–36, 2006). Iterates are updated using a line search. In particular, a trial point is accepted if it provides a sufficient reduction in either of the penalty functions. We show that the proposed method has the same strong global convergence properties as those established in Chen and Goldfarb (Math Program 108:1–36, 2006). Moreover, our method enjoys fast local convergence. Specifically, for each fixed small barrier parameter μ, iterates in a small neighborhood (roughly within o(μ)) of the minimizer of the barrier problem converge Q-quadratically to the minimizer. The overall convergence rate of the iterates to the solution of the nonlinear program is Q-superlinear.

[1]  D. Ralph,et al.  Convergence of a Penalty Method for Mathematical Programming with Complementarity Constraints , 2004 .

[2]  Sven Leyffer,et al.  Nonlinear programming without a penalty function , 2002, Math. Program..

[3]  C. Lemaréchal,et al.  The watchdog technique for forcing convergence in algorithms for constrained optimization , 1982 .

[4]  Jorge Nocedal,et al.  An Interior Point Algorithm for Large-Scale Nonlinear Programming , 1999, SIAM J. Optim..

[5]  Philip E. Gill,et al.  A primal-dual trust region algorithm for nonlinear optimization , 2004, Math. Program..

[6]  Hiroshi Yamashita,et al.  An Interior Point Method with a Primal-Dual Quadratic Barrier Penalty Function for Nonlinear Optimization , 2003, SIAM J. Optim..

[7]  Stefan Scholtes,et al.  Mathematical Programs with Complementarity Constraints: Stationarity, Optimality, and Sensitivity , 2000, Math. Oper. Res..

[8]  Jorge Nocedal,et al.  On the Local Behavior of an Interior Point Method for Nonlinear Programming , 1997 .

[9]  Nicholas I. M. Gould,et al.  CUTEr and SifDec: A constrained and unconstrained testing environment, revisited , 2003, TOMS.

[10]  Lorenz T. Biegler,et al.  Failure of global convergence for a class of interior point methods for nonlinear programming , 2000, Math. Program..

[11]  Jorge Nocedal,et al.  Steering exact penalty methods for nonlinear programming , 2008, Optim. Methods Softw..

[12]  Jorge Nocedal,et al.  An interior algorithm for nonlinear optimization that combines line search and trust region steps , 2006, Math. Program..

[13]  S. Scholtes,et al.  Exact Penalization of Mathematical Programs with Equilibrium Constraints , 1999 .

[14]  J. Douglas Faires,et al.  Numerical Analysis , 1981 .

[15]  Anders Forsgren,et al.  Interior Methods for Nonlinear Optimization , 2002, SIAM Rev..

[16]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[17]  Robert J. Vanderbei,et al.  An Interior-Point Algorithm for Nonconvex Nonlinear Programming , 1999, Comput. Optim. Appl..

[18]  Nicholas I. M. Gould,et al.  An Interior-Point l 1 -Penalty Method for Nonlinear Optimization , 2010 .

[19]  Jorge Nocedal,et al.  Interior Methods for Mathematical Programs with Complementarity Constraints , 2006, SIAM J. Optim..

[20]  Robert J. Vanderbei,et al.  Convergence analysis of a primal-dual interior-point method for nonlinear programming ∗ , 2004 .

[21]  Lifeng Chen Interior-point penalty methods for nonlinear programming , 2008 .

[22]  Lorenz T. Biegler,et al.  Line Search Filter Methods for Nonlinear Programming: Motivation and Global Convergence , 2005, SIAM J. Optim..

[23]  Donald Goldfarb,et al.  Interior-point ℓ2-penalty methods for nonlinear programming with strong global convergence properties , 2006, Math. Program..

[24]  Andreas Wächter,et al.  A Primal-Dual Interior-Point Method for Nonlinear Programming with Strong Global and Local Convergence Properties , 2003, SIAM J. Optim..

[25]  Lifeng Chen,et al.  ON THE FAST LOCAL CONVERGENCE OF INTERIOR-POINT `2-PENALTY METHODS FOR NONLINEAR PROGRAMMING , 2006 .

[26]  Jorge Nocedal,et al.  On the convergence of Newton iterations to non-stationary points , 2004, Math. Program..