A Primal-Dual Exterior Point Method for Nonlinear Optimization

In this paper, primal-dual methods for general nonconvex nonlinear optimization problems are considered. The proposed methods are exterior point type methods that permit primal variables to violate inequality constraints during the iterations. The methods are based on the exact penalty type transformation of inequality constraints and use a smooth approximation of the problem to form primal-dual iteration based on Newton's method as in usual primal-dual interior point methods. Global convergence and local superlinear/quadratic convergence of the proposed methods are proved. For global convergence, methods using line searches and trust region type searches are proposed. The trust region type method is tested with CUTEr problems and is shown to have similar efficiency to the primal-dual interior point method code IPOPT. It is also shown that the methods can be warm started easily, unlike interior point methods, and that the methods can be efficiently used in parametric programming problems.

[1]  Jacek Gondzio,et al.  Warm start of the primal-dual method applied in the cutting-plane scheme , 1998, Math. Program..

[2]  Hiroshi Yamashita A globally convergent primal-dual interior point method for constrained optimization , 1998 .

[3]  Hiroshi Yamashita,et al.  An Interior Point Method with a Primal-Dual Quadratic Barrier Penalty Function for Nonlinear Optimization , 2003, SIAM J. Optim..

[4]  Hiroshi Yamashita,et al.  A globally and superlinearly convergent primal-dual interior point trust region method for large scale constrained optimization , 2005, Math. Program..

[5]  A. Fischer A special newton-type optimization method , 1992 .

[6]  R. Fletcher Practical Methods of Optimization , 1988 .

[7]  Stephen J. Wright,et al.  Warm-Start Strategies in Interior-Point Methods for Linear Programming , 2002, SIAM J. Optim..

[8]  Hiroshi Yamashita,et al.  Quadratic Convergence of a Primal-Dual Interior Point Method for Degenerate Nonlinear Optimization Problems , 2005, Comput. Optim. Appl..

[9]  Lorenz T. Biegler,et al.  On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming , 2006, Math. Program..

[10]  Donald Goldfarb,et al.  l2-PENALTY METHODS FOR NONLINEAR PROGRAMMING WITH STRONG GLOBAL CONVERGENCE PROPERTIES , 2004 .

[11]  Jan Vlcek,et al.  Interior point methods for large-scale nonlinear programming , 2005, Optim. Methods Softw..

[12]  Jorge Nocedal,et al.  An Interior Point Algorithm for Large-Scale Nonlinear Programming , 1999, SIAM J. Optim..

[13]  H. Konno,et al.  A FAST ALGORITHM FOR SOLVING LARGE SCALE MEAN-VARIANCE MODELS BY COMPACT FACTORIZATION OF COVARIANCE MATRICES , 1992 .

[14]  Nicholas I. M. Gould,et al.  CUTEr and SifDec: A constrained and unconstrained testing environment, revisited , 2003, TOMS.

[15]  Nicholas I. M. Gould,et al.  An Interior-Point l 1 -Penalty Method for Nonlinear Optimization , 2010 .

[16]  Hiroshi Yamashita,et al.  Superlinear and quadratic convergence of some primal-dual interior point methods for constrained optimization , 1996, Math. Program..