Superlinear Convergence of Primal-Dual Interior Point Algorithms for Nonlinear Programming

The local convergence properties of a class of primal-dual interior point methods are analyzed. These methods are designed to minimize a nonlinear, nonconvex, objective function subject to linear equality constraints and general inequalities. They involve an inner iteration in which the log-barrier merit function is approximately minimized subject to satisfying the linear equality constraints, and an outer iteration that specifies both the decrease in the barrier parameter and the level of accuracy for the inner minimization. Under nondegeneracy assumptions, it is shown that, asymptotically, for each value of the barrier parameter, solving a single primal-dual linear system is enough to produce an iterate that already matches the barrier subproblem accuracy requirements. The asymptotic rate of convergence of the resulting algorithm is Q-superlinear and may be chosen arbitrarily close to quadratic. Furthermore, this rate applies componentwise. These results hold in particular for the method described in [A. R. Conn, N. I. M. Gould, D. Orban, and P. L. Toint, Math. Program. Ser. B, 87 (2000), pp. 215--249] and indicate that the details of its inner minimization are irrelevant in the asymptotics, except for its accuracy requirements.

[1]  Anthony V. Fiacco,et al.  Nonlinear programming;: Sequential unconstrained minimization techniques , 1968 .

[2]  Robert Mifflin Convergence bounds for nonlinear programming algorithms , 1975, Math. Program..

[3]  Philip E. Gill,et al.  Practical optimization , 1981 .

[4]  Nicholas I. M. Gould,et al.  On practical conditions for the existence and uniqueness of solutions to the general equality quadratic programming problem , 1985, Math. Program..

[5]  N. Gould On the convegence of a sequential penalty function method for constrained minimization , 1989 .

[6]  Margaret H. Wright,et al.  Interior methods for constrained optimization , 1992, Acta Numerica.

[7]  P. Toint,et al.  A note on using alternative second-order models for the subproblems arising in barrier function methods for minimization , 1994 .

[8]  Margaret H. Wright,et al.  Why a Pure Primal Newton Barrier Step May be Infeasible , 1995, SIAM J. Optim..

[9]  J. Dussault Numerical stability and efficiency of penalty algorithms , 1995 .

[10]  Hiroshi Yamashita,et al.  Superlinear and quadratic convergence of some primal-dual interior point methods for constrained optimization , 1996, Math. Program..

[11]  Hiroshi Yamashita,et al.  Q-SUPERLINEAR CONVERGENCE OF PRIMAL-DUAL INTERIOR POINT QUASI-NEWTON METHODS FOR CONSTRAINED OPTIMIZATION , 1997 .

[12]  Nicholas I. M. Gould,et al.  On the Number of Inner Iterations Per Outer Iteration of a Globally Convergent Algorithm for Optimization with General Nonlinear Inequality Constraints and Simple Bounds , 1997, Comput. Optim. Appl..

[13]  Stephen J. Wright Primal-Dual Interior-Point Methods , 1997, Other Titles in Applied Mathematics.

[14]  Jorge Nocedal,et al.  On the Local Behavior of an Interior Point Method for Nonlinear Programming , 1997 .

[15]  Michael L. Overton,et al.  A Primal-dual Interior Method for Nonconvex Nonlinear Programming , 1998 .

[16]  Margaret H. Wright,et al.  The interior-point revolution in constrained optimization , 1998 .

[17]  Stephen J. Wright,et al.  The role of linear objective functions in barrier methods , 1999, Math. Program..

[18]  Nicholas I. M. Gould,et al.  A primal-dual trust-region algorithm for non-convex nonlinear programming , 2000, Math. Program..

[19]  Florian A. Potra,et al.  Q-superlinear convergence of the iterates in primal-dual interior-point methods , 2001, Math. Program..