Quadratically and superlinearly convergent algorithms for the solution of inequality constrained minimization problems

In this paper, some Newton and quasi-Newton algorithms for the solution of inequality constrained minimization problems are considered. All the algorithms described produce sequences {xk} convergingq-superlinearly to the solution. Furthermore, under mild assumptions, aq-quadratic convergence rate inx is also attained. Other features of these algorithms are that only the solution of linear systems of equations is required at each iteration and that the strict complementarity assumption is never invoked. First, the superlinear or quadratic convergence rate of a Newton-like algorithm is proved. Then, a simpler version of this algorithm is studied, and it is shown that it is superlinearly convergent. Finally, quasi-Newton versions of the previous algorithms are considered and, provided the sequence defined by the algorithms converges, a characterization of superlinear convergence extending the result of Boggs, Tolle, and Wang is given.

[1]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[2]  J. J. Moré,et al.  A Characterization of Superlinear Convergence and its Application to Quasi-Newton Methods , 1973 .

[3]  Stephen M. Robinson,et al.  Perturbed Kuhn-Tucker points and rates of convergence for a class of nonlinear-programming algorithms , 1974, Math. Program..

[4]  M. Hestenes.  Optimization Theory: The Finite Dimensional Case , 1975 .

[5]  Olvi L. Mangasarian,et al.  Superlinearly convergent quasi-newton algorithms for nonlinearly constrained optimization problems , 1976, Math. Program..

[6]  Shih-ping Han.  Dual variable metric algorithms for constrained optimization , 1976 .

[7]  Shih-Ping Han,et al.  Superlinearly convergent variable metric algorithms for general nonlinear programming problems , 1976, Math. Program..

[8]  R. Tapia.  Diagonalized multiplier methods and quasi-Newton methods for constrained optimization , 1977 .

[9]  M. C. Biggs.  On the Convergence of Some Constrained Minimization Algorithms Based on Recursive Quadratic Programming , 1978 .

[10]  M. J. D. Powell,et al.  THE CONVERGENCE OF VARIABLE METRIC METHODS FOR NONLINEARLY CONSTRAINED OPTIMIZATION CALCULATIONS , 1978 .

[11]  Torkel Glad,et al.  A multiplier method with automatic limitation of penalty growth , 1979, Math. Program..

[12]  S. Glad.  Properties of updating methods for the multipliers in augmented Lagrangians , 1979 .

[13]  P. Boggs,et al.  On the Local Convergence of Quasi-Newton Methods for Constrained Optimization , 1982 .

[14]  D. Gabay.  Reduced quasi-Newton methods with feasibility improvement for nonlinearly constrained optimization , 1982 .

[15]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[16]  L. Grippo,et al.  A class of continuously differentiable exact penalty function algorithms for nonlinear programming problems , 1984 .

[17]  Luigi Grippo,et al.  Globally convergent exact penalty algorithms for constrained optimization , 1986 .

[18]  Richard A. Tapia,et al.  On the Characterization of Q-superlinear Convergence of Quasi-Newton Methods for Constrained Optimization , 1987 .

[19]  T. Steihaug,et al.  A Convergence Theory for a Class of Quasi-Newton Methods for Constrained Optimization , 1987 .

[20]  M. Bartholomew-Biggs.  Recursive quadratic programming methods based on the augmented lagrangian , 1987 .

[21]  J. F. Bonnans.  Local study of Newton type algorithms for constrained problems , 1988 .

[22]  Jong-Shi Pang,et al.  A B-differentiable equation-based, globally and locally quadratically convergent algorithm for nonlinear programs, complementarity and variational inequality problems , 1991, Math. Program..

[23]  H. Kleinmichel,et al.  On a class of hybrid methods for smooth constrained optimization , 1992 .

[24]  Stefano Lucidi,et al.  New Results on a Continuously Differentiable Exact Penalty Function , 1992, SIAM J. Optim..

[25]  S. Lucidi,et al.  A Class of penalty functions for optimization problema with bound constraints , 1992 .

[26]  S. Lucidi,et al.  Local properties of a Newton-like direction for equality constrained minimization problems , 1994 .

[27]  J. F. Bonnans,et al.  Local analysis of Newton-type methods for variational inequalities and nonlinear programming , 1994 .