On local convergence of sequential quadratically-constrained quadratic-programming type methods, with an extension to variational problems

Abstract We consider the class of quadratically-constrained quadratic-programming methods in the framework extended from optimization to more general variational problems. Previously, in the optimization case, Anitescu (SIAM J. Optim. 12, 949–978, 2002) showed superlinear convergence of the primal sequence under the Mangasarian-Fromovitz constraint qualification and the quadratic growth condition. Quadratic convergence of the primal-dual sequence was established by Fukushima, Luo and Tseng (SIAM J. Optim. 13, 1098–1119, 2003) under the assumption of convexity, the Slater constraint qualification, and a strong second-order sufficient condition. We obtain a new local convergence result, which complements the above (it is neither stronger nor weaker): we prove primal-dual quadratic convergence under the linear independence constraint qualification, strict complementarity, and a second-order sufficiency condition. Additionally, our results apply to variational problems beyond the optimization case. Finally, we provide a necessary and sufficient condition for superlinear convergence of the primal sequence under a Dennis-Moré type condition.

[1]  F. Clarke Optimization And Nonsmooth Analysis , 1983 .

[2]  H. Wolkowicz,et al.  Sequential, Quadratic Constrained, Quadratic Programming for General Nonlinear Programming , 2000 .

[3]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[4]  M. J. D. Powell,et al.  Variable Metric Methods for Constrained Optimization , 1982, ISMP.

[5]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[6]  V. M. Panin A Second-order method for the discrete min-max problem , 1979 .

[7]  Masao Fukushima,et al.  A Sequential Quadratically Constrained Quadratic Programming Method for Differentiable Convex Minimization , 2003, SIAM J. Optim..

[8]  Alexey F. Izmailov,et al.  Karush-Kuhn-Tucker systems: regularity conditions, error bounds and a class of Newton-type methods , 2003, Math. Program..

[9]  Mikhail V. Solodov,et al.  On the Sequential Quadratically Constrained Quadratic Programming Methods , 2004, Math. Oper. Res..

[10]  Mihai Anitescu,et al.  A Superlinearly Convergent Sequential Quadratically Constrained Quadratic Programming Algorithm for Degenerate Nonlinear Programming , 2002, SIAM J. Optim..

[11]  J. J. Moré,et al.  A Characterization of Superlinear Convergence and its Application to Quasi-Newton Methods , 1973 .

[12]  E. Polak,et al.  A generalized quadratic programming-based phase I-phase II method for inequality-constrained optimization , 1992 .

[13]  Takashi Tsuchiya,et al.  Polynomial convergence of primal-dual algorithms for the second-order cone program based on the MZ-family of directions , 2000, Math. Program..

[14]  N. Maratos,et al.  Exact penalty function algorithms for finite dimensional and control optimization problems , 1978 .

[15]  李幼升,et al.  Ph , 1989 .

[16]  N. Josephy Newton's Method for Generalized Equations. , 1979 .

[17]  Alexey F. Izmailov,et al.  A Class of Active-Set Newton Methods for Mixed ComplementarityProblems , 2005, SIAM J. Optim..

[18]  V. M. Panin Some methods of solving convex programming problems , 1981 .

[19]  T. Tsuchiya A Convergence Analysis of the Scaling-invariant Primal-dual Path-following Algorithms for Second-ord , 1998 .