Semismooth SQP method for equality-constrained optimization problems with an application to the lifted reformulation of mathematical programs with complementarity constraints

We consider the sequential quadratic programming (SQP) algorithm applied to equality-constrained optimization problems, where the problem data is differentiable with Lipschitz-continuous first derivatives. For this setting, Dennis–Moré-type analysis of primal superlinear convergence is presented. Our main motivation is a special modification of SQP tailored to the structure of the lifted reformulation of mathematical programs with complementarity constraints (MPCC). For this problem, we propose a special positive definite modification of the matrices in the generalized Hessian, which is suitable for globalization of SQP based on the penalty function, and at the same time can be expected to satisfy our general Dennis–Moré-type conditions, thus preserving local superlinear convergence. (Standard quasi-Newton updates in the SQP framework require twice differentiability of the problem data at the solution for superlinear convergence.) Preliminary numerical results comparing a number of quasi-Newton versions of semismooth SQP applied to MPCC are also reported.

[1]  A. F. Izmailovy,et al.  THE THEORY OF 2-REGULARITY FOR MAPPINGS WITH LIPSCHITZIAN DERIVATIVES AND ITS APPLICATIONS TO OPTIMALITY CONDITIONS , 2001 .

[2]  Bethany L. Nicholson,et al.  Mathematical Programs with Equilibrium Constraints , 2021, Pyomo — Optimization Modeling in Python.

[3]  Sven Leyffer,et al.  Local Convergence of SQP Methods for Mathematical Programs with Equilibrium Constraints , 2006, SIAM J. Optim..

[4]  B. Kummer Newton’s Method Based on Generalized Derivatives for Nonsmooth Functions: Convergence Analysis , 1992 .

[5]  Defeng Sun,et al.  Superlinear Convergence of Approximate Newton Methods for LC1 Optimization Problems without Strict Complementarity , 1995 .

[6]  F. Clarke Optimization And Nonsmooth Analysis , 1983 .

[7]  Paul T. Boggs,et al.  Sequential Quadratic Programming , 1995, Acta Numerica.

[8]  Jean Charles Gilbert,et al.  Numerical Optimization: Theoretical and Practical Aspects , 2003 .

[9]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[10]  J. M. Martínez,et al.  Inexact Newton methods for solving nonsmooth equations , 1995 .

[11]  Liqun Qi,et al.  Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations , 1993, Math. Oper. Res..

[12]  Alexey F. Izmailov,et al.  An Active-Set Newton Method for Mathematical Programs with Complementarity Constraints , 2008, SIAM J. Optim..

[13]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[14]  Alexey F. Izmailov,et al.  Superlinearly Convergent Algorithms for Solving Singular Equations and Smooth Reformulations of Complementarity Problems , 2002, SIAM J. Optim..

[15]  Michal Kočvara,et al.  Nonsmooth approach to optimization problems with equilibrium constraints : theory, applications, and numerical results , 1998 .

[16]  Graham F. Carey,et al.  Book reviewComputational techniques and applications, CTAC-83: J. Noye and C. Fletcher, eds. (North-Holland, Amsterdam, 1984), 982 pp., ISBN 0 444 875271 , 1985 .

[17]  Sven Leyffer,et al.  Solving mathematical programs with complementarity constraints as nonlinear programs , 2004, Optim. Methods Softw..

[18]  Liqun Qi,et al.  Superlinearly convergent approximate Newton methods for LC1 optimization problems , 1994, Math. Program..

[19]  D. Klatte,et al.  On second-order sufficient optimality conditions for c 1,1-optimization problems , 1988 .

[20]  R. Rockafellar,et al.  Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time , 1990 .

[21]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[22]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[23]  José Mario Martínez,et al.  On Augmented Lagrangian Methods with General Lower-Level Constraints , 2007, SIAM J. Optim..

[24]  Jerzy Kyparisis,et al.  Local convergence of quasi-Newton methods for B-differentiable equations , 1992, Math. Program..

[25]  R. Tyrrell Rockafellar,et al.  Computational schemes for large-scale problems in extended linear-quadratic programming , 1990, Math. Program..

[26]  Oliver Stein Lifting mathematical programs with complementarity constraints , 2012, Math. Program..

[27]  Alexey F. Izmailov,et al.  Semismooth Newton method for the lifted reformulation of mathematical programs with complementarity constraints , 2012, Comput. Optim. Appl..

[28]  Stefan Scholtes,et al.  Mathematical Programs with Complementarity Constraints: Stationarity, Optimality, and Sensitivity , 2000, Math. Oper. Res..