Karush-Kuhn-Tucker systems: regularity conditions, error bounds and a class of Newton-type methods

Abstract. We consider optimality systems of Karush-Kuhn-Tucker (KKT) type, which arise, for example, as primal-dual conditions characterizing solutions of optimization problems or variational inequalities. In particular, we discuss error bounds and Newton-type methods for such systems. An exhaustive comparison of various regularity conditions which arise in this context is given. We obtain a new error bound under an assumption which we show to be strictly weaker than assumptions previously used for KKT systems, such as quasi-regularity or semistability (equivalently, the R0-property). Error bounds are useful, among other things, for identifying active constraints and developing efficient local algorithms. We propose a family of local Newton-type algorithms. This family contains some known active-set Newton methods, as well as some new methods. Regularity conditions required for local superlinear convergence compare favorably with convergence conditions of nonsmooth Newton methods and sequential quadratic programming methods.

[1]  Alexey F. Izmailov,et al.  The Theory of 2-Regularity for Mappings with Lipschitzian Deriatives and its Applications to Optimality Conditions , 2002, Math. Oper. Res..

[2]  Francisco Facchinei,et al.  Regularity Properties of a Semismooth Reformulation of Variational Inequalities , 1998, SIAM J. Optim..

[3]  Houyuan Jiang,et al.  Semismooth Karush-Kuhn-Tucker Equations and Convergence Analysis of Newton and Quasi-Newton Methods for Solving these Equations , 1997, Math. Oper. Res..

[4]  Houyuan Jiang Global Convergence Analysis of the Generalized Newton and Gauss-Newton Methods of the Fischer Burmeister Equation for the Complementarity Problem , 1999 .

[5]  Patrick T. Harker,et al.  Finite-dimensional variational inequality and nonlinear complementarity problems: A survey of theory, algorithms and applications , 1990, Math. Program..

[6]  Francisco Facchinei,et al.  A New Merit Function For Nonlinear Complementarity Problems And A Related Algorithm , 1997, SIAM J. Optim..

[7]  S. Lucidi,et al.  Quadratically and superlinearly convergent algorithms for the solution of inequality constrained minimization problems , 1995 .

[8]  Houyuan Jiang,et al.  Global and Local Superlinear Convergence Analysis of Newton-Type Methods for Semismooth Equations with Smooth Least Squares , 1998 .

[9]  Liqun Qi,et al.  Corrigendum: On the Constant Positive Linear Dependence Condition and Its Application to SQP Methods , 2000, SIAM J. Optim..

[10]  Michael C. Ferris,et al.  Feasible descent algorithms for mixed complementarity problems , 1999, Math. Program..

[11]  Stephen M. Robinson,et al.  Strongly Regular Generalized Equations , 1980, Math. Oper. Res..

[12]  M. Kojima Strongly Stable Stationary Solutions in Nonlinear Programs. , 1980 .

[13]  Alexey F. Izmailov,et al.  Superlinearly Convergent Algorithms for Solving Singular Equations and Smooth Reformulations of Complementarity Problems , 2002, SIAM J. Optim..

[14]  J. F. Bonnans,et al.  Local analysis of Newton-type methods for variational inequalities and nonlinear programming , 1994 .

[15]  Stephen J. Wright Superlinear Convergence of a Stabilized SQP Method to a Degenerate Solution , 1998, Comput. Optim. Appl..

[16]  Liqun Qi,et al.  Convergence Analysis of Some Algorithms for Solving Nonsmooth Equations , 1993, Math. Oper. Res..

[17]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[18]  Francisco Facchinei,et al.  On the Accurate Identification of Active Constraints , 1998, SIAM J. Optim..

[19]  Jong-Shi Pang,et al.  Error bounds in mathematical programming , 1997, Math. Program..

[20]  Alexey F. Izmailov,et al.  Error bounds for 2-regular mappings with Lipschitzian derivatives and their applications , 2001, Math. Program..

[21]  Andreas Fischer,et al.  Modified Wilson's Method for Nonlinear Programs with Nonunique Multipliers , 1999, Math. Oper. Res..

[22]  C. Kanzow Some equation-based methods for the nonlinear complementarity problem , 1994 .

[23]  Liqun Qi,et al.  A nonsmooth version of Newton's method , 1993, Math. Program..

[24]  P. Tseng Growth behavior of a class of merit functions for the nonlinear complementarity problem , 1996 .

[25]  Zengxin Wei,et al.  On the Constant Positive Linear Dependence Condition and Its Application to SQP Methods , 1999, SIAM J. Optim..

[26]  Jerzy Kyparisis,et al.  On uniqueness of Kuhn-Tucker multipliers in nonlinear programming , 1985, Math. Program..

[27]  J. Frédéric Bonnans,et al.  Pseudopower expansion of solutions of generalized equations and constrained optimization problems , 1995, Math. Program..

[28]  B. Kummer Newton’s Method Based on Generalized Derivatives for Nonsmooth Functions: Convergence Analysis , 1992 .

[29]  A. Fischer A special newton-type optimization method , 1992 .