Solution sensitivity for Karush–Kuhn–Tucker systems with non-unique Lagrange multipliers

This article is devoted to quantitative stability of a given primal-dual solution of the Karush–Kuhn–Tucker system subject to parametric perturbations. We are mainly concerned with those cases when the dual solution associated with the base primal solution is non-unique. Starting with a review of known results regarding the Lipschitz-stable case, supplied by simple direct justifications based on piecewise analysis, we then proceed with new results for the cases of Hölder (square root) stability. Our results include characterizations of asymptotic behaviour and upper estimates of perturbed solutions, as well as some sufficient conditions for (the specific kinds of) stability of a given solution subject to directional perturbations. We argue that Lipschitz stability of strictly complementary multipliers is highly unlikely to occur, and we employ the recently introduced notion of a critical multiplier for dealing with Hölder stability.

[1]  Jerzy Kyparisis.  Sensitivity Analysis for Nonlinear Programs and Variational Inequalities with Nonunique Multipliers , 1990, Math. Oper. Res..

[2]  A. Shapiro.  Perturbation analysis of optimization problems in banach spaces , 1992 .

[3]  Thomas L. Magnanti,et al.  Sensitivity Analysis for Variational Inequalities , 1992, Math. Oper. Res..

[4]  Jerzy Kyparisis.  Parametric Variational Inequalities with Multivalued Solution Sets , 1992, Math. Oper. Res..

[5]  William W. Hager,et al.  Stability in the presence of degeneracy and error estimation , 1999, Math. Program..

[6]  Diethard Klatte,et al.  Generalized Kojima–Functions and Lipschitz Stability of Critical Points , 1999, Comput. Optim. Appl..

[7]  Diethard Klatte.  Upper Lipschitz behavior of solutions to perturbed. C1,1 programs , 2000, Math. Program..

[8]  ADAM B. LEVY.  Solution Sensitivity from General Principles , 2001, SIAM J. Control. Optim..

[9]  Stephen J. Wright.  Constraint identification and algorithm stabilization for degenerate nonlinear programs , 2000, Math. Program..

[10]  A. Shapiro.  Sensitivity Analysis of Generalized Equations , 2003 .

[11]  Alexey F. Izmailov,et al.  Abnormal equality-constrained optimization problems: sensitivity theory , 2004, Math. Program..

[12]  Alexey F. Izmailov,et al.  On the analytical and numerical stability of critical Lagrange multipliers , 2005 .

[13]  Alexey F. Izmailov,et al.  A note on solution sensitivity for Karush–Kuhn–Tucker systems , 2005, Math. Methods Oper. Res..

[14]  Diethard Klatte,et al.  Nonsmooth Equations in Optimization: "Regularity, Calculus, Methods And Applications" , 2006 .

[15]  A. F. Izmailov.  Sensitivity of solutions to systems of optimality conditions under the violation of constraint qualifications , 2007 .

[16]  Alexey F. Izmailov,et al.  On attraction of Newton-type iterates to multipliers violating second-order sufficiency conditions , 2009, Math. Program..

[17]  Alexey F. Izmailov,et al.  Examples of dual behaviour of Newton-type methods on optimization problems with degenerate constraints , 2009, Comput. Optim. Appl..