Augmented Lagrangians and hidden convexity in sufficient conditions for local optimality

Second-order sufficient conditions for local optimality have long been central to designing solution algorithms and justifying claims about their convergence. Here a far-reaching extension of such conditions, called variational sufficiency, is explored in territory beyond just classical nonlinear programming. Variational sufficiency is already known to support multiplier methods that are able, even without convexity, to achieve problem decomposition, but further insight has been needed into how it coordinates with other sufficient conditions. In the framework of this paper, it is shown to characterize local optimality in terms of having a convex–concave-type local saddle point of an augmented Lagrangian function. A stronger version of variational sufficiency is tied in turn to local strong convexity in the primal argument of that function and a property of augmented tilt stability that offers crucial aid to Lagrange multiplier methods at a fundamental level of analysis. Moreover, that strong version is translated here through second-order variational analysis into statements that can readily be compared to existing sufficient conditions in nonlinear programming, second-order cone programming, and other problem formulations which can incorporate nonsmooth objectives and regularization terms.

[1]  R. Rockafellar,et al.  Implicit Functions and Solution Mappings: A View from Variational Analysis , 2009 .

[2]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[3]  R. Tyrrell Rockafellar,et al.  Extended Nonlinear Programming , 2000 .

[4]  J. Frédéric Bonnans,et al.  Perturbation analysis of second-order cone programming problems , 2005, Math. Program..

[5]  Boris S. Mordukhovich,et al.  Parabolic regularity in geometric variational analysis , 2020, Transactions of the American Mathematical Society.

[6]  R. Rockafellar Convergence of augmented Lagrangian methods in extensions beyond nonlinear programming , 2022, Mathematical Programming.

[7]  R. Tyrrell Rockafellar,et al.  Augmented Lagrangians and Applications of the Proximal Point Algorithm in Convex Programming , 1976, Math. Oper. Res..

[8]  Teemu Pennanen,et al.  Local Convergence of the Proximal Point Algorithm and Multiplier Methods Without Monotonicity , 2002, Math. Oper. Res..

[9]  R. Rockafellar 1. Conjugate Duality and Optimization , 1974 .

[10]  B. Mordukhovich Sensitivity analysis in nonsmooth optimization , 1992 .

[11]  B. Mordukhovich Lipschitzian stability of constraint systems and generalized equations , 1994 .

[12]  R. Tyrrell Rockafellar,et al.  Lagrange Multipliers and Optimality , 1993, SIAM Rev..

[13]  Donald Goldfarb,et al.  Second-order cone programming , 2003, Math. Program..

[14]  Boris S. Mordukhovich,et al.  Full Stability of Locally Optimal Solutions in Second-Order Cone Programs , 2014, SIAM J. Optim..

[15]  R. Tyrrell Rockafellar,et al.  Variational Analysis , 1998, Grundlehren der mathematischen Wissenschaften.

[16]  R. Tyrrell Rockafellar Conjugate Duality and Optimization , 1974 .

[17]  R. Rockafellar Variational Convexity and the Local Monotonicity of Subgradient Mappings , 2019, Vietnam Journal of Mathematics.

[18]  R. Poliquin,et al.  Subgradient monotonicity and convex functions , 1990 .

[19]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[20]  Boris S. Mordukhovich,et al.  Augmented Lagrangian method for second-order cone programs under second-order sufficiency , 2020, J. Glob. Optim..

[21]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[22]  R. Rockafellar,et al.  Implicit Functions and Solution Mappings , 2009 .

[23]  Boris S. Mordukhovich,et al.  Second-order variational analysis in second-order cone programming , 2020, Math. Program..

[24]  R. Rockafellar Progressive Decoupling of Linkages in Optimization and Variational Inequalities with Elicitable Convexity or Monotonicity , 2018, Set-Valued and Variational Analysis.

[25]  R. Tyrrell Rockafellar,et al.  Tilt Stability of a Local Minimum , 1998, SIAM J. Optim..