Local and Global Analysis of Multiplier Methods for Constrained Optimization in Banach Spaces

We propose an augmented Lagrangian method for the solution of constrained optimization problems in Banach spaces. The framework we consider is very general and encompasses a host of standard proble...

[1]  Kazufumi Ito,et al.  An augmented Lagrangian technique for variational inequalities , 1990 .

[2]  Christian Kanzow,et al.  Theoretical and numerical comparison of relaxation methods for mathematical programs with complementarity constraints , 2011, Mathematical Programming.

[3]  Daniel Wachsmuth,et al.  An augmented Lagrange method for elliptic state constrained optimal control problems , 2018, Comput. Optim. Appl..

[4]  Stephen J. Wright.  Modifying SQP for Degenerate Problems , 2002, SIAM J. Optim..

[5]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[6]  Christian Kanzow,et al.  The Multiplier-Penalty Method for Generalized Nash Equilibrium Problems in Banach Spaces , 2019, SIAM J. Optim..

[7]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[8]  Christian Kanzow,et al.  Quasi-Variational Inequalities in Banach Spaces: Theory and Augmented Lagrangian Methods , 2018, SIAM J. Optim..

[9]  R. Rockafellar.  Augmented Lagrange Multiplier Functions and Duality in Nonconvex Programming , 1974 .

[10]  Gerd Wachsmuth,et al.  Mathematical Programs with Complementarity Constraints in Banach Spaces , 2014, Journal of Optimization Theory and Applications.

[11]  Mikhail V. Solodov,et al.  Local Convergence of Exact and Inexact Augmented Lagrangian Methods under the Second-Order Sufficient Optimality Condition , 2012, SIAM J. Optim..

[12]  José Mario Martínez,et al.  On Augmented Lagrangian Methods with General Lower-Level Constraints , 2007, SIAM J. Optim..

[13]  Andreas Fischer,et al.  Local behavior of an iterative framework for generalized equations with nonisolated solutions , 2002, Math. Program..

[14]  Christian Kanzow,et al.  On Error Bounds and Multiplier Methods for Variational Problems in Banach Spaces , 2018, SIAM J. Control. Optim..

[15]  K. Kunisch,et al.  Augmented Lagrangian Techniques for Elliptic State Constrained Optimal Control Problems , 1997 .

[16]  Christian Kanzow,et al.  On the multiplier-penalty-approach for quasi-variational inequalities , 2016, Math. Program..

[17]  Ivan P. Gavrilyuk,et al.  Lagrange multiplier approach to variational problems and applications , 2010, Math. Comput..

[18]  Karl Kunisch,et al.  Feasible and Noninterior Path-Following in Constrained Minimization with Low Multiplier Regularity , 2006, SIAM J. Control. Optim..

[19]  S. Kurcyusz,et al.  Projection on a Cone, Penalty Functionals and Duality Theory for Problems with Inequaltity Constraints in Hilbert Space , 1977 .

[20]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[21]  José Mario Martínez,et al.  Practical augmented Lagrangian methods for constrained optimization , 2014, Fundamentals of algorithms.

[22]  Daniel Wachsmuth,et al.  A Lagrange multiplier method for semilinear elliptic state constrained optimal control problems , 2018, Computational Optimization and Applications.

[23]  F. Tröltzsch.  Optimal Control of Partial Differential Equations: Theory, Methods and Applications , 2010 .

[24]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[25]  J. Rodrigues.  Obstacle Problems in Mathematical Physics , 1987 .

[26]  Bethany L. Nicholson,et al.  Mathematical Programs with Equilibrium Constraints , 2021, Pyomo — Optimization Modeling in Python.

[27]  K. J. Palmer.  On the Complete Continuity of Differentiable Mappings , 1969 .

[28]  J. Frédéric Bonnans,et al.  Perturbation Analysis of Optimization Problems , 2000, Springer Series in Operations Research.

[29]  Nicholas I. M. Gould,et al.  Trust Region Methods , 2000, MOS-SIAM Series on Optimization.

[30]  Christian Kanzow,et al.  An example comparing the standard and safeguarded augmented Lagrangian methods , 2017, Oper. Res. Lett..

[31]  Alexey F. Izmailov,et al.  Global Convergence of Augmented Lagrangian Methods Applied to Optimization Problems with Degenerate Constraints, Including Problems with Complementarity Constraints , 2012, SIAM J. Optim..

[32]  Gerd Wachsmuth,et al.  Strong Stationarity for Optimal Control of the Obstacle Problem with Control Constraints , 2014, SIAM J. Optim..

[33]  Mikhail V. Solodov,et al.  Stabilized sequential quadratic programming for optimization and a stabilized Newton-type method for variational problems , 2010, Math. Program..

[34]  V. Torczon,et al.  A GLOBALLY CONVERGENT AUGMENTED LAGRANGIAN ALGORITHM FOR OPTIMIZATION WITH GENERAL CONSTRAINTS AND SIMPLE BOUNDS , 2002 .

[35]  E. Zeidler.  Nonlinear functional analysis and its applications , 1988 .

[36]  Masao Fukushima,et al.  Quasi-variational inequalities, generalized Nash equilibria, and multi-leader-follower games , 2009, Comput. Manag. Sci..

[37]  H. Brezis.  Functional Analysis, Sobolev Spaces and Partial Differential Equations , 2010 .

[38]  Stephen J. Wright.  Superlinear Convergence of a Stabilized SQP Method to a Degenerate Solution , 1998, Comput. Optim. Appl..

[39]  Arnd Rösch,et al.  Finite Element Discretization of State-Constrained Elliptic Optimal Control Problems with Semilinear State Equation , 2015, SIAM J. Control. Optim..

[40]  Haim Brezis,et al.  Équations et inéquations non linéaires dans les espaces vectoriels en dualité , 1968 .

[41]  Christian Kanzow,et al.  An Augmented Lagrangian Method for Optimization Problems in Banach Spaces , 2018, SIAM J. Control. Optim..

[42]  Gerd Wachsmuth,et al.  Strong Stationarity for Optimization Problems with Complementarity Constraints in Absence of Polyhedricity , 2017 .

[43]  Stefan Scholtes,et al.  Mathematical Programs with Complementarity Constraints: Stationarity, Optimality, and Sensitivity , 2000, Math. Oper. Res..

[44]  William W. Hager,et al.  Stabilized Sequential Quadratic Programming , 1999, Comput. Optim. Appl..