On R-linear convergence of semi-monotonic inexact augmented Lagrangians for bound and equality constrained quadratic programming problems with application

New convergence results for a variant of the inexact augmented Lagrangian algorithm SMALBE [Z. Dostal, An optimal algorithm for bound and equality constrained quadratic programming problems with bounded spectrum, Computing 78 (2006) 311-328] for the solution of strictly convex bound and equality constrained quadratic programming problems are presented. The algorithm SMALBE-M presented here uses a fixed regularization parameter and controls the precision of the solution of auxiliary bound constrained problems by a multiple of the norm of violation of the equality constraints and a constant which is updated in order to enforce the increase of Lagrangian function. A nice feature of SMALBE-M is its capability to find an approximate solution of important classes of problems in a number of iterations that is independent of the conditioning of the equality constraints. Here we prove the R-linear rate of convergence of the outer loop of SMALBE-M for any positive regularization parameter after the strong active constraints of the solution are identified. The theoretical results are illustrated by solving two benchmarks, including the contact problem of elasticity discretized by two million of nodal variables. The numerical experiments indicate that the inexact solution of auxiliary problems in the inner loop results in a very small increase of the number of outer iterations as compared with the exact algorithm. The results do not assume independent equality constraints and remain valid when the solution is dual degenerate.

[1]  Zdenek Dostl Optimal Quadratic Programming Algorithms: With Applications to Variational Inequalities , 2009 .

[2]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[3]  Z. Dostál,et al.  Scalable TFETI algorithm for the solution of multibody contact problems of elasticity , 2009 .

[4]  C. Farhat,et al.  A method of finite element tearing and interconnecting and its parallel solution algorithm , 1991 .

[5]  David Horák,et al.  On R-linear convergence of semi-monotonic inexact augmented Lagrangians for saddle point problems , 2013, Computational Optimization and Applications.

[6]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[7]  W. Hager Analysis and implementation of a dual algorithm for constrained optimization , 1993 .

[8]  R. Glowinski,et al.  Augmented Lagrangian and Operator-Splitting Methods in Nonlinear Mechanics , 1987 .

[9]  Sven Leyffer,et al.  Global and Finite Termination of a Two-Phase Augmented Lagrangian Filter Method for General Quadratic Programs , 2008, SIAM J. Sci. Comput..

[10]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[11]  P. Toint,et al.  A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds , 1991 .

[12]  Olaf Steinbach,et al.  The all-floating boundary element tearing and interconnecting method , 2009, J. Num. Math..

[13]  Michael P. Friedlander,et al.  A Globally Convergent Linearly Constrained Lagrangian Method for Nonlinear Optimization , 2005, SIAM J. Optim..

[14]  Zdenek Dostál,et al.  Augmented Lagrangians with Adaptive Precision Control for Quadratic Programming with Simple Bounds and Equality Constraints , 2002, SIAM J. Optim..

[15]  Joachim Schöberl,et al.  Minimizing Quadratic Functions Subject to Bound Constraints with the Rate of Convergence and Finite Termination , 2005, Comput. Optim. Appl..

[16]  G. Golub,et al.  Inexact and preconditioned Uzawa algorithms for saddle point problems , 1994 .

[17]  M. Hestenes Multiplier and gradient methods , 1969 .

[18]  Zdenek Dostál,et al.  Superrelaxation and the rate of convergence in minimizing quadratic functions subject to bound constraints , 2011, Comput. Optim. Appl..

[19]  M. Fortin,et al.  Augmented Lagrangian methods : applications to the numerical solution of boundary-value problems , 1983 .

[20]  Zdenek Dostál,et al.  An Optimal Algorithm for Bound and Equality Constrained Quadratic Programming Problems with Bounded Spectrum , 2006, Computing.

[21]  Zdeněk Dostál,et al.  Scalable total BETI based solver for 3D multibody frictionless contact problems in mechanical engineering , 2011 .