Solving large-scale minimax problems with the primal—dual steepest descent algorithm

This paper shows that the primal-dual steepest descent algorithm developed by Zhu and Rockafellar for large-scale extended linear—quadratic programming can be used in solving constrained minimax problems related to a generalC2 saddle function. It is proved that the algorithm converges linearly from the very beginning of the iteration if the related saddle function is strongly convex—concave uniformly and the cross elements between the convex part and the concave part of the variables in its Hessian are bounded on the feasible region. Better bounds for the asymptotic rates of convergence are also obtained. The minimax problems where the saddle function has linear cross terms between the convex part and the concave part of the variables are discussed specifically as a generalization of the extended linear—quadratic programming. Some fundamental features of these problems are laid out and analyzed.

[1]  Alan J. King,et al.  An Implementation of the Lagrangian Finite-Generation Method , 1988 .

[2]  Janet Mary Wagner Stochastic programming with recourse applied to groundwater quality management , 1988 .

[3]  Ciyou Zhu On the Primal-Dual Steepest Descent Algorithm for Extended Linear-Quadratic Programming , 1995, SIAM J. Optim..

[4]  R. Rockafellar Linear-quadratic programming and optimal control , 1987 .

[5]  Ciyou Zhu,et al.  Modified proximal point algorithm for extended linear-quadratic programming , 1992, Comput. Optim. Appl..

[6]  James M. Ortega,et al.  Iterative solution of nonlinear equations in several variables , 2014, Computer science and applied mathematics.

[7]  R. T. Rocbfellar A Generalized Approach to Linear-Quadratic Programming , .

[8]  R. Rockafellar,et al.  A Lagrangian Finite Generation Technique for Solving Linear-Quadratic Problems in Stochastic Programming , 1986 .

[9]  R. Rockafellar LARGE-SCALE EXTENDED LINEAR-QUADRATIC PROGRAMMING AND MULTISTAGE OPTIMIZATION R.T.Rockafellar Abstract. Optimization problems in discrete time can be modeled more flexibly by extended linear- quadratic programming than by traditional linear or quadratic programming, because penalties and other expre , 1991 .

[10]  R. Tyrrell Rockafellar,et al.  Convex Analysis , 1970, Princeton Landmarks in Mathematics and Physics.

[11]  R. Tyrrell Rockafellar,et al.  Computational schemes for large-scale problems in extended linear-quadratic programming , 1990, Math. Program..

[12]  R. Tyrrell Rockafellar,et al.  Primal-Dual Projected Gradient Algorithms for Extended Linear-Quadratic Programming , 1993, SIAM J. Optim..

[13]  R. Rockafellar,et al.  Generalized linear-quadratic problems of deterministic and stochastic optimal control in discrete time , 1990 .

[14]  Ciyou Zhu Asymptotic Convergence Analysis of the Forward-Backward Splitting Algorithm , 1995, Math. Oper. Res..