Complexity of Variants of Tseng's Modified F-B Splitting and Korpelevich's Methods for Hemivariational Inequalities with Applications to Saddle-point and Convex Optimization Problems

In this paper, we consider both a variant of Tseng's modified forward-backward splitting method and an extension of Korpelevich's method for solving hemivariational inequalities with Lipschitz continuous operators. By showing that these methods are special cases of the hybrid proximal extragradient method introduced by Solodov and Svaiter, we derive iteration-complexity bounds for them to obtain different types of approximate solutions. In the context of saddle-point problems, we also derive complexity bounds for these methods to obtain another type of an approximate solution, namely, that of an approximate saddle point. Finally, we illustrate the usefulness of the above results by applying them to a large class of linearly constrained convex programming problems, including, for example, cone programming and problems whose objective functions converge to infinity as the boundaries of their effective domains are approached.

[1]  R. Rockafellar,et al.  On the maximal monotonicity of subdifferential mappings. , 1970 .

[2]  R. Rockafellar On the maximality of sums of nonlinear monotone operators , 1970 .

[3]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[4]  Ronald E. Bruck On the weak convergence of an ergodic iteration for the solution of variational inequalities for monotone operators in Hilbert space , 1977 .

[5]  P. Lions,et al.  Une methode iterative de resolution d’une inequation variationnelle , 1978 .

[6]  P. Tseng On linear convergence of iterative methods for the variational inequality problem , 1995 .

[7]  E. G. Golʹshteĭn,et al.  Modified Lagrangians and monotone maps in optimization , 1996 .

[8]  A. Iusem,et al.  Enlargement of Monotone Operators with Applications to Variational Inequalities , 1997 .

[9]  M. Patriksson Nonlinear Programming and Variational Inequality Problems: A Unified Approach , 1998 .

[10]  M. V. Solodovy,et al.  A Hybrid Projection{proximal Point Algorithm , 1998 .

[11]  B. Svaiter,et al.  ε-Enlargements of Maximal Monotone Operators: Theory and Applications , 1998 .

[12]  M. Noor An extraresolvent method for monotone mixed variational inequalities , 1999 .

[13]  M. Patriksson Nonlinear Programming and Variational Inequality Problems , 1999 .

[14]  M. Solodov,et al.  A Hybrid Approximate Extragradient – Proximal Point Algorithm Using the Enlargement of a Maximal Monotone Operator , 1999 .

[15]  Benar Fux Svaiter,et al.  An Inexact Hybrid Generalized Proximal Point Algorithm and Some New Results on the Theory of Bregman Functions , 2000, Math. Oper. Res..

[16]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[17]  M. Solodov,et al.  A UNIFIED FRAMEWORK FOR SOME INEXACT PROXIMAL POINT ALGORITHMS , 2001 .

[18]  M. Teboulle,et al.  Asymptotic cones and functions in optimization and variational inequalities , 2002 .

[19]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[20]  Arkadi Nemirovski,et al.  Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems , 2004, SIAM J. Optim..

[21]  Yurii Nesterov,et al.  Dual extrapolation and its applications to solving variational inequalities and related problems , 2003, Math. Program..

[22]  I. Konnov Combined Relaxation Methods for Generalized Monotone Variational Inequalities , 2007 .

[23]  Renato D. C. Monteiro,et al.  On the Complexity of the Hybrid Proximal Extragradient Method for the Iterates and the Ergodic Mean , 2010, SIAM J. Optim..

[24]  M. Fukushima,et al.  "Reformulation: Nonsmooth, Piecewise Smooth, Semismooth and Smoothing Methods" , 2010 .

[25]  J. Schiff Wiley‐Interscience Series in Discrete Mathematics and Optimization , 2011 .