The Forward-Backward-Forward Method from discrete and continuous perspective for pseudo-monotone variational inequalities in Hilbert Spaces

Tseng's forward-backward-forward algorithm is a valuable alternative for Korpelevich's extragradient method when solving variational inequalities over a convex and closed set governed by monotone and Lipschitz continuous operators, as it requires in every step only one projection operation. However, it is well-known that Korpelevich's method is provable convergent and thus applicable when solving variational inequalities governed by a pseudo-monotone and Lipschitz continuous operator. In this paper we prove that Tseng's method converges also when it is applied to the solving of pseudo-monotone variational inequalities. In addition, we show that linear convergence is guaranteed under strong pseudo-monotonicity. We also associate a dynamical system to the pseudo-monotone variational inequality and carry out an asymptotic analysis for the generated trajectories. Numerical experiments show that Tseng's method outperforms Korplelevich's extragradient method when applied to the solving of pseudo-monotone variational inequalities and fractional programming problems.

[1]  Yura Malitsky,et al.  Golden ratio algorithms for variational inequalities , 2018, Mathematical Programming.

[2]  Yu Malitsky,et al.  Proximal extrapolated gradient methods for variational inequalities , 2016, Optim. Methods Softw..

[3]  Radu Ioan Bot,et al.  Proximal-gradient algorithms for fractional programming , 2016, Optimization.

[4]  Do Sang Kim,et al.  Qualitative properties of strongly pseudomonotone variational inequalities , 2016, Optim. Lett..

[5]  A. Zaslavski The Extragradient Method for Solving Variational Inequalities , 2016 .

[6]  Radu Ioan Bot,et al.  A forward-backward-forward differential equation and its asymptotic properties , 2015, 1503.07728.

[7]  Yu. V. Malitsky,et al.  Projected Reflected Gradient Methods for Monotone Variational Inequalities , 2015, SIAM J. Optim..

[8]  Guanghui Lan,et al.  On the convergence properties of non-Euclidean extragradient methods for variational inequalities with generalized monotone operators , 2013, Comput. Optim. Appl..

[9]  Benar Fux Svaiter,et al.  Newton-Like Dynamics and Forward-Backward Methods for Structured Monotone Inclusions in Hilbert Spaces , 2014, J. Optim. Theory Appl..

[10]  Phan Tu Vuong,et al.  Modified projection method for strongly pseudomonotone variational inequalities , 2014, J. Glob. Optim..

[11]  A. Cegielski Iterative Methods for Fixed Point Problems in Hilbert Spaces , 2012 .

[12]  Yair Censor,et al.  Extensions of Korpelevich's extragradient method for the variational inequality problem in Euclidean space , 2012 .

[13]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[14]  Yair Censor,et al.  The Subgradient Extragradient Method for Solving Variational Inequalities in Hilbert Space , 2011, J. Optim. Theory Appl..

[15]  Marc Teboulle,et al.  Weak Convergence of an Iterative Method for Pseudomonotone Variational Inequalities and Fixed-Point Problems , 2010 .

[16]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[17]  J. Borwein,et al.  Convex Analysis And Nonlinear Optimization , 2000 .

[18]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[19]  M. Solodov,et al.  A New Projection Method for Variational Inequality Problems , 1999 .

[20]  P. Tseng,et al.  Modified Projection-Type Methods for Monotone Variational Inequalities , 1996 .

[21]  Patrice Marcotte,et al.  Co-Coercivity and Its Role in the Convergence of Iterative Schemes for Solving Variational Inequalities , 1996, SIAM J. Optim..

[22]  Jen-Chih Yao,et al.  Pseudo-monotone complementarity problems in Hilbert space , 1992 .

[23]  S. Karamardian,et al.  Seven kinds of monotone maps , 1990 .

[24]  G. M. Korpelevich The extragradient method for finding saddle points and other problems , 1976 .