On the analysis of reflected gradient and splitting methods for monotone stochastic variational inequality problems

Stochastic generalizations of the extragradient method are complicated by a key challenge: the scheme requires two projections on a convex set and two evaluations of the map for every major iteration. We consider two related avenues where every iteration requires a single projection: (i) A projected reflected gradient (PRG) method requiring a single evaluation of the map and a single projection; and (ii) A modified backward-forward splitting (MBFS) method that requires two evaluations of the map and a single projection. We make the following contributions: (a) We prove almost sure convergence of the iterates to a random point in the solution set for the stochastic PRG scheme under a weak sharpness requirement; (b) We prove that the mean of the gap function associated with the averaged sequence diminishes to zero at the optimal rate of O(1/√N) for both schemes where N is the iteration index.

[1]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[2]  P. Tseng.  On linear convergence of iterative methods for the variational inequality problem , 1995 .

[3]  Renato D. C. Monteiro,et al.  Complexity of Variants of Tseng's Modified F-B Splitting and Korpelevich's Methods for Hemivariational Inequalities with Applications to Saddle-point and Convex Optimization Problems , 2011, SIAM J. Optim..

[4]  Angelia Nedic,et al.  A regularized smoothing stochastic approximation (RSSA) algorithm for stochastic variational inequality problems , 2013, 2013 Winter Simulations Conference (WSC).

[5]  Yu. V. Malitsky,et al.  Projected Reflected Gradient Methods for Monotone Variational Inequalities , 2015, SIAM J. Optim..

[6]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[7]  I. V. Konnov.  A combined method for variational inequalities with monotone operators , 1999 .

[8]  Houyuan Jiang,et al.  Stochastic Approximation Approaches to the Stochastic Variational Inequality Problem , 2008, IEEE Transactions on Automatic Control.

[9]  Alexander Shapiro,et al.  Stochastic Approximation approach to Stochastic Programming , 2013 .

[10]  A. Juditsky,et al.  Solving variational inequalities with Stochastic Mirror-Prox algorithm , 2008, 0809.0815.

[11]  Ines Gloeckner,et al.  Modified Lagrangians And Monotone Maps In Optimization , 2016 .

[12]  Angelia Nedic,et al.  Regularized Iterative Stochastic Approximation Methods for Stochastic Variational Inequality Problems , 2013, IEEE Transactions on Automatic Control.

[13]  Angelia Nedic,et al.  Self-Tuned Stochastic Approximation Schemes for Non-Lipschitzian Stochastic Multi-User Optimization and Nash Games , 2016, IEEE Transactions on Automatic Control.

[14]  Uday V. Shanbhag,et al.  On the Characterization of Solution Sets of Smooth and Nonsmooth Convex Stochastic Nash Games , 2011, SIAM J. Optim..

[15]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[16]  G. M. Korpelevich.  The extragradient method for finding saddle points and other problems , 1976 .

[17]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[18]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[19]  Angelia Nedic,et al.  Optimal robust smoothing extragradient algorithms for stochastic variational inequality problems , 2014, 53rd IEEE Conference on Decision and Control.