Extragradient Method with Variance Reduction for Stochastic Variational Inequalities

We propose an extragradient method with stepsizes bounded away from zero for stochastic variational inequalities requiring only pseudomonotonicity. We provide convergence and complexity analysis, a...

[1]  Tito Homem-de-Mello,et al.  Variable-sample methods for stochastic optimization , 2003, TOMC.

[2]  H. Robbins.  A Stochastic Approximation Method , 1951 .

[3]  Carlo Marinelli,et al.  On the maximal inequalities of Burkholder, Davis and Gundy , 2013, 1308.2418.

[4]  R. Durrett.  Probability: Theory and Examples , 1993 .

[5]  Yunmei Chen,et al.  Accelerated schemes for a class of variational inequalities , 2014, Mathematical Programming.

[6]  I. Konnov.  Equilibrium Models and Variational Inequalities , 2013 .

[7]  Uday V. Shanbhag,et al.  Budget-constrained stochastic approximation , 2015, 2015 Winter Simulation Conference (WSC).

[8]  A. Iusem,et al.  Enlargement of Monotone Operators with Applications to Variational Inequalities , 1997 .

[9]  Alfredo N. Iusem,et al.  Incremental Constraint Projection Methods for Monotone Stochastic Variational Inequalities , 2017, Math. Oper. Res..

[10]  Angelia Nedic,et al.  Optimal robust smoothing extragradient algorithms for stochastic variational inequality problems , 2014, 53rd IEEE Conference on Decision and Control.

[11]  R. Tyrrell Rockafellar,et al.  Asymptotic Theory for Solutions in Statistical Estimation and Stochastic Programming , 1993, Math. Oper. Res..

[12]  Angelia Nedi'c,et al.  Distributed adaptive steplength stochastic approximation schemes for Cartesian stochastic variational inequality problems , 2013, 1301.1711.

[13]  Huifu Xu.  Uniform exponential convergence of sample average random functions under general sampling with applications in stochastic programming , 2010 .

[14]  Tail bounds for stochastic approximation , 2013, 1304.5586.

[15]  Angelia Nedic,et al.  Regularized Iterative Stochastic Approximation Methods for Stochastic Variational Inequality Problems , 2013, IEEE Transactions on Automatic Control.

[16]  Huifu Xu,et al.  Sample Average Approximation Methods for a Class of Stochastic Variational inequality Problems , 2010, Asia Pac. J. Oper. Res..

[17]  Uday V. Shanbhag,et al.  The pseudomonotone stochastic variational inequality problem: Analytical statements and stochastic extragradient schemes , 2014, 2014 American Control Conference.

[18]  Arkadi Nemirovski,et al.  Prox-Method with Rate of Convergence O(1/t) for Variational Inequalities with Lipschitz Continuous Monotone Operators and Smooth Convex-Concave Saddle Point Problems , 2004, SIAM J. Optim..

[19]  Uday V. Shanbhag,et al.  On the existence of solutions to stochastic quasi-variational inequality and complementarity problems , 2017, Math. Program..

[20]  Alexander Shapiro,et al.  Stochastic Approximation approach to Stochastic Programming , 2013 .

[21]  Pseudomonotone Stochastic Variational Inequality Problems: Analysis and Stochastic Approximation Schemes , 2014 .

[22]  Jorge Nocedal,et al.  Sample size selection in optimization methods for machine learning , 2012, Math. Program..

[23]  R. Bass,et al.  Review: P. Billingsley, Convergence of probability measures , 1971 .

[24]  Eric Moulines,et al.  Non-Asymptotic Analysis of Stochastic Approximation Algorithms for Machine Learning , 2011, NIPS.

[25]  Renato D. C. Monteiro,et al.  On the Complexity of the Hybrid Proximal Extragradient Method for the Iterates and the Ergodic Mean , 2010, SIAM J. Optim..

[26]  Angelia Nedic,et al.  Self-Tuned Stochastic Approximation Schemes for Non-Lipschitzian Stochastic Multi-User Optimization and Nash Games , 2016, IEEE Transactions on Automatic Control.

[27]  Yurii Nesterov,et al.  Primal-dual subgradient methods for convex problems , 2005, Math. Program..

[28]  Michael C. Ferris,et al.  Variable-Number Sample-Path Optimization , 2008, Math. Program..

[29]  Huifu Xu,et al.  Stochastic Nash equilibrium problems: sample average approximation and applications , 2013, Comput. Optim. Appl..

[30]  A. Juditsky,et al.  Solving variational inequalities with Stochastic Mirror-Prox algorithm , 2008, 0809.0815.

[31]  Michael C. Ferris,et al.  Engineering and Economic Applications of Complementarity Problems , 1997, SIAM Rev..

[32]  Renato D. C. Monteiro,et al.  Complexity of Variants of Tseng's Modified F-B Splitting and Korpelevich's Methods for Hemivariational Inequalities with Applications to Saddle-point and Convex Optimization Problems , 2011, SIAM J. Optim..

[33]  G. M. Korpelevich.  The extragradient method for finding saddle points and other problems , 1976 .

[34]  Saeed Ghadimi,et al.  Mini-batch stochastic approximation methods for nonconvex stochastic composite optimization , 2013, Mathematical Programming.

[35]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[36]  B. Davis,et al.  Integral Inequalities for Convex Functions of Operators on Martingales , 2011 .

[37]  Gül Gürkan,et al.  Sample-path solution of stochastic variational inequalities , 1999, Math. Program..

[38]  Martin J. Wainwright,et al.  Randomized Smoothing for Stochastic Optimization , 2011, SIAM J. Optim..

[39]  Houyuan Jiang,et al.  Stochastic Approximation Approaches to the Stochastic Variational Inequality Problem , 2008, IEEE Transactions on Automatic Control.

[40]  H. Robbins,et al.  A Convergence Theorem for Non Negative Almost Supermartingales and Some Applications , 1985 .

[41]  Xiaojun Chen,et al.  Stochastic Variational Inequalities: Residual Minimization Smoothing Sample Average Approximations , 2012, SIAM J. Optim..

[42]  Uday V. Shanbhag,et al.  Distributed Computation of Equilibria in Monotone Nash Games via Iterative Regularization Techniques , 2012, SIAM J. Optim..

[43]  Alexander Shapiro,et al.  Lectures on Stochastic Programming: Modeling and Theory , 2009 .

[44]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[45]  Dimitri P. Bertsekas,et al.  Incremental constraint projection methods for variational inequalities , 2014, Math. Program..