Convergence of a stochastic subgradient method with averaging for nonsmooth nonconvex constrained optimization

We prove convergence of a single time-scale stochastic subgradient method with subgradient averaging for constrained problems with a nonsmooth and nonconvex objective function having the property of generalized differentiability. As a tool of our analysis, we also prove a chain rule on a path for such functions.

[1]  Dmitriy Drusvyatskiy,et al.  Stochastic model-based minimization of weakly convex functions , 2018, SIAM J. Optim..

[2]  Harold J. Kushner,et al.  wchastic. approximation methods for constrained and unconstrained systems , 1978 .

[3]  Harold J. Kushner,et al.  Stochastic Approximation Algorithms and Applications , 1997, Applications of Mathematics.

[4]  Adrian S. Lewis,et al.  Clarke Subgradients of Stratifiable Functions , 2006, SIAM J. Optim..

[5]  Vladimir I. Norkin,et al.  Generalized-differentiable functions , 1980 .

[6]  Paulo Cortez,et al.  Modeling wine preferences by data mining from physicochemical properties , 2009, Decis. Support Syst..

[7]  F. Clarke.  Generalized gradients and applications , 1975 .

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Feng Ruan,et al.  Stochastic Methods for Composite and Weakly Convex Optimization Problems , 2017, SIAM J. Optim..

[10]  Dmitriy Drusvyatskiy,et al.  Stochastic Subgradient Method Converges on Tame Functions , 2018, Foundations of Computational Mathematics.

[11]  É. Moulines,et al.  Analysis of nonsmooth stochastic approximation: the differential inclusion approach , 2018, 1805.01916.

[12]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[13]  Haim Brezis,et al.  Monotonicity Methods in Hilbert Spaces and Some Applications to Nonlinear Partial Differential Equations , 1971 .

[14]  Andrzej Ruszczynski,et al.  A Linearization Method for Nonsmooth Stochastic Programming Problems , 1987, Math. Oper. Res..

[15]  Tamer Basar,et al.  Analysis of Recursive Stochastic Algorithms , 2001 .

[16]  R. Mifflin.  Semismooth and Semiconvex Functions in Constrained Optimization , 1977 .

[17]  Josef Hofbauer,et al.  Stochastic Approximations and Differential Inclusions , 2005, SIAM J. Control. Optim..

[18]  Dmitriy Drusvyatskiy,et al.  Curves of Descent , 2012, SIAM J. Control. Optim..

[19]  V. Borkar.  Stochastic Approximation: A Dynamical Systems Viewpoint , 2008 .

[20]  Andrzej Ruszczyński,et al.  A method of feasible directions for solving nonsmooth stochastic programming problems , 1986 .