Convergence of inexact descent methods for nonconvex optimization on Riemannian manifolds

In this paper we present an abstract convergence analysis of inexact descent methods in Riemannian context for functions satisfying Kurdyka-Lojasiewicz inequality. In particular, without any restrictive assumption about the sign of the sectional curvature of the manifold, we obtain full convergence of a bounded sequence generated by the proximal point method, in the case that the objective function is nonsmooth and nonconvex, and the subproblems are determined by a quasi distance which does not necessarily coincide with the Riemannian distance. Moreover, if the objective function is $C^1$ with $L$-Lipschitz gradient, not necessarily convex, but satisfying Kurdyka-Lojasiewicz inequality, full convergence of a bounded sequence generated by the steepest descent method is obtained.

[1]  Adrian S. Lewis,et al.  The [barred L]ojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems , 2006, SIAM J. Optim..

[2]  K. Kurdyka,et al.  Proof of the gradient conjecture of R. Thom , 1999, math/9906212.

[3]  Charles Steinhorn,et al.  Tame Topology and O-Minimal Structures , 2008 .

[4]  Patrick L. Combettes,et al.  Proximal Methods for Cohypomonotone Operators , 2004, SIAM J. Control. Optim..

[5]  J. Nash.  The imbedding problem for Riemannian manifolds , 1956 .

[6]  E. Bierstone,et al.  Semianalytic and subanalytic sets , 1988 .

[7]  D. Luenberger.  The Gradient Projection Method Along Geodesics , 1972 .

[8]  Antoine Soubeyran,et al.  A proximal algorithm with quasi distance. Application to habit's formation , 2012 .

[9]  B. Dundas,et al.  DIFFERENTIAL TOPOLOGY , 2002 .

[10]  Paulo Roberto Oliveira,et al.  Proximal point method for a special class of nonconvex functions on Hadamard manifolds , 2008, 0812.2201.

[11]  Hédy Attouch,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality , 2008, Math. Oper. Res..

[12]  A. Iusem,et al.  Full convergence of the steepest descent method with inexact line searches , 1995 .

[13]  M. Coste.  AN INTRODUCTION TO O-MINIMAL GEOMETRY , 2002 .

[14]  Teemu Pennanen,et al.  Local Convergence of the Proximal Point Algorithm and Multiplier Methods Without Monotonicity , 2002, Math. Oper. Res..

[15]  A. Iusem,et al.  Proximal methods in reflexive Banach spaces without monotonicity , 2007 .

[16]  Tamás Rapcsák,et al.  Smooth Nonlinear Optimization in Rn , 1997 .

[17]  C. Udriste,et al.  Convex Functions and Optimization Methods on Riemannian Manifolds , 1994 .

[18]  O. P. Ferreira,et al.  Proximal Point Algorithm On Riemannian Manifolds , 2002 .

[19]  K. G. Murty,et al.  Convergence of the steepest descent method for minimizing quasiconvex functions , 1996 .

[20]  P. Roberto Oliveira,et al.  Steepest descent method with a generalized Armijo search for quasiconvex functions on Riemannian manifolds , 2008 .

[21]  M. Fukushima,et al.  A generalized proximal point algorithm for certain non-convex minimization problems , 1981 .

[22]  Alfredo N. Iusem,et al.  Inexact Variants of the Proximal Point Algorithm without Monotonicity , 2002, SIAM J. Optim..

[23]  J. Spingarn.  Submonotone mappings and the proximal point algorithm , 1982 .

[24]  Hédy Attouch,et al.  On the convergence of the proximal algorithm for nonsmooth functions involving analytic features , 2008, Math. Program..

[25]  L. Dries,et al.  Geometric categories and o-minimal structures , 1996 .

[26]  Felipe Alvarez,et al.  A Unifying Local Convergence Result for Newton's Method in Riemannian Manifolds , 2008, Found. Comput. Math..

[27]  D. Gabay.  Minimizing a differentiable function over a differential manifold , 1982 .

[28]  Alexander Kaplan,et al.  Proximal Point Methods and Nonconvex Optimization , 1998, J. Glob. Optim..

[29]  Robert E. Mahony,et al.  Convergence of the Iterates of Descent Methods for Analytic Cost Functions , 2005, SIAM J. Optim..

[30]  Yu. S. Ledyaev,et al.  Nonsmooth analysis on smooth manifolds , 2007 .

[31]  K. Kurdyka.  On gradients of functions definable in o-minimal structures , 1998 .

[32]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..