A New Approach to the Proximal Point Method: Convergence on General Riemannian Manifolds

In this paper, we present a new approach to the proximal point method in the Riemannian context. In particular, without requiring any restrictive assumptions about the sign of the sectional curvature of the manifold, we obtain full convergence for any bounded sequence generated by the proximal point method, in the case that the objective function satisfies the Kurdyka–Lojasiewicz inequality. In our approach, we extend the applicability of the proximal point method to be able to solve any problem that can be formulated as the minimizing of a definable function, such as one that is analytic, restricted to a compact manifold, on which the sign of the sectional curvature is not necessarily constant.

[1]  Chong Li,et al.  Monotone vector fields and the proximal point algorithm on Hadamard manifolds , 2009 .

[2]  Adrian S. Lewis,et al.  The [barred L]ojasiewicz Inequality for Nonsmooth Subanalytic Functions with Applications to Subgradient Dynamical Systems , 2006, SIAM J. Optim..

[3]  Sandor Nemeth.  Homeomorphisms and monotone vector fields , 2001 .

[4]  Alfredo N. Iusem,et al.  Inexact Variants of the Proximal Point Algorithm without Monotonicity , 2002, SIAM J. Optim..

[5]  Robert Mahony,et al.  Optimization On Manifolds: Methods And Applications , 2010 .

[6]  Adrian S. Lewis,et al.  Clarke Subgradients of Stratifiable Functions , 2006, SIAM J. Optim..

[7]  M. Fukushima,et al.  A generalized proximal point algorithm for certain non-convex minimization problems , 1981 .

[8]  K. Kurdyka,et al.  Proof of the gradient conjecture of R. Thom , 1999, math/9906212.

[9]  Yu. S. Ledyaev,et al.  Nonsmooth analysis on smooth manifolds , 2007 .

[10]  K. Kurdyka.  On gradients of functions definable in o-minimal structures , 1998 .

[11]  Patrick L. Combettes,et al.  Proximal Methods for Cohypomonotone Operators , 2004, SIAM J. Control. Optim..

[12]  J. Bolte,et al.  Characterizations of Lojasiewicz inequalities: Subgradient flows, talweg, convexity , 2009 .

[13]  Paulo Roberto Oliveira,et al.  Proximal point method for a special class of nonconvex functions on Hadamard manifolds , 2008, 0812.2201.

[14]  Németh S.Z.,et al.  Five kinds of monotone vector fields , 1998 .

[15]  P. R. Oliveira,et al.  Proximal point methods for quasiconvex and convex functions with Bregman distances on Hadamard manifolds , 2009 .

[16]  Hédy Attouch,et al.  On the convergence of the proximal algorithm for nonsmooth functions involving analytic features , 2008, Math. Program..

[17]  Nan-Jing Huang,et al.  Korpelevich’s method for variational inequality problems on Hadamard manifolds , 2012, J. Glob. Optim..

[18]  A. Iusem,et al.  Proximal methods in reflexive Banach spaces without monotonicity , 2007 .

[19]  Benar Fux Svaiter,et al.  Convergence of descent methods for semi-algebraic and tame problems: proximal algorithms, forward–backward splitting, and regularized Gauss–Seidel methods , 2013, Math. Program..

[20]  Orizon Pereira Ferreira,et al.  Singularities of Monotone Vector Fields and an Extragradient-type Algorithm , 2005, J. Glob. Optim..

[21]  Jefferson G. Melo,et al.  Subgradient Method for Convex Feasibility on Riemannian Manifolds , 2011, Journal of Optimization Theory and Applications.

[22]  I. Holopainen.  Riemannian Geometry , 1927, Nature.

[23]  Antoine Soubeyran,et al.  Learning how to Play Nash, Potential Games and Alternating Minimization Method for Structured Nonconvex Problems on Riemannian Manifolds , 2013 .

[24]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[25]  J. H. Wang,et al.  Monotone and Accretive Vector Fields on Riemannian Manifolds , 2010 .

[26]  Antoine Soubeyran,et al.  A proximal algorithm with quasi distance. Application to habit's formation , 2012 .

[27]  Chong Li,et al.  Resolvents of Set-Valued Monotone Vector Fields in Hadamard Manifolds , 2011 .

[28]  Alexander Kaplan,et al.  Proximal Point Methods and Nonconvex Optimization , 1998, J. Glob. Optim..

[29]  Sandor Nemeth.  Monotonicity of the Complementary Vector Field of a Nonexpansive Map , 1999 .

[30]  L. Dries,et al.  Geometric categories and o-minimal structures , 1996 .

[31]  João X. da Cruz Neto,et al.  A Subgradient Method for Multiobjective Optimization on Riemannian Manifolds , 2013, Journal of Optimization Theory and Applications.

[32]  Sandor Nemeth.  Geodesic monotone vector fields. , 1999 .

[33]  J. Spingarn.  Submonotone mappings and the proximal point algorithm , 1982 .

[34]  Guo-ji Tang,et al.  A projection-type method for variational inequalities on Hadamard manifolds and verification of solution existence , 2015 .

[35]  Hédy Attouch,et al.  Proximal Alternating Minimization and Projection Methods for Nonconvex Problems: An Approach Based on the Kurdyka-Lojasiewicz Inequality , 2008, Math. Oper. Res..

[36]  Tamás Rapcsák,et al.  Sectional curvatures in nonlinear optimization , 2008, J. Glob. Optim..

[37]  O. P. Ferreira,et al.  Proximal Point Algorithm On Riemannian Manifolds , 2002 .

[38]  Locally geodesically quasiconvex functions on complete Riemannian manifolds , 1986 .

[39]  Teemu Pennanen,et al.  Local Convergence of the Proximal Point Algorithm and Multiplier Methods Without Monotonicity , 2002, Math. Oper. Res..

[40]  João X. da Cruz Neto,et al.  Convex- and Monotone-Transformable Mathematical Programming Problems and a Proximal-Like Point Method , 2006, J. Glob. Optim..