Convergence of Proximal-Like Algorithms

We analyze proximal methods based on entropy-like distances for the minimization of convex functions subject to nonnegativity constraints. We prove global convergence results for the methods with approximate minimization steps and an ergodic convergence result for the case of finding a zero of a maximal monotone operator. We also consider linearly constrained convex problems and establish a quadratic convergence rate result for linear programs. Our analysis allows us to simplify and extend the available convergence results for these methods.

[1]  J. Moreau.  Proximité et dualité dans un espace hilbertien , 1965 .

[2]  R. Rockafellar.  On the maximality of sums of nonlinear monotone operators , 1970 .

[3]  Ronald E. Bruck.  An iterative solution of a variational inequality for certain monotone operators in Hilbert space , 1975 .

[4]  R. Rockafellar.  Monotone Operators and the Proximal Point Algorithm , 1976 .

[5]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[6]  B. Martinet.  Perturbation des méthodes d'optimisation. Applications , 1978 .

[7]  H. Brezis,et al.  Produits infinis de resolvantes , 1978 .

[8]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[9]  P. P. B. Eggermont,et al.  Multiplicative iterative algorithms for convex programming , 1990 .

[10]  Osman Güer.  On the convergence of the proximal point algorithm for convex minimization , 1991 .

[11]  Roman A. Polyak,et al.  Modified barrier functions (theory and methods) , 1992, Math. Program..

[12]  B. Lemaire.  About the Convergence of the Proximal Method , 1992 .

[13]  Marc Teboulle,et al.  Entropic Proximal Mappings with Applications to Nonlinear Programming , 1992, Math. Oper. Res..

[14]  Paul Tseng,et al.  On the convergence of the exponential multiplier method for convex programming , 1993, Math. Program..

[15]  Marc Teboulle,et al.  Convergence Analysis of a Proximal-Like Minimization Algorithm Using Bregman Functions , 1993, SIAM J. Optim..

[16]  Marc Teboulle,et al.  Entropy-Like Proximal Methods in Convex Programming , 1994, Math. Oper. Res..

[17]  Sai͏̈d Kabbadj.  Méthodes proximales entropiques , 1994 .

[18]  Mounir Haddou,et al.  An interior-proximal method for convex linearly constrained problems and its extension to variational inequalities , 1995, Math. Program..

[19]  B. Lemaire.  On the Convergence of Some Iterative Methods for Convex Minimization , 1995 .

[20]  Marc Teboulle,et al.  Convergence Rate Analysis of Nonquadratic Proximal Methods for Convex and Linear Programming , 1995, Math. Oper. Res..

[21]  Marc Teboulle,et al.  Nonlinear rescaling and proximal-like methods in convex optimization , 1997, Math. Program..

[22]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[23]  K. Kiwiel.  Proximal Minimization Methods with Generalized Bregman Functions , 1997 .

[24]  I. Vajda,et al.  Convex Statistical Distances , 2018, Statistical Inference for Engineers and Data Scientists.