On the convergence rate of the Halpern-iteration

In this work, we give a tight estimate of the rate of convergence for the Halpern-iteration for approximating a fixed point of a nonexpansive mapping in a Hilbert space. Specifically, using semidefinite programming and duality we prove that the norm of the residuals is upper bounded by the distance of the initial iterate to the closest fixed point divided by the number of iterations plus one.

[1]  Ulrich Kohlenbach,et al.  Effective metastability of Halpern iterates in CAT(0) spaces , 2011, 1107.3215.

[2]  Ulrich Kohlenbach,et al.  On quantitative versions of theorems due to F.E. Browder and R. Wittmann , 2011 .

[3]  Jos F. Sturm,et al.  Implementation of interior point methods for mixed semidefinite and second order cone optimization problems , 2002, Optim. Methods Softw..

[4]  Hong-Kun Xu.  Iterative Algorithms for Nonlinear Operators , 2002 .

[5]  Junfeng Yang,et al.  Tight Sublinear Convergence Rate of the Proximal Point Algorithm for Maximal Monotone Inclusion Problems , 2020, SIAM J. Optim..

[6]  Felix M. Sc Lieder,et al.  Projection Based Methods for Conic Linear Programming — Optimal First Order Complexities and Norm Constrained Quasi Newton Methods , 2018 .

[7]  Laurentiu Leustean.  Rates of Asymptotic Regularity for Halpern Iterations of Nonexpansive Mappings , 2007, J. Univers. Comput. Sci..

[8]  Adrien B. Taylor,et al.  Smooth strongly convex interpolation and exact worst-case performance of first-order methods , 2015, Mathematical Programming.

[9]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[10]  Johan Löfberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004 .

[11]  B. Halpern.  Fixed points of nonexpanding maps , 1967 .

[12]  Junfeng Yang,et al.  Optimal Nonergodic Sublinear Convergence Rate of Proximal Point Algorithm for Maximal Monotone Inclusion Problems , 2019, 1904.05495.

[13]  R. Wittmann.  Approximation of fixed points of nonexpansive mappings , 1992 .

[14]  M. D. Kirszbraun.  Über die zusammenziehende und Lipschitzsche Transformationen , 1934 .

[15]  Shimrit Shtern,et al.  A First Order Method for Solving Convex Bilevel Optimization Problems , 2017, SIAM J. Optim..

[16]  José A. Soto,et al.  On the rate of convergence of Krasnosel’skiĭ-Mann iterations and their connection with sums of Bernoullis , 2012, 1206.4195.