Tight coefficients of averaged operators via scaled relative graph

Many iterative methods in optimization are fixed-point iterations with averaged operators. As such methods converge at an $\mathcal{O}(1/k)$ rate with the constant determined by the averagedness coefficient, establishing small averagedness coefficients for operators is of broad interest. In this paper, we show that the averagedness coefficients of the composition of averaged operators by Ogura and Yamada (Numer Func Anal Opt 32(1--2):113--137, 2002) and the three-operator splitting by Davis and Yin (Set-Valued Var Anal 25(4):829--858, 2017) are tight. The analysis relies on the scaled relative graph, a geometric tool recently proposed by Ryu, Hannah, and Yin (arXiv:1902.09788, 2019).

[1]  P. L. Combettes,et al.  Compositions and convex combinations of averaged nonexpansive operators , 2014, 1407.5100.

[2]  J. Lawrence,et al.  A Catalog of Special Plane Curves , 2013 .

[3]  Paul J. Goulart,et al.  Tight Global Linear Convergence Rate Bounds for Operator Splitting Methods , 2018, IEEE Transactions on Automatic Control.

[4]  P. Henrici,et al.  Circular arithmetic and the determination of polynomial zeros , 1971 .

[5]  Damek Davis,et al.  A Three-Operator Splitting Scheme and its Optimization Applications , 2015, 1504.01032.

[6]  J. L. Coolidge.  The Unsatisfactory Story of Curvature , 1952 .

[7]  Hwan Pyo Moon,et al.  Minkowski Geometric Algebra of Complex Sets , 2001 .

[8]  P. Giblin,et al.  Curves and singularities : a geometrical introduction to singularity theory , 1992 .

[9]  Jonathan Eckstein.  Splitting methods for monotone operators with applications to parallel optimization , 1989 .

[10]  Patrick L. Combettes *.  Solving monotone inclusions via compositions of nonexpansive averaged operators , 2004 .

[11]  B. T. Polyak,et al.  Construction of value set for robustness analysis via circular arithmetic , 1994 .

[12]  B. O'neill.  Elementary Differential Geometry , 1966 .

[13]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[14]  A. Pressley.  Elementary Differential Geometry , 2000 .

[15]  Ernest K. Ryu,et al.  Scaled relative graphs: nonexpansive operators via 2D Euclidean geometry , 2019, Mathematical Programming.

[16]  Helmut Pottmann,et al.  Exact Minkowski Products of N Complex Disks , 2002, Reliab. Comput..

[17]  W. R. Mann,et al.  Mean value methods in iteration , 1953 .

[18]  Manfred Hauenschild.  EXTENDED CIRCULAR ARITHMETIC, PROBLEMS AND RESULTS , 1980 .

[19]  Pontus Giselsson,et al.  On compositions of special cases of Lipschitz continuous operators , 2019, Fixed Point Theory and Algorithms for Sciences and Engineering.

[20]  Stephen P. Boyd,et al.  A Primer on Monotone Operator Methods , 2015 .

[21]  I. Yamada,et al.  NON-STRICTLY CONVEX MINIMIZATION OVER THE FIXED POINT SET OF AN ASYMPTOTICALLY SHRINKING NONEXPANSIVE MAPPING , 2002 .

[22]  Hannah Fisher-Grafy.  Envelopes , 2018, New Perspectives on Happiness and Mental Wellbeing in Schoolchildren.

[23]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[24]  M. Hauenschild.  Arithmetiken für komplexe Kreise , 2005, Computing.