Local linear convergence of approximate projections onto regularized sets

Abstract The numerical properties of algorithms for finding the intersection of sets depend to some extent on the regularity of the sets, but even more importantly on the regularity of the intersection. The alternating projection algorithm of von Neumann has been shown to converge locally at a linear rate dependent on the regularity modulus of the intersection. In many applications, however, the sets in question come from inexact measurements that are matched to idealized models. It is unlikely that any such problems in applications will enjoy metrically regular intersection, let alone set intersection. We explore a regularization strategy that generates an intersection with the desired regularity properties. The regularization, however, can lead to a significant increase in computational complexity. In a further refinement, we investigate and prove linear convergence of an approximate alternating projection algorithm. The analysis provides a regularization strategy that fits naturally with many ill-posed inverse problems, and a mathematically sound stopping criterion for extrapolated, approximate algorithms. The theory is demonstrated on the phase retrieval problem with experimental data. The conventional early termination applied in practice to unregularized, consistent problems in diffraction imaging can be justified fully in the framework of this analysis providing, for the first time, proof of convergence of alternating approximate projections for finite dimensional, consistent phase retrieval problems.

[1]  Heinz H. Bauschke,et al.  On the convergence of von Neumann's alternating projection algorithm for two sets , 1993 .

[2]  S. Marchesini,et al.  Invited article: a [corrected] unified evaluation of iterative projection algorithms for phase retrieval. , 2006, The Review of scientific instruments.

[3]  Heinz H. Bauschke,et al.  Finding best approximation pairs relative to two closed convex sets in Hilbert spaces , 2004, J. Approx. Theory.

[4]  A. Dontchev,et al.  Convergence of the proximal point method for metrically regular mappings , 2007 .

[5]  Heinz H. Bauschke,et al.  Hybrid projection-reflection method for phase retrieval. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  F. Clarke,et al.  Proximal Smoothness and the Lower{C 2 Property , 1995 .

[7]  Boris Polyak,et al.  The method of projections for finding the common point of convex sets , 1967 .

[8]  Alfredo N. Iusem,et al.  Inexact Variants of the Proximal Point Algorithm without Monotonicity , 2002, SIAM J. Optim..

[9]  R. Rockafellar,et al.  Local differentiability of distance functions , 2000 .

[10]  James V. Burke,et al.  Variational Analysis Applied to the Problem of Optical Phase Retrieval , 2003, SIAM J. Control. Optim..

[11]  A. Kruger About Regularity of Collections of Sets , 2006 .

[12]  D. Russell Luke,et al.  Finding Best Approximation Pairs Relative to a Convex and Prox-Regular Set in a Hilbert Space , 2008, SIAM J. Optim..

[13]  J. Spingarn A primal-dual projection method for solving systems of linear inequalities , 1985 .

[14]  S Marchesini,et al.  Invited article: a [corrected] unified evaluation of iterative projection algorithms for phase retrieval. , 2006, The Review of scientific instruments.

[15]  W. Cheney,et al.  Proximity maps for convex sets , 1959 .

[16]  D. R. Luke Relaxed Averaged Alternating Reflections for Diffraction Imaging , 2004, math/0405208.

[17]  Teemu Pennanen,et al.  Local Convergence of the Proximal Point Algorithm and Multiplier Methods Without Monotonicity , 2002, Math. Oper. Res..

[18]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[19]  Adrian S. Lewis,et al.  Local Linear Convergence for Alternating and Averaged Nonconvex Projections , 2009, Found. Comput. Math..

[20]  James Renegar,et al.  Incorporating Condition Measures into the Complexity Theory of Linear Programming , 1995, SIAM J. Optim..

[21]  J. Neumann On Rings of Operators. Reduction Theory , 1949 .

[22]  Patrick L. Combettes,et al.  Convex set theoretic image recovery by extrapolated iterations of parallel subgradient projections , 1997, IEEE Trans. Image Process..

[23]  Heinz H. Bauschke,et al.  Phase retrieval, error reduction algorithm, and Fienup variants: a view from convex optimization. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.