Weak, strong and linear convergence of the CQ-method via the regularity of Landweber operators

ABSTRACT We consider the split convex feasibility problem in a fixed point setting. Motivated by the well-known CQ-method of Byrne [Iterative oblique projection onto convex sets and the split feasibility problem. Inverse Probl. 2002;18:441–453], we define an abstract Landweber transform which applies to more general operators than the metric projection. We call the result of this transform a Landweber operator. It turns out that the Landweber transform preserves many interesting properties. For example, the Landweber transform of a (quasi/firmly) nonexpansive mapping is again (quasi/firmly) nonexpansive. Moreover, the Landweber transform of a (weakly/linearly) regular mapping is again (weakly/linearly) regular. The preservation of regularity is important because it leads to (weak/linear) convergence of many CQ-type methods.

[1]  S. Reich,et al.  Linear convergence rates for extrapolated fixed point algorithms , 2018, Optimization.

[2]  U. Kohlenbach,et al.  Moduli of regularity and rates of convergence for Fejér monotone sequences , 2017, Israel Journal of Mathematics.

[3]  Andrzej Cegielski,et al.  Regular Sequences of Quasi-Nonexpansive Operators and Their Applications , 2017, SIAM J. Optim..

[4]  Chong Li,et al.  Linear convergence of CQ algorithms and applications in gene regulatory network inference , 2017 .

[5]  S. Reich,et al.  Weak convergence of infinite products of operators in Hadamard spaces , 2016 .

[6]  A. Cegielski,et al.  Strong convergence of a hybrid steepest descent method for the split common fixed point problem , 2016 .

[7]  Jonathan M. Borwein,et al.  Convergence Rate Analysis for Averaged Fixed Point Iterations in Common Fixed Point Problems , 2015, SIAM J. Optim..

[8]  Xingshi He,et al.  Introduction to Optimization , 2015, Optimization for Chemical and Biochemical Engineering.

[9]  Andrzej Cegielski,et al.  General Method for Solving the Split Common Fixed Point Problem , 2015, J. Optim. Theory Appl..

[10]  A. Cegielski.  Landweber-type operator and its properties , 2014, 1411.1904.

[11]  Heinz H. Bauschke,et al.  Linear and strong convergence of algorithms involving averaged nonexpansive operators , 2014, Journal of Mathematical Analysis and Applications.

[12]  Koji Aoyama,et al.  Viscosity approximation process for a sequence of quasinonexpansive mappings , 2014 .

[13]  A. Cegielski,et al.  Methods for Variational Inequality Problem Over the Intersection of Fixed Point Sets of Quasi-Nonexpansive Operators , 2013 .

[14]  A. Cegielski.  Iterative Methods for Fixed Point Problems in Hilbert Spaces , 2012 .

[15]  Hong-Kun Xu,et al.  Solving the split feasibility problem without prior knowledge of matrix norms , 2012 .

[16]  Hong-Kun Xu,et al.  Cyclic algorithms for split feasibility problems in Hilbert spaces , 2011 .

[17]  Abdellatif Moudafi,et al.  A note on the split common fixed-point problem for quasi-nonexpansive operators , 2011 .

[18]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[19]  Hong-Kun Xu,et al.  Averaged Mappings and the Gradient-Projection Algorithm , 2011, J. Optim. Theory Appl..

[20]  H. Zhang,et al.  Projected Landweber iteration for matrix completion , 2010, J. Comput. Appl. Math..

[21]  Hong-Kun Xu.  Iterative methods for the split feasibility problem in infinite-dimensional Hilbert spaces , 2010 .

[22]  Yair Censor,et al.  Algorithms for the Split Variational Inequality Problem , 2010, Numerical Algorithms.

[23]  Abdellatif Moudafi,et al.  The split common fixed-point problem for demicontractive mappings , 2010 .

[24]  Y. Censor,et al.  Perturbed projections and subgradient projections for the multiple-sets split feasibility problem , 2007 .

[25]  P. Maingé.  Inertial Iterative Process for Fixed Points of Certain Quasi-nonexpansive Mappings , 2007 .

[26]  Hong-Kun Xu.  A variable Krasnosel'skii–Mann algorithm and the multiple-set split feasibility problem , 2006 .

[27]  Björn Johansson,et al.  The application of an oblique-projected Landweber method to a model of supervised learning , 2006, Math. Comput. Model..

[28]  Y. Censor,et al.  The multiple-sets split feasibility problem and its applications for inverse problems , 2005 .

[29]  N. Xiu,et al.  A note on the CQ algorithm for the split feasibility problem , 2005 .

[30]  Qingzhi Yang.  On variable-step relaxed projection algorithm for variational inequalities , 2005 .

[31]  Qingzhi Yang.  The relaxed CQ algorithm solving the split feasibility problem , 2004 .

[32]  C. Byrne.  A unified treatment of some iterative algorithms in signal processing and image reconstruction , 2004 .

[33]  C. Byrne.  Iterative oblique projection onto convex sets and the split feasibility problem , 2002 .

[34]  Heinz H. Bauschke,et al.  A Weak-to-Strong Convergence Principle for Fejé-Monotone Methods in Hilbert Spaces , 2001, Math. Oper. Res..

[35]  M. Bertero,et al.  Projected Landweber method and preconditioning , 1997 .

[36]  Krzysztof C. Kiwiel,et al.  Surrogate Projection Methods for Finding Fixed Points of Firmly Nonexpansive Mappings , 1997, SIAM J. Optim..

[37]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[38]  Yair Censor,et al.  A multiprojection algorithm using Bregman projections in a product space , 1994, Numerical Algorithms.

[39]  W. Petryshyn,et al.  Strong and weak convergence of the sequence of successive approximations for quasi-nonexpansive mappings , 1973 .

[40]  Curtis Outlaw,et al.  Mean value iteration of nonexpansive mappings in a Banach space , 1969 .

[41]  Z. Opial.  Weak convergence of the sequence of successive approximations for nonexpansive mappings , 1967 .

[42]  W. R. Mann,et al.  Mean value methods in iteration , 1953 .

[43]  L. Landweber.  An iteration formula for Fredholm integral equations of the first kind , 1951 .

[44]  Andrzej Cegielskiand Rafa L Zalas.  PROPERTIES OF A CLASS OF APPROXIMATELY SHRINKING OPERATORS AND THEIR APPLICATIONS , 2014 .

[45]  Yair Censor,et al.  The Split Common Fixed Point Problem for Directed Operators. , 2010, Journal of convex analysis.

[46]  Lokenath Debnath,et al.  Hilbert spaces with applications , 2005 .

[47]  Patrick L. Combettes,et al.  Signal Recovery by Proximal Forward-Backward Splitting , 2005, Multiscale Model. Simul..

[48]  Gerald Teschl.  Functional Analysis , 2004 .

[49]  F. Deutsch.  Best approximation in inner product spaces , 2001 .

[50]  R. Kanwal.  Linear Integral Equations , 1925, Nature.