A Family of Projection Gradient Methods for Solving the Multiple-Sets Split Feasibility Problem

In the present paper, we explore a family of projection gradient methods for solving the multiple-sets split feasibility problem, which include the cyclic/simultaneous iteration methods introduced in Wen et al. (J Optim Theory Appl 166:844–860, 2015) as special cases. For the general case, where the involved sets are given by level sets of convex functions, the calculation of the projection onto the level sets is complicated in general, and thus, the resulting projection gradient method cannot be implemented easily. To avoid this difficulty, we introduce a family of relaxed projection gradient methods, in which the projections onto the approximated halfspaces are adopted in place of the ones onto the level sets. They cover the relaxed cyclic/simultaneous iteration methods introduced in Wen et al. (J Optim Theory Appl 166:844–860, 2015) as special cases. Global weak convergence theorems are established for these methods. In particular, as direct applications of the established theorems, our results fill some gaps and deal with the imperfections that appeared in Wen et al. (J Optim Theory Appl 166:844–860, 2015) and hence improve and extend the corresponding results therein.

[1]  Y. Censor,et al.  A unified approach for inversion problems in intensity-modulated radiation therapy , 2006, Physics in medicine and biology.

[2]  Yaoliang Yu,et al.  Generalized Conditional Gradient for Sparse Estimation , 2014, J. Mach. Learn. Res..

[3]  Heinz H. Bauschke,et al.  Reflection-Projection Method for Convex Feasibility Problems with an Obtuse Cone , 2004 .

[4]  Jigen Peng,et al.  A Cyclic and Simultaneous Iterative Method for Solving the Multiple-Sets Split Feasibility Problem , 2015, J. Optim. Theory Appl..

[5]  Qingzhi Yang,et al.  A simple projection method for solving the multiple-sets split feasibility problem , 2013 .

[6]  Yair Censor,et al.  A multiprojection algorithm using Bregman projections in a product space , 1994, Numerical Algorithms.

[7]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[8]  Qingzhi Yang,et al.  Self-adaptive projection methods for the multiple-sets split feasibility problem , 2011 .

[9]  Deren Han,et al.  A self-adaptive projection method for solving the multiple-sets split feasibility problem , 2009 .

[10]  C. Byrne,et al.  A unified treatment of some iterative algorithms in signal processing and image reconstruction , 2003 .

[11]  Chong Li,et al.  Linear convergence of CQ algorithms and applications in gene regulatory network inference , 2017 .

[12]  Chong Li,et al.  On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications , 2016, SIAM J. Optim..

[13]  Boris Polyak,et al.  The method of projections for finding the common point of convex sets , 1967 .

[14]  Tieyong Zeng,et al.  Image Deblurring Via Total Variation Based Structured Sparse Model Selection , 2016, J. Sci. Comput..

[15]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[16]  P. L. Combettes,et al.  Hilbertian convex feasibility problem: Convergence of projection methods , 1997 .

[17]  Hong-Kun Xu A variable Krasnosel'skii–Mann algorithm and the multiple-set split feasibility problem , 2006 .

[18]  Chen Ling,et al.  An Implementable Splitting Algorithm for the ℓ1\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\ell _1$$\end{document} , 2015, Journal of Scientific Computing.

[19]  Jen-Chih Yao,et al.  Linear Regularity and Linear Convergence of Projection-Based Methods for Solving Convex Feasibility Problems , 2018 .

[20]  Guoyin Li,et al.  Douglas–Rachford splitting for nonconvex optimization with application to nonconvex feasibility problems , 2014, Math. Program..

[21]  Lichong,et al.  Group sparse optimization via lp,q regularization , 2017 .

[22]  Chong Li,et al.  Group Sparse Optimization via lp, q Regularization , 2016, J. Mach. Learn. Res..

[23]  C. Byrne,et al.  Iterative oblique projection onto convex sets and the split feasibility problem , 2002 .

[24]  Y. Censor,et al.  The multiple-sets split feasibility problem and its applications for inverse problems , 2005 .