Finding the projection of a point onto the intersection of convex sets via projections onto half-spaces

We present a modification of Dykstra's algorithm which allows us to avoid projections onto general convex sets. Instead, we calculate projections onto either a half-space or onto the intersection of two half-spaces. Convergence of the algorithm is established and special choices of the half-spaces are proposed.The option to project onto half-spaces instead of general convex sets makes the algorithm more practical. The fact that the half-spaces are quite general enables us to apply the algorithm in a variety of cases and to generalize a number of known projection algorithms.The problem of projecting a point onto the intersection of closed convex sets receives considerable attention in many areas of mathematics and physics as well as in other fields of science and engineering such as image reconstruction from projections.In this work we propose a new class of algorithms which allow projection onto certain super half-spaces, i.e., half-spaces which contain the convex sets. Each one of the algorithms that we present gives the user freedom to choose the specific super half-space from a family of such half-spaces. Since projecting a point onto a half-space is an easy task to perform, the new algorithms may be more useful in practical situations in which the construction of the super half-spaces themselves is not too difficult.

[1]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[2]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[3]  Guy Pierra,et al.  Decomposition through formalization in a product space , 1984, Math. Program..

[4]  P. L. Combettes The foundations of set theoretic estimation , 1993 .

[5]  I. Csiszár Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[6]  P. Lions Approximation de Points Fixes de Contractions , 1977 .

[7]  Y. Censor,et al.  An interior points algorithm for the convex feasibility problem , 1983 .

[8]  Patrick L. Combettes,et al.  Signal recovery by best feasible approximation , 1993, IEEE Trans. Image Process..

[9]  Alfredo N. Iusem,et al.  A row-action method for convex programming , 1994, Math. Program..

[10]  R. Dykstra,et al.  A Method for Finding Projections onto the Intersection of Convex Sets in Hilbert Spaces , 1986 .

[11]  P. L. Combettes Construction d'un point fixe commun à une famille de contractions fermes , 1995 .

[12]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[13]  Y. Censor,et al.  Parallel Optimization:theory , 1997 .

[14]  A. Pierro,et al.  A simultaneous iterative method for computing projections on polyhedra , 1987 .

[15]  Heinz H. Bauschke,et al.  Dykstra's Alternating Projection Algorithm for Two Sets , 1994 .

[16]  R. Dykstra An Algorithm for Restricted Least Squares Regression , 1983 .

[17]  K. Kiwiel Block-iterative surrogate projection methods for convex feasibility problems , 1995 .

[18]  D. D'Esopo,et al.  A convex programming procedure , 1959 .

[19]  A. Iusem,et al.  Primal-dual row-action method for convex programming , 1995 .

[20]  Masao Fukushima An Outer Approximation Algorithm for Solving General Convex Programs , 1983, Oper. Res..

[21]  Hein Hundal,et al.  The rate of convergence of dykstra's cyclic projections algorithm: The polyhedral case , 1994 .

[22]  R. Dykstra An Iterative Procedure for Obtaining $I$-Projections onto the Intersection of Convex Sets , 1985 .

[23]  Heinz H. Bauschke,et al.  A Weak-to-Strong Convergence Principle for Fejé-Monotone Methods in Hilbert Spaces , 2001, Math. Oper. Res..

[24]  Frank Deutsch,et al.  Two generalizations of Dykstra’s cyclic projections algorithm , 1997, Math. Program..

[25]  Yair Censor,et al.  The Dykstra algorithm with Bregman projec-tions , 1998 .

[26]  Paul Tseng,et al.  Dual coordinate ascent methods for non-strictly convex minimization , 1993, Math. Program..

[27]  Heinz H. Bauschke,et al.  Construction of best Bregman approximations in reflexive Banach spaces , 2003 .

[28]  Patrick L. Combettes,et al.  Strong Convergence of Block-Iterative Outer Approximation Methods for Convex Optimization , 2000, SIAM J. Control. Optim..

[29]  Shih-Ping Han A parallel algorithm for a class of convex programs , 1988 .

[30]  R. Mathar,et al.  A cyclic projection algorithm via duality , 1989 .

[31]  Y. Censor,et al.  An iterative row-action method for interval convex programming , 1981 .

[32]  D. Luenberger Optimization by Vector Space Methods , 1968 .

[33]  A. Pierro,et al.  A relaxed version of Bregman's method for convex programming , 1986 .

[34]  Patrick L. Combettes Constrained image recovery in a product space , 1995, Proceedings., International Conference on Image Processing.

[35]  Guy Pierra,et al.  Eclatement de Contraintes en Parallèle pour la Minimisation d'une Forme Quadratique , 1975, Optimization Techniques.

[36]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[37]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[38]  Clifford Hildreth,et al.  A quadratic programming procedure , 1957 .

[39]  Frank Deutsch,et al.  The Method of Alternating Orthogonal Projections , 1992 .

[40]  G. Crombez,et al.  Finding projections onto the intersection of convex sets in hilbert spaces , 1995 .

[41]  Benar Fux Svaiter,et al.  An Inexact Hybrid Generalized Proximal Point Algorithm and Some New Results on the Theory of Bregman Functions , 2000, Math. Oper. Res..

[42]  Masao Fukushima,et al.  A relaxed projection method for variational inequalities , 1986, Math. Program..

[43]  Heinz H. Bauschke The Approximation of Fixed Points of Compositions of Nonexpansive Mappings in Hilbert Space , 1996 .

[44]  Krzysztof C. Kiwiel,et al.  Free-Steering Relaxation Methods for Problems with Strictly Convex Costs and Linear Constraints , 1997, Math. Oper. Res..

[45]  Alvaro R. De Pierro,et al.  On the convergence of Han's method for convex programming with quadratic objective , 1991, Math. Program..

[46]  Heinz H. Bauschke,et al.  Dykstras algorithm with bregman projections: A convergence proof , 2000 .

[47]  Heinz H. Bauschke,et al.  Legendre functions and the method of random Bregman projections , 1997 .

[48]  Shih-Ping Han,et al.  A successive projection method , 1988, Math. Program..

[49]  Krzysztof C. Kiwiel,et al.  Surrogate Projection Methods for Finding Fixed Points of Firmly Nonexpansive Mappings , 1997, SIAM J. Optim..

[50]  F. T. Wright,et al.  Advances in Order Restricted Statistical Inference , 1986 .