A family of projective splitting methods for the sum of two maximal monotone operators

A splitting method for two monotone operators A and B is an algorithm that attempts to converge to a zero of the sum A + B by solving a sequence of subproblems, each of which involves only the operator A, or only the operator B. Prior algorithms of this type can all in essence be categorized into three main classes, the Douglas/Peaceman-Rachford class, the forward-backward class, and the little-used double-backward class. Through a certain “extended” solution set in a product space, we construct a fundamentally new class of splitting methods for pairs of general maximal monotone operators in Hilbert space. Our algorithms are essentially standard projection methods, using splitting decomposition to construct separators. We prove convergence through Fejér monotonicity techniques, but showing Fejér convergence of a different sequence to a different set than in earlier splitting methods. Our projective algorithms converge under more general conditions than prior splitting methods, allowing the proximal parameter to vary from iteration to iteration, and even from operator to operator, while retaining convergence for essentially arbitrary pairs of operators. The new projective splitting class also contains noteworthy preexisting methods either as conventional special cases or excluded boundary cases.

[1]  R. Rockafellar On the maximality of sums of nonlinear monotone operators , 1970 .

[2]  P. Lions,et al.  Une methode iterative de resolution d’une inequation variationnelle , 1978 .

[3]  G. Minty Monotone (nonlinear) operators in Hilbert space , 1962 .

[4]  P. L. Combettes,et al.  Solving monotone inclusions via compositions of nonexpansive averaged operators , 2004 .

[5]  Michael C. Ferris,et al.  Operator-Splitting Methods for Monotone Affine Variational Inequalities, with a Parallel Application to Optimal Control , 1998, INFORMS J. Comput..

[6]  D. Gabay Applications of the method of multipliers to variational inequalities , 1983 .

[7]  S. Kaczmarz Approximate solution of systems of linear equations , 1993 .

[8]  M. Solodov,et al.  A Hybrid Approximate Extragradient – Proximal Point Algorithm Using the Enlargement of a Maximal Monotone Operator , 1999 .

[9]  F. Browder Nonlinear maximal monotone operators in Banach space , 1968 .

[10]  J. Lawrence,et al.  On Fixed Points of Non-Expansive Piecewise Isometric Mappings , 1987 .

[11]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[12]  Heinz H. Bauschke,et al.  On Projection Algorithms for Solving Convex Feasibility Problems , 1996, SIAM Rev..

[13]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[14]  Benar Fux Svaiter,et al.  Forcing strong convergence of proximal point iterations in a Hilbert space , 2000, Math. Program..

[15]  F. Browder Multi-valued monotone nonlinear mappings and duality mappings in Banach spaces , 1965 .

[16]  Gregory B. Passty Ergodic convergence to a zero of the sum of monotone operators in Hilbert space , 1979 .

[17]  Jonathan Eckstein Some Saddle-function splitting methods for convex programming , 1994 .

[18]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[19]  M. Solodov,et al.  A hybrid projection-proximal point algorithm. , 1998 .

[20]  Heinz H. Bauschke,et al.  The asymptotic behavior of the composition of two resolvents , 2005, Nonlinear Analysis: Theory, Methods & Applications.

[21]  J. Spingarn Partial inverse of a monotone operator , 1983 .