On the Range of the Douglas-Rachford Operator

The problem of finding a minimizer of the sum of two convex functions - or, more generally, that of finding a zero of the sum of two maximally monotone operators - is of central importance in variational analysis. Perhaps the most popular method of solving this problem is the Douglas-Rachford splitting method. Surprisingly, little is known about the range of the Douglas-Rachford operator. In this paper, we set out to study this range systematically. We prove that for 3* monotone operators a very pleasing formula can be found that reveals the range to be nearly equal to a simple set involving the domains and ranges of the underlying operators. A similar formula holds for the range of the corresponding displacement mapping. We discuss applications to subdifferential operators, to the infimal displacement vector, and to firmly nonexpansive mappings. Various examples and counter-examples are presented, including some concerning the celebrated Brezis-Haraux theorem.

[1]  A. Iusem,et al.  Set-valued mappings and enlargements of monotone operators , 2008 .

[2]  G. Minty.  Monotone (nonlinear) operators in Hilbert space , 1962 .

[3]  C. Zălinescu.  Convex analysis in general vector spaces , 2002 .

[4]  Jonathan Eckstein.  Splitting methods for monotone operators with applications to parallel optimization , 1989 .

[5]  S. Simons.  From Hahn-Banach to monotonicity , 2008 .

[6]  Heinz H. Bauschke,et al.  Firmly Nonexpansive Mappings and Maximally Monotone Operators: Correspondence and Duality , 2011, 1101.4688.

[7]  P. L. Combettes,et al.  Solving monotone inclusions via compositions of nonexpansive averaged operators , 2004 .

[8]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[9]  A. Pazy.  Asymptotic behavior of contractions in hilbert space , 1971 .

[10]  M. Teboulle,et al.  Asymptotic cones and functions in optimization and variational inequalities , 2002 .

[11]  H. Attouch.  A General Duality Principle for the Sum of Two Operators 1 , 1996 .

[12]  Xianfu Wang,et al.  Nearly convex sets: fine properties and domains or ranges of subdifferentials of convex functions , 2015, Math. Program..

[13]  Heinz H. Bauschke,et al.  Finding best approximation pairs relative to two closed convex sets in Hilbert spaces , 2004, J. Approx. Theory.

[14]  H. Brezis.  Opérateurs maximaux monotones et semi-groupes de contractions dans les espaces de Hilbert , 1973 .

[15]  E. Zeidler.  Nonlinear Functional Analysis and Its Applications: II/ A: Linear Monotone Operators , 1989 .

[16]  R. Rockafellar.  On the maximality of sums of nonlinear monotone operators , 1970 .

[17]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[18]  Heinz H. Bauschke,et al.  Attouch-Théra duality revisited: Paramonotonicity and operator splitting , 2011, J. Approx. Theory.

[19]  Heinz H. Bauschke,et al.  Rectangularity and paramonotonicity of maximally monotone operators , 2012, 1201.4220.

[20]  S. Simons.  Minimax and monotonicity , 1998 .

[21]  J.-C. Pesquet,et al.  A Douglas–Rachford Splitting Approach to Nonsmooth Convex Variational Signal Recovery , 2007, IEEE Journal of Selected Topics in Signal Processing.

[22]  E. H. Zarantonello.  Projections on Convex Sets in Hilbert Space and Spectral Theory: Part I. Projections on Convex Sets: Part II. Spectral Theory , 1971 .

[23]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[24]  Stephen M. Robinson,et al.  Composition duality and maximal monotonicity , 1999, Math. Program..

[25]  P. Lions,et al.  Splitting Algorithms for the Sum of Two Nonlinear Operators , 1979 .

[26]  Heinz H. Bauschke,et al.  Near equality, near convexity, sums of maximally monotone operators, and averages of firmly nonexpansive mappings , 2011, Math. Program..

[27]  Radu Ioan Bot,et al.  Duality for almost convex optimization problems via the perturbation approach , 2008, J. Glob. Optim..

[28]  Teemu Pennanen,et al.  Dualization of Generalized Equations of Maximal Monotone Type , 1999, SIAM J. Optim..

[29]  Heinz H. Bauschke,et al.  Generalized Solutions for the Sum of Two Maximally Monotone Operators , 2013, SIAM J. Control. Optim..

[30]  R. Rockafellar.  Convex Analysis: (pms-28) , 1970 .

[31]  丸山 徹.  Convex Analysisの二,三の進展について , 1977 .

[32]  H. Brezis,et al.  Image d’une somme d’operateurs monotones et applications , 1976 .

[33]  P. L. Combettes,et al.  A proximal decomposition method for solving convex variational inverse problems , 2008, 0807.2617.

[34]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[35]  P. L. Combettes.  Iterative construction of the resolvent of a sum of maximal monotone operators , 2009 .

[36]  Nonlinear functional analysis and its applications, part I: Fixed-point theorems , 1991 .

[37]  Michael C. Ferris,et al.  Smooth methods of multipliers for complementarity problems , 1999, Math. Program..

[38]  Sarah M. Moffat,et al.  The resolvent average : an expansive analysis of firmly nonexpansive mappings and maximally monotone operators , 2014 .