Solving Systems of Monotone Inclusions via Primal-dual Splitting Techniques

In this paper we propose an algorithm for solving systems of coupled monotone inclusions in Hilbert spaces. The operators arising in each of the inclusions of the system are processed in each iteration separately, namely, the single-valued are evaluated explicitly (forward steps), while the set-valued ones via their resolvents (backward steps). In addition, most of the steps in the iterative scheme can be executed simultaneously, this making the method applicable to a variety of convex minimization problems. The numerical performances of the proposed splitting algorithm are emphasized through applications in average consensus on colored networks and image classification via support vector machines.

[1]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[2]  Patrick L. Combettes,et al.  Systems of Structured Monotone Inclusions: Duality, Algorithms, and Applications , 2012, SIAM J. Optim..

[3]  Radu Ioan Bot,et al.  A Douglas-Rachford Type Primal-Dual Method for Solving Inclusions with Mixtures of Composite and Parallel-Sum Type Monotone Operators , 2012, SIAM J. Optim..

[4]  Radu Ioan Bot,et al.  Convergence Analysis for a Primal-Dual Monotone + Skew Splitting Algorithm with Applications to Total Variation Minimization , 2012, Journal of Mathematical Imaging and Vision.

[5]  Radu Ioan Bot,et al.  A Primal-Dual Splitting Algorithm for Finding Zeros of Sums of Maximal Monotone Operators , 2012, SIAM J. Optim..

[6]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[7]  Bang Công Vu,et al.  A splitting algorithm for dual monotone inclusions involving cocoercive operators , 2011, Advances in Computational Mathematics.

[8]  João M. F. Xavier,et al.  ADMM for consensus on colored networks , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[9]  R. Boţ,et al.  On the acceleration of the double smoothing technique for unconstrained convex optimization problems , 2012, 1205.0721.

[10]  W. Marsden.  I and J , 2012 .

[11]  P. L. Combettes,et al.  Primal-Dual Splitting Algorithm for Solving Inclusions with Mixtures of Composite, Lipschitzian, and Parallel-Sum Type Monotone Operators , 2011, Set-Valued and Variational Analysis.

[12]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[13]  Patrick L. Combettes,et al.  A Monotone+Skew Splitting Model for Composite Monotone Inclusions in Duality , 2010, SIAM J. Optim..

[14]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[15]  R. Boţ,et al.  Conjugate Duality in Convex Optimization , 2010 .

[16]  Patrick L. Combettes,et al.  A Parallel Splitting Method for Coupled Monotone Inclusions , 2009, SIAM J. Control. Optim..

[17]  Georgios B. Giannakis,et al.  Distributed In-Network Channel Decoding , 2009, IEEE Transactions on Signal Processing.

[18]  R. Boţ,et al.  Regularity conditions via generalized interiority notions in convex optimization: New achievements and their relation to some classical statements , 2009, 0906.0453.

[19]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[20]  P. L. Combettes,et al.  Iterative construction of the resolvent of a sum of maximal monotone operators , 2009 .

[21]  S. Simons.  From Hahn-Banach to monotonicity , 2008 .

[22]  Heinz H. Bauschke,et al.  The asymptotic behavior of the composition of two resolvents , 2005, Nonlinear Analysis: Theory, Methods & Applications.

[23]  P. L. Combettes,et al.  Solving monotone inclusions via compositions of nonexpansive averaged operators , 2004 .

[24]  C. Zălinescu.  Convex analysis in general vector spaces , 2002 .

[25]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[26]  Paul Tseng,et al.  A Modified Forward-backward Splitting Method for Maximal Monotone Mappings 1 , 1998 .

[27]  Thomas Strömberg.  The operation of infimal convolution , 1996 .

[28]  H. Attouch.  A General Duality Principle for the Sum of Two Operators 1 , 1996 .

[29]  C. Charalambous,et al.  Solving multifacility location problems involving euclidean distances , 1980 .

[30]  I. Ekeland,et al.  Convex analysis and variational problems , 1976 .

[31]  John A. White,et al.  On Solving Multifacility Location Problems using a Hyperboloid Approximation Procedure , 1973 .