A Distributed ADMM-like Method for Resource Sharing over Time-Varying Networks

We consider cooperative multi-agent resource sharing problems over time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific composite convex functions subject to a conic constraint that couples agents' decisions. We propose a distributed primal-dual algorithm DPDA-D to solve the saddle point formulation of the sharing problem on time-varying (un)directed communication networks; and we show that primal-dual iterate sequence converges to a point defined by a primal optimal solution and a consensual dual price for the coupling constraint. Furthermore, we provide convergence rates for suboptimality, infeasibility and consensus violation of agents' dual price assessments; examine the effect of underlying network topology on the convergence rates of the proposed decentralized algorithm; and compare DPDA-D with a centralized method on the basis pursuit denoising and multi-channel power allocation problems.

[1]  Antonin Chambolle,et al.  On the ergodic convergence rates of a first-order primal–dual algorithm , 2016, Math. Program..

[2]  Jorge Cortés,et al.  Distributed subgradient methods for saddle-point problems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[3]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[4]  Wotao Yin,et al.  Parallel Multi-Block ADMM with o(1 / k) Convergence , 2013, Journal of Scientific Computing.

[5]  Antonin Chambolle,et al.  A First-Order Primal-Dual Algorithm for Convex Problems with Applications to Imaging , 2011, Journal of Mathematical Imaging and Vision.

[6]  Tsung-Hui Chang,et al.  A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization , 2014, IEEE Transactions on Signal Processing.

[7]  Chuanye Gu,et al.  Distributed convex optimization with coupling constraints over time-varying directed graphs† , 2018, Journal of Industrial & Management Optimization.

[8]  Anna Scaglione,et al.  Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method , 2013, IEEE Transactions on Automatic Control.

[9]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[10]  Xiangfeng Wang,et al.  Multi-Agent Distributed Optimization via Inexact Consensus ADMM , 2014, IEEE Transactions on Signal Processing.

[11]  Dimitri P. Bertsekas,et al.  On the Douglas—Rachford splitting method and the proximal point algorithm for maximal monotone operators , 1992, Math. Program..

[12]  丸山 徹 Convex Analysisの二,三の進展について , 1977 .

[13]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[14]  Wei Shi,et al.  Improved Convergence Rates for Distributed Resource Allocation , 2017, 2018 IEEE Conference on Decision and Control (CDC).

[15]  Thinh T. Doan,et al.  Distributed Lagrangian methods for network resource allocation , 2016, 2017 IEEE Conference on Control Technology and Applications (CCTA).

[16]  N. S. Aybat,et al.  A distributed ADMM-like method for resource sharing under conic constraints over time-varying networks , 2016 .

[17]  Wei Shi,et al.  Collaborative Resource Allocation over a Hybrid Cloud Center and Edge Server Network , 2017 .

[18]  Jorge Cortés,et al.  Distributed coordination for separable convex optimization with coupling constraints , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[19]  Thinh T. Doan,et al.  Distributed resource allocation on dynamic networks in quadratic time , 2015, Syst. Control. Lett..

[20]  Yongduan Song,et al.  Distributed Economic Dispatch for Smart Grids With Random Wind Power , 2016, IEEE Transactions on Smart Grid.

[21]  W. Marsden I and J , 2012 .

[22]  Marc Teboulle,et al.  Rate of Convergence Analysis of Decomposition Methods Based on the Proximal Method of Multipliers for Convex Minimization , 2014, SIAM J. Optim..

[23]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[24]  Asuman E. Ozdaglar,et al.  On the O(1=k) convergence of asynchronous distributed alternating Direction Method of Multipliers , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[25]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[26]  Jorge Cortés,et al.  Distributed Saddle-Point Subgradient Algorithms With Laplacian Averaging , 2015, IEEE Transactions on Automatic Control.

[27]  Bingsheng He,et al.  Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective , 2012, SIAM J. Imaging Sci..

[28]  Yonina C. Eldar,et al.  Convex Optimization in Signal Processing and Communications , 2009 .

[29]  Angelia Nedic,et al.  Subgradient Methods for Saddle-Point Problems , 2009, J. Optimization Theory and Applications.

[30]  Angelia Nedic,et al.  Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs , 2014, IEEE Transactions on Automatic Control.

[31]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[32]  N. S. Aybat,et al.  Distributed Linearized Alternating Direction Method of Multipliers for Composite Convex Consensus Optimization , 2015, IEEE Transactions on Automatic Control.

[33]  Erfan Yazdandoost Hamedani,et al.  Distributed primal-dual method for multi-agent sharing problem with conic constraints , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[34]  Yu Zhang,et al.  Efficient Decentralized Economic Dispatch for Microgrids with Wind Power Integration , 2014, 2014 Sixth Annual IEEE Green Technologies Conference.

[35]  Erfan Yazdandoost Hamedani,et al.  A primal-dual method for conic constrained distributed optimization problems , 2016, NIPS.

[36]  Ziyang Meng,et al.  A Distributed Algorithm for Economic Dispatch Over Time-Varying Directed Networks With Delays , 2017, IEEE Transactions on Industrial Electronics.

[37]  B. V. Dean,et al.  Studies in Linear and Non-Linear Programming. , 1959 .

[38]  Shiqian Ma,et al.  An Extragradient-Based Alternating Direction Method for Convex Minimization , 2017, Found. Comput. Math..

[39]  J. Borwein,et al.  Convex Analysis And Nonlinear Optimization , 2000 .

[40]  Angelia Nedic,et al.  Distributed optimization over time-varying directed graphs , 2013, 52nd IEEE Conference on Decision and Control.

[41]  Niao He,et al.  Mirror Prox algorithm for multi-term composite minimization and semi-separable problems , 2013, Computational Optimization and Applications.

[42]  Minyue Fu,et al.  A Distributed Algorithm for Resource Allocation Over Dynamic Digraphs , 2017, IEEE Transactions on Signal Processing.

[43]  Necdet Serhat Aybat,et al.  A First-Order Augmented Lagrangian Method for Compressed Sensing , 2010, SIAM J. Optim..

[44]  Stephen P. Boyd,et al.  Fastest Mixing Markov Chain on a Graph , 2004, SIAM Rev..

[45]  Xiang Gao,et al.  On the Information-Adaptive Variants of the ADMM: An Iteration Complexity Perspective , 2017, Journal of Scientific Computing.

[46]  Yunmei Chen,et al.  Optimal Primal-Dual Methods for a Class of Saddle Point Problems , 2013, SIAM J. Optim..

[47]  Asuman E. Ozdaglar,et al.  A fast distributed proximal-gradient method , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[48]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[49]  Convex Optimization in Signal Processing and Communications , 2010 .