Multi-agent constrained optimization of a strongly convex function over time-varying directed networks

We consider cooperative multi-agent consensus optimization problems over undirected and directed time-varying communication networks, where only local communications are allowed. The objective is to minimize the sum of agent-specific possibly non-smooth composite convex functions over agent-specific private conic constraint sets; hence, the optimal consensus decision should lie in the intersection of these private sets. Assuming the sum function is strongly convex, we provide convergence rates in sub-optimality, infeasibility and consensus violation; examine the effect of underlying network topology on the convergence rates of the proposed decentralized algorithm.

[1]  Ali H. Sayed,et al.  Collaborative learning of mixture models using diffusion adaptation , 2011, 2011 IEEE International Workshop on Machine Learning for Signal Processing.

[2]  Asuman E. Ozdaglar,et al.  Convergence Rate of Distributed ADMM Over Networks , 2016, IEEE Transactions on Automatic Control.

[3]  Deming Yuan,et al.  Distributed Primal-Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms. , 2011, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society.

[4]  Angelia Nedic,et al.  Distributed optimization over time-varying directed graphs , 2013, 52nd IEEE Conference on Decision and Control.

[5]  Jorge Cortés,et al.  Distributed subgradient methods for saddle-point problems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[6]  Angelia Nedić,et al.  Distributed Optimization , 2015, Encyclopedia of Systems and Control.

[7]  Angelia Nedic,et al.  Distributed constrained optimization over noisy networks , 2010, 49th IEEE Conference on Decision and Control (CDC).

[8]  Shengyuan Xu,et al.  Distributed Primal–Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Anna Scaglione,et al.  Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method , 2013, IEEE Transactions on Automatic Control.

[10]  Gonzalo Mateos,et al.  Group-Lasso on Splines for Spectrum Cartography , 2010, IEEE Transactions on Signal Processing.

[11]  Johannes Gehrke,et al.  Gossip-based computation of aggregate information , 2003, 44th Annual IEEE Symposium on Foundations of Computer Science, 2003. Proceedings..

[12]  Tsung-Hui Chang,et al.  A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization , 2014, IEEE Transactions on Signal Processing.

[13]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[14]  A. Chambolle,et al.  A remark on accelerated block coordinate descent for computing the proximity operators of a sum of convex functions , 2015 .

[15]  Xiangfeng Wang,et al.  Multi-Agent Distributed Optimization via Inexact Consensus ADMM , 2014, IEEE Transactions on Signal Processing.

[16]  Wotao Yin,et al.  ExtraPush for Convex Smooth Decentralized Optimization over Directed Networks , 2015, ArXiv.

[17]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[18]  Angelia Nedic,et al.  Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs , 2014, IEEE Transactions on Automatic Control.

[19]  Hua Zhou,et al.  Algorithms for Fitting the Constrained Lasso , 2016, Journal of computational and graphical statistics : a joint publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America.

[20]  Angelia Nedic,et al.  Distributed Non-Autonomous Power Control through Distributed Convex Optimization , 2009, IEEE INFOCOM 2009.

[21]  Georgios B. Giannakis,et al.  Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity , 2010, IEEE Transactions on Signal Processing.

[22]  Qiong Wu,et al.  Fast distributed optimization over directed graphs , 2016, 2016 American Control Conference (ACC).

[23]  Gareth M. James,et al.  Penalized and Constrained Regression , 2013 .

[24]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[25]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[26]  Stergios I. Roumeliotis,et al.  Multirobot Active Target Tracking With Combinations of Relative Observations , 2011, IEEE Transactions on Robotics.

[27]  Torsten Hothorn,et al.  A unified framework of constrained regression , 2014, Stat. Comput..

[28]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[29]  Gesualdo Scutari,et al.  NEXT: In-Network Nonconvex Optimization , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[30]  Michael G. Rabbat,et al.  Consensus-based distributed optimization: Practical issues and applications in large-scale machine learning , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[31]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[32]  Antonin Chambolle,et al.  On the ergodic convergence rates of a first-order primal–dual algorithm , 2016, Math. Program..

[33]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[34]  Usman A. Khan,et al.  ADD-OPT: Accelerated Distributed Directed Optimization , 2016, IEEE Transactions on Automatic Control.

[35]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[36]  Gesualdo Scutari,et al.  Distributed nonconvex optimization for sparse representation , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[37]  Daniel Pérez Palomar,et al.  Distributed nonconvex multiagent optimization over time-varying networks , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[38]  Ohad Shamir,et al.  Optimal Distributed Online Prediction , 2011, ICML.

[39]  H. Vincent Poor,et al.  Distributed learning in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[40]  Convex Optimization in Signal Processing and Communications , 2010 .

[41]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[42]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[43]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[44]  Erfan Yazdandoost Hamedani,et al.  A primal-dual method for conic constrained distributed optimization problems , 2016, NIPS.

[45]  Erfan Yazdandoost Hamedani,et al.  Multi-agent constrained optimization of a strongly convex function , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).