Distributed Consensus Optimization in Multiagent Networks With Time-Varying Directed Topologies and Quantized Communication

This paper considers solving a class of optimization problems which are modeled as the sum of all agents’ convex cost functions and each agent is only accessible to its individual function. Communication between agents in multiagent networks is assumed to be limited: each agent can only interact information with its neighbors by using time-varying communication channels with limited capacities. A technique which overcomes the limitation is to implement a quantization process to the interacted information. The quantized information is first encoded as a binary sequence at the side of each agent before sending. After the binary sequence is received by the neighboring agent, corresponding decoding scheme is utilized to resume the original information with a certain degree of error which is caused by the quantization process. With the availability of each agent’s encoding states (associated with its out-channels) and decoding states (associated with its in-channels), we devise a set of distributed optimization algorithms that generate two iterative sequences, one of which converges to the optimal solution and the other of which reaches to the optimal value. We prove that if the parameters satisfy some mild conditions, the quantization errors are bounded and the consensus optimization can be achieved. How to minimize the number of quantization level of each connected communication channel in fixed networks is also explored thoroughly. It is found that, by properly choosing system parameters, one bit information exchange suffices to ensure consensus optimization. Finally, we present two numerical simulation experiments to illustrate the efficacy of the algorithms as well as to validate the theoretical findings.

[1]  Gang Feng,et al.  Output Consensus of Heterogeneous Linear Multi-Agent Systems by Distributed Event-Triggered/Self-Triggered Strategy , 2017, IEEE Transactions on Cybernetics.

[2]  Angelia Nedic,et al.  Nonasymptotic convergence rates for cooperative learning over time-varying directed graphs , 2014, 2015 American Control Conference (ACC).

[3]  Gonzalo Mateos,et al.  Distributed Sparse Linear Regression , 2010, IEEE Transactions on Signal Processing.

[4]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[5]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[6]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[7]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[8]  Deming Yuan,et al.  Distributed Primal-Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms. , 2011, IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Systems, Man, and Cybernetics Society.

[9]  Lei Ding,et al.  Network-Based Practical Consensus of Heterogeneous Nonlinear Multiagent Systems. , 2017, IEEE transactions on cybernetics.

[10]  Lihua Xie,et al.  Distributed Consensus With Limited Communication Data Rate , 2011, IEEE Transactions on Automatic Control.

[11]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[12]  Yiguang Hong,et al.  Quantized Subgradient Algorithm and Data-Rate Analysis for Distributed Optimization , 2014, IEEE Transactions on Control of Network Systems.

[13]  Volkan Cevher,et al.  Convex Optimization for Big Data: Scalable, randomized, and parallel algorithms for big data analytics , 2014, IEEE Signal Processing Magazine.

[14]  Qingshan Liu,et al.  Distributed Optimization Based on a Multiagent System in the Presence of Communication Delays , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[15]  Johan A. K. Suykens,et al.  Application of a Smoothing Technique to Decomposition in Convex Optimization , 2008, IEEE Transactions on Automatic Control.

[16]  Soummya Kar,et al.  DILAND: An Algorithm for Distributed Sensor Localization With Noisy Distance Measurements , 2009, IEEE Transactions on Signal Processing.

[17]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[18]  Angelia Nedic,et al.  Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs , 2014, IEEE Transactions on Automatic Control.

[19]  Gang Feng,et al.  Consensus of Linear Multi-Agent Systems by Distributed Event-Triggered Strategy , 2016, IEEE Transactions on Cybernetics.

[20]  Jinde Cao,et al.  $M$-Matrix Strategies for Pinning-Controlled Leader-Following Consensus in Multiagent Systems With Nonlinear Dynamics , 2013, IEEE Transactions on Cybernetics.

[21]  Angelia Nedic,et al.  DrSVM: Distributed random projection algorithms for SVMs , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[22]  Layuan Li,et al.  A distributed multiple dimensional QoS constrained resource scheduling optimization policy in computational grid , 2006, J. Comput. Syst. Sci..

[23]  Shengyuan Xu,et al.  Regularized Primal–Dual Subgradient Method for Distributed Constrained Optimization , 2016, IEEE Transactions on Cybernetics.

[24]  Xuelong Li,et al.  Robust Alternative Minimization for Matrix Completion , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Huijun Gao,et al.  On Group Synchronization for Interacting Clusters of Heterogeneous Systems , 2017, IEEE Transactions on Cybernetics.

[26]  Qiang Zhang,et al.  Quantized Data-Based Distributed Consensus under Directed Time-Varying Communication Topology , 2013, SIAM J. Control. Optim..

[27]  Georgios B. Giannakis,et al.  Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity , 2010, IEEE Transactions on Signal Processing.

[28]  Wei Ren,et al.  Consensus based formation control strategies for multi-vehicle systems , 2006, 2006 American Control Conference.

[29]  Giovanni Neglia,et al.  Distributed gradient optimization for epidemic routing: A preliminary evaluation , 2009, 2009 2nd IFIP Wireless Days (WD).

[30]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[31]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[32]  Angelia Nedić,et al.  Fast Convergence Rates for Distributed Non-Bayesian Learning , 2015, IEEE Transactions on Automatic Control.

[33]  Tingwen Huang,et al.  A One-Layer Recurrent Neural Network for Real-Time Portfolio Optimization With Probability Criterion , 2013, IEEE Transactions on Cybernetics.

[34]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[35]  Angelia Nedic,et al.  Distributed Asynchronous Constrained Stochastic Optimization , 2011, IEEE Journal of Selected Topics in Signal Processing.

[36]  Sonia Martínez,et al.  Discrete-time dynamic average consensus , 2010, Autom..

[37]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[38]  Jun Wang,et al.  A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).