Cooperative convex optimization with subgradient delays using push-sum distributed dual averaging

Abstract In this paper, we address the distributed convex optimization problems for multi-agent systems. In our research, it is assumed that each agent in the multi-agent system could merely interact with its neighbors via a directed graph and is available to its own cost function. We then utilize the push-sum distributed dual averaging (PS-DDA) algorithm to tackle with the distributed optimization problem. However, we consider that there exist subgradient delays in PS-DDA algorithm. The proof of the main result which shows that the PS-DDA algorithm with subgradient delays converges and the error possesses sublinear growth of a rate O ( τ 2 T − 0.5 ) , where T denotes the total amount of iterations, is detailed presented in this paper. Finally, a numerical example is simulated to show the performance of the algorithm we study in this paper.

[1]  Yu-An Liu,et al.  Extended dissipative sliding mode control for nonlinear networked control systems via event-triggered mechanism with random uncertain measurement , 2021, Appl. Math. Comput..

[2]  J. A. Fill Eigenvalue bounds on convergence to stationarity for nonreversible markov chains , 1991 .

[3]  Alfred O. Hero,et al.  Accelerated Distributed Dual Averaging Over Evolving Networks of Growing Connectivity , 2017, IEEE Transactions on Signal Processing.

[4]  John C. Duchi,et al.  Distributed delayed stochastic optimization , 2011, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[5]  Shengyuan Xu,et al.  Gradient‐free method for distributed multi‐agent optimization via push‐sum algorithms , 2015 .

[6]  Yiguang Hong,et al.  Distributed Optimization for Resource Allocation Problems Under Large Delays , 2019, IEEE Transactions on Industrial Electronics.

[7]  Gang Chen,et al.  Distributed zero‐gradient‐sum algorithm for convex optimization with time‐varying communication delays and switching networks , 2018, International Journal of Robust and Nonlinear Control.

[8]  Shengyuan Xu,et al.  Distributed dual averaging method for multi-agent optimization with quantized communication , 2012, Syst. Control. Lett..

[9]  Angelia Nedic,et al.  Stochastic Gradient-Push for Strongly Convex Functions on Time-Varying Directed Graphs , 2014, IEEE Transactions on Automatic Control.

[10]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[11]  Zhao Yang Dong,et al.  Distributed mirror descent method for multi-agent optimization with delay , 2016, Neurocomputing.

[12]  Jan Dimon Bendtsen,et al.  Fault tolerant distributed portfolio optimization in smart grids , 2014 .

[13]  Zheng Wang,et al.  Stochastic gradient-push for economic dispatch on time-varying directed networks with delays , 2019 .

[14]  Jorge Cortés,et al.  Distributed Saddle-Point Subgradient Algorithms With Laplacian Averaging , 2015, IEEE Transactions on Automatic Control.

[15]  Zhisong Pan,et al.  Primal Averaging: A New Gradient Evaluation Step to Attain the Optimal Individual Convergence , 2020, IEEE Transactions on Cybernetics.

[16]  Tingwen Huang,et al.  Cooperative Distributed Optimization in Multiagent Networks With Delays , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[18]  Jing Wang,et al.  Asynchronous Event-Triggered Sliding Mode Control for Semi-Markov Jump Systems Within a Finite-Time Interval , 2021, IEEE Transactions on Circuits and Systems I: Regular Papers.

[19]  Feng Liu,et al.  Distributed gradient algorithm for constrained optimization with application to load sharing in power systems , 2015, Syst. Control. Lett..

[20]  Michael G. Rabbat,et al.  Distributed consensus and optimization under communication delays , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[21]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[22]  Fei Chen,et al.  Event-based secure H∞ load frequency control for delayed power systems subject to deception attacks , 2021, Appl. Math. Comput..

[23]  Jueyou Li,et al.  An adaptive online learning algorithm for distributed convex optimization with coupled constraints over unbalanced directed graphs , 2019, J. Frankl. Inst..

[24]  Shu Liang,et al.  Distributed continuous-time algorithm for nonsmooth optimal consensus without sharing local decision variables , 2020, J. Frankl. Inst..

[25]  Shengyuan Xu,et al.  Inexact dual averaging method for distributed multi-agent optimization , 2014, Syst. Control. Lett..

[26]  Yongduan Song,et al.  Distributed multi-agent optimization subject to nonidentical constraints and communication delays , 2016, Autom..

[27]  Qi Han,et al.  Distributed consensus-based multi-agent convex optimization via gradient tracking technique , 2019, J. Frankl. Inst..

[28]  Angelia Nedic,et al.  Distributed Optimization Over Time-Varying Directed Graphs , 2015, IEEE Trans. Autom. Control..

[29]  Shu Liang,et al.  Dual Averaging Push for Distributed Convex Optimization Over Time-Varying Directed Graph , 2020, IEEE Transactions on Automatic Control.

[30]  Hao Zhang,et al.  A distributed stochastic gradient algorithm for economic dispatch over directed network with communication delays , 2019, International Journal of Electrical Power & Energy Systems.

[31]  Michael G. Rabbat,et al.  Distributed dual averaging for convex optimization under communication delays , 2012, 2012 American Control Conference (ACC).

[32]  Pierre Coucheney,et al.  Distributed optimization in multi-user MIMO systems with imperfect and delayed information , 2014, 2014 IEEE International Symposium on Information Theory.

[33]  Michael G. Rabbat,et al.  Push-Sum Distributed Dual Averaging for convex optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[34]  Xianlin Zeng,et al.  Distributed proximal‐gradient algorithms for nonsmooth convex optimization of second‐order multiagent systems , 2020, International Journal of Robust and Nonlinear Control.

[35]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[36]  Zheng Wang,et al.  Primal-dual stochastic distributed algorithm for constrained convex optimization , 2019, J. Frankl. Inst..

[37]  Shengyuan Xu,et al.  Distributed Primal–Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[38]  Xinghuo Yu,et al.  Predefined-time optimization for distributed resource allocation , 2020, J. Frankl. Inst..