Online Distributed Constrained Optimization Over General Unbalanced Digraphs

This paper studies the distributed online constrained optimization problem over a multiagent network, where each agent exchanges local information with neighbors on an unbalanced digraph with row-stochastic matrix. For solving such problem, an distributed online projection gradient algorithm is presented and the dynamic regret is adopted to measure its performance. With proper assumptions, we establish a dynamic-regret bound for each agent, which grows sublinearly as long as the increasing rate of the minimizer sequence’ deviation lies in a certain range. Finally, a simulation example is provided to show the effectiveness of the proposed approach.

[1]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[2]  Daniel W. C. Ho,et al.  An Adaptive Primal-Dual Subgradient Algorithm for Online Distributed Constrained Optimization , 2018, IEEE Transactions on Cybernetics.

[3]  Gonzalo Mateos,et al.  Distributed Sparse Linear Regression , 2010, IEEE Transactions on Signal Processing.

[4]  Lihua Xie,et al.  A Dual Splitting Approach for Distributed Resource Allocation With Regularization , 2019, IEEE Transactions on Control of Network Systems.

[5]  Cheng Wu,et al.  Distributed Convex Optimization with Inequality Constraints over Time-Varying Unbalanced Digraphs , 2016, IEEE Transactions on Automatic Control.

[6]  Long Wang,et al.  Online Distributed Optimization With Strongly Pseudoconvex-Sum Cost Functions , 2020, IEEE Transactions on Automatic Control.

[7]  Qing Ling,et al.  Decentralized Dynamic Optimization Through the Alternating Direction Method of Multipliers , 2013, IEEE Transactions on Signal Processing.

[8]  Ying Xiong Nonlinear Optimization , 2014 .

[9]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[10]  Rebecca Willett,et al.  Online Convex Optimization in Dynamic Environments , 2015, IEEE Journal of Selected Topics in Signal Processing.

[11]  Jorge Cortés,et al.  Distributed Online Convex Optimization Over Jointly Connected Digraphs , 2014, IEEE Transactions on Network Science and Engineering.

[12]  Bahman Gharesifard,et al.  Distributed Online Convex Optimization on Time-Varying Directed Graphs , 2017, IEEE Transactions on Control of Network Systems.

[13]  Angelia Nedic,et al.  Stochastic Dual Averaging for Decentralized Online Optimization on Time-Varying Communication Graphs , 2017, IEEE Transactions on Automatic Control.

[14]  Bahman Gharesifard,et al.  Individual Regret Bounds for the Distributed Online Alternating Direction Method of Multipliers , 2019, IEEE Transactions on Automatic Control.

[15]  Shahin Shahrampour,et al.  Distributed Online Optimization in Dynamic Environments Using Mirror Descent , 2016, IEEE Transactions on Automatic Control.

[16]  Omar Besbes,et al.  Non-Stationary Stochastic Optimization , 2013, Oper. Res..

[17]  Van Sy Mai,et al.  Distributed optimization over weighted directed graphs using row stochastic matrix , 2016, 2016 American Control Conference (ACC).

[18]  Shahin Shahrampour,et al.  An online optimization approach for multi-agent tracking of dynamic parameters in the presence of adversarial noise , 2017, 2017 American Control Conference (ACC).

[19]  Shahin Shahrampour,et al.  Online Optimization : Competing with Dynamic Comparators , 2015, AISTATS.