Distributed Primal-Dual Perturbation Algorithm Over Unbalanced Directed Networks

This paper investigates a primal-dual method for a convex optimization problem that has coupled inequality constraints. A group of agents searches for an optimal solution over unbalanced directed communication networks by a consensus-based perturbation algorithm. Each agent computes perturbation points for the estimation of a saddle point of a Lagrange function. The primal and dual variables are updated based on a gradient-based algorithm. In addition, each agent estimates a normalized left eigenvector of a weight matrix for the communication graph in order to compensate for unbalanced directed communication flows. The convergence properties of the proposed primal-dual perturbation algorithm are shown based on the row stochasticity of the weight matrix. The application of the proposed method is also considered for a distributed economic dispatch problem.

[1]  Graziano Chesi,et al.  Input-Feedforward-Passivity-Based Distributed Optimization Over Jointly Connected Balanced Digraphs , 2019, IEEE Transactions on Automatic Control.

[2]  Feng Liu,et al.  Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems , 2015, Autom..

[3]  Tao Xiang,et al.  Privacy Masking Stochastic Subgradient-Push Algorithm for Distributed Online Optimization , 2020, IEEE Transactions on Cybernetics.

[4]  Michael G. Rabbat,et al.  Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization , 2017, Proceedings of the IEEE.

[5]  Na Li,et al.  Harnessing smoothness to accelerate distributed optimization , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[6]  Gang Feng,et al.  Distributed Proximal Algorithms for Multiagent Optimization With Coupled Inequality Constraints , 2019, IEEE Transactions on Automatic Control.

[7]  Van Sy Mai,et al.  Distributed Optimization over Directed Graphs with Row Stochasticity and Constraint Regularity , 2018, Autom..

[8]  Usman A. Khan,et al.  Distributed Subgradient Projection Algorithm Over Directed Graphs , 2016, IEEE Transactions on Automatic Control.

[9]  Qiuye Sun,et al.  Distributed Optimal Economic Dispatch for Microgrids Considering Communication Delays , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Shengyuan Xu,et al.  Distributed Primal–Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Huaguang Zhang,et al.  Event-Triggered-Based Distributed Cooperative Energy Management for Multienergy Systems , 2019, IEEE Transactions on Industrial Informatics.

[12]  Zhao Yang Dong,et al.  Distributed Constrained Optimization Over Unbalanced Directed Networks Using Asynchronous Broadcast-Based Algorithm , 2021, IEEE Transactions on Automatic Control.

[13]  Jianguo Zhou,et al.  Double-Mode Energy Management for Multi-Energy System via Distributed Dynamic Event-Triggered Newton-Raphson Algorithm , 2020, IEEE Transactions on Smart Grid.

[14]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[15]  Stephen P. Boyd,et al.  CVXPY: A Python-Embedded Modeling Language for Convex Optimization , 2016, J. Mach. Learn. Res..

[16]  Angelia Nedic,et al.  Distributed optimization over time-varying directed graphs , 2013, 52nd IEEE Conference on Decision and Control.

[17]  Joao Xavier,et al.  Primal–Dual Methods for Large-Scale and Distributed Convex Optimization and Data Analytics , 2019, Proceedings of the IEEE.

[18]  Wei Gu,et al.  A Multi-Time-Scale Economic Scheduling Strategy for Virtual Power Plant Based on Deferrable Loads Aggregation and Disaggregation , 2020, IEEE Transactions on Sustainable Energy.

[19]  Anna Scaglione,et al.  Distributed sparse regression by consensus-based primal-dual perturbation optimization , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[20]  Qing Yang,et al.  Primal-Dual Subgradient Algorithm for Distributed Constraint Optimization Over Unbalanced Digraphs , 2019, IEEE Access.

[21]  Jorge Cortés,et al.  Distributed Saddle-Point Subgradient Algorithms With Laplacian Averaging , 2015, IEEE Transactions on Automatic Control.

[22]  Michael Patriksson,et al.  Ergodic, primal convergence in dual subgradient schemes for convex programming , 1999, Mathematical programming.

[23]  Anna Scaglione,et al.  Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method , 2013, IEEE Transactions on Automatic Control.

[24]  Xiaofeng Liao,et al.  A Nesterov-Like Gradient Tracking Algorithm for Distributed Optimization Over Directed Networks , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[26]  Yongduan Song,et al.  Distributed multi-agent optimization subject to nonidentical constraints and communication delays , 2016, Autom..

[27]  Asuman E. Ozdaglar,et al.  Approximate Primal Solutions and Rate Analysis for Dual Subgradient Methods , 2008, SIAM J. Optim..

[28]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[29]  Wei Shi,et al.  Push–Pull Gradient Methods for Distributed Optimization in Networks , 2021, IEEE Transactions on Automatic Control.

[30]  David Wenzhong Gao,et al.  A Distributed Double-Newton Descent Algorithm for Cooperative Energy Management of Multiple Energy Bodies in Energy Internet , 2020, IEEE Transactions on Industrial Informatics.

[31]  Markku Kallio,et al.  Large-Scale Convex Optimization Via Saddle Point Computation , 1999, Oper. Res..