A Dual Splitting Approach for Distributed Resource Allocation With Regularization

We deal with a class of distributed resource allocation problems where each agent attempts to minimize its own cost while respecting network-wide resource constraints as well as local capacity limits. This problem arises from many areas, such as economic dispatch, network utility maximization, and demand response. Most existing methods are centralized while few works are devoted to solving the problem in a distributed manner. The problem becomes even more challenging when there is a (nonsmooth) regularization term in the cost function. In this paper, we propose a novel distributed algorithm (termed DuSPA) to solve the above problem based on duality analysis and splitting methods. For privacy concerns, this algorithm is not required to communicate sensitive gradient information while still achieving the optimum without sacrificing the performance. We will show that the proposed algorithm converges at a nonergodic convergence rate of $O(\frac{1}{k})$ for general convex cost functions and a linear convergence rate for smooth and strongly convex cost functions, respectively. Furthermore, we apply the proposed algorithm to an economic dispatch problem to show its effectiveness.

[1]  Ashish Cherukuri,et al.  Distributed Generator Coordination for Initialization and Anytime Optimization in Economic Dispatch , 2015, IEEE Transactions on Control of Network Systems.

[2]  Marc Teboulle,et al.  An $O(1/k)$ Gradient Method for Network Resource Allocation Problems , 2014, IEEE Transactions on Control of Network Systems.

[3]  Daniela Pucci de Farias,et al.  Decentralized Resource Allocation in Dynamic Networks of Agents , 2008, SIAM J. Optim..

[4]  Henrik Sandberg,et al.  A Survey of Distributed Optimization and Control Algorithms for Electric Power Systems , 2017, IEEE Transactions on Smart Grid.

[5]  Mo-Yuen Chow,et al.  Convergence Analysis of the Incremental Cost Consensus Algorithm Under Different Communication Network Topologies in a Smart Grid , 2012, IEEE Transactions on Power Systems.

[6]  Stephen P. Boyd,et al.  Optimal Scaling of a Gradient Method for Distributed Resource Allocation , 2006 .

[7]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[8]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[9]  Shengwei Mei,et al.  Distributed Frequency Control With Operational Constraints, Part I: Per-Node Power Balance , 2017, IEEE Transactions on Smart Grid.

[10]  Lihua Xie,et al.  Augmented distributed gradient methods for multi-agent optimization under uncoordinated constant stepsizes , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[11]  Thinh T. Doan,et al.  On the geometric convergence rate of distributed economic dispatch/demand response in power networks , 2016, 1609.06660.

[12]  Laurent Condat,et al.  A Primal–Dual Splitting Method for Convex Optimization Involving Lipschitzian, Proximable and Linear Composite Terms , 2012, Journal of Optimization Theory and Applications.

[13]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[14]  Feng Liu,et al.  Distributed Frequency Control with Operational Constraints, Part II: Network Power Balance , 2017, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[15]  Jian-Xin Xu,et al.  Consensus Based Approach for Economic Dispatch Problem in a Smart Grid , 2013, IEEE Transactions on Power Systems.

[16]  Lihua Xie,et al.  A Bregman Splitting Scheme for Distributed Optimization Over Networks , 2018, IEEE Transactions on Automatic Control.

[17]  Feng Liu,et al.  Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems , 2015, Autom..

[18]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[19]  G. Hug,et al.  Distributed robust economic dispatch in power systems: A consensus + innovations approach , 2012, 2012 IEEE Power and Energy Society General Meeting.

[20]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[21]  Stephen P. Boyd,et al.  Simultaneous routing and resource allocation via dual decomposition , 2004, IEEE Transactions on Communications.

[22]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[23]  Na Li,et al.  Harnessing smoothness to accelerate distributed optimization , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[24]  Lihua Xie,et al.  A dual splitting algorithm for distributed resource allocation problems , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[25]  Tingwen Huang,et al.  Second-Order Continuous-Time Algorithms for Economic Power Dispatch in Smart Grids , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[26]  Xiaoyu Wang,et al.  Distributed Energy Management in Smart Grid With Wind Power and Temporally Coupled Constraints , 2017, IEEE Transactions on Industrial Electronics.

[27]  Lihua Xie,et al.  A forward-backward Bregman splitting scheme for regularized distributed optimization problems , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[28]  R. Rockafellar Monotone Operators and the Proximal Point Algorithm , 1976 .

[29]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[30]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[31]  Lihua Xie,et al.  Continuous-Time Distributed Algorithms for Extended Monotropic Optimization Problems , 2016, 1608.01167.

[32]  Bingsheng He,et al.  Convergence Analysis of Primal-Dual Algorithms for a Saddle-Point Problem: From Contraction Perspective , 2012, SIAM J. Imaging Sci..

[33]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[34]  Wei Zhang,et al.  Fully Distributed Social Welfare Optimization With Line Flow Constraint Consideration , 2015, IEEE Transactions on Industrial Informatics.

[35]  Ashish Cherukuri,et al.  Initialization-free distributed coordination for economic dispatch under varying loads and generator commitment , 2014, Autom..