Tracking-ADMM for Distributed Constraint-Coupled Optimization

We consider constraint-coupled optimization problems in which agents of a network aim to cooperatively minimize the sum of local objective functions subject to individual constraints and a common linear coupling constraint. We propose a novel optimization algorithm that embeds a dynamic average consensus protocol in the parallel Alternating Direction Method of Multipliers (ADMM) to design a fully distributed scheme for the considered set-up. The dynamic average mechanism allows agents to track the time-varying coupling constraint violation (at the current solution estimates). The tracked version of the constraint violation is then used to update local dual variables in a consensus-based scheme mimicking a parallel ADMM step. Under convexity, we prove that all limit points of the agents' primal solution estimates form an optimal solution of the constraint-coupled (primal) problem. The result is proved by means of a Lyapunov-based analysis simultaneously showing consensus of the dual estimates to a dual optimal solution, convergence of the tracking scheme and asymptotic optimality of primal iterates. A numerical study on optimal charging schedule of plug-in electric vehicles corroborates the theoretical results.

[1]  Gesualdo Scutari,et al.  NEXT: In-Network Nonconvex Optimization , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[2]  J. Suykens,et al.  An Interior-Point Lagrangian Decomposition Method for Separable Convex Optimization , 2013, 1302.3136.

[3]  Qing Ling,et al.  Decentralized dynamic optimization through the alternating direction method of multipliers , 2013, SPAWC.

[4]  Tsung-Hui Chang,et al.  A Proximal Dual Consensus ADMM Method for Multi-Agent Constrained Optimization , 2014, IEEE Transactions on Signal Processing.

[5]  Usman A. Khan,et al.  ADD-OPT: Accelerated Distributed Directed Optimization , 2016, IEEE Transactions on Automatic Control.

[6]  Qing Ling,et al.  EXTRA: An Exact First-Order Algorithm for Decentralized Consensus Optimization , 2014, 1404.6264.

[7]  José M. F. Moura,et al.  Fast Distributed Gradient Methods , 2011, IEEE Transactions on Automatic Control.

[8]  José M. F. Moura,et al.  Linear Convergence Rate of a Class of Distributed Augmented Lagrangian Algorithms , 2013, IEEE Transactions on Automatic Control.

[9]  Gang Chen,et al.  Distributed constrained optimization for multi-agent networks with nonsmooth objective functions , 2019, Syst. Control. Lett..

[10]  Giuseppe Notarstefano,et al.  Constraint-Coupled Distributed Optimization: A Relaxation and Duality Approach , 2017, IEEE Transactions on Control of Network Systems.

[11]  Damiano Varagnolo,et al.  Newton-Raphson Consensus for Distributed Convex Optimization , 2015, IEEE Transactions on Automatic Control.

[12]  Michael M. Zavlanos,et al.  A Consensus-Based Distributed Augmented Lagrangian Method , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[13]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[14]  Mariagrazia Dotoli,et al.  Distributed Alternating Direction Method of Multipliers for Linearly Constrained Optimization Over a Network , 2020, IEEE Control Systems Letters.

[15]  Sanyang Liu,et al.  Convergent prediction-correction-based ADMM for multi-block separable convex programming , 2018, J. Comput. Appl. Math..

[16]  Maria Prandini,et al.  Distributed Constrained Optimization and Consensus in Uncertain Networks via Proximal Minimization , 2016, IEEE Transactions on Automatic Control.

[17]  Richard Heusdens,et al.  On the Distributed Method of Multipliers for Separable Convex Optimization Problems , 2019, IEEE Transactions on Signal and Information Processing over Networks.

[18]  Ion Necoara,et al.  On linear convergence of a distributed dual gradient algorithm for linearly constrained separable convex problems , 2014, Autom..

[19]  Shu Liang,et al.  Distributed Smooth Convex Optimization With Coupled Constraints , 2020, IEEE Transactions on Automatic Control.

[20]  Solmaz S. Kia,et al.  Distributed optimal in-network resource allocation algorithm design via a control theoretic approach , 2017, Syst. Control. Lett..

[21]  Maria Prandini,et al.  Dual decomposition for multi-agent distributed optimization with coupling constraints , 2016, Autom..

[22]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[23]  Karl Henrik Johansson,et al.  Subgradient methods and consensus algorithms for solving convex optimization problems , 2008, 2008 47th IEEE Conference on Decision and Control.

[24]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[25]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[26]  Manfred Morari,et al.  A decomposition method for large scale MILPs, with performance guarantees and a power system application , 2014, Autom..

[27]  Lihua Xie,et al.  Convergence of Asynchronous Distributed Gradient Methods Over Stochastic Networks , 2018, IEEE Transactions on Automatic Control.

[28]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[29]  Sonia Martínez,et al.  Discrete-time dynamic average consensus , 2010, Autom..

[30]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[31]  Qing Ling,et al.  On the Linear Convergence of the ADMM in Decentralized Consensus Optimization , 2013, IEEE Transactions on Signal Processing.

[32]  Asuman E. Ozdaglar,et al.  Convergence Rate of Distributed ADMM Over Networks , 2016, IEEE Transactions on Automatic Control.

[33]  Ali H. Sayed,et al.  Dual Coupled Diffusion for Distributed Optimization with Affine Constraints , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[34]  Chong Jin Ong,et al.  Distributed Model Predictive Control of linear discrete-time systems with local and global constraints , 2017, Autom..

[36]  Anna Scaglione,et al.  Distributed Constrained Optimization by Consensus-Based Primal-Dual Perturbation Method , 2013, IEEE Transactions on Automatic Control.

[37]  Bingsheng He,et al.  On Full Jacobian Decomposition of the Augmented Lagrangian Method for Separable Convex Programming , 2015, SIAM J. Optim..

[38]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[39]  Jorge Cortés,et al.  Distributed Saddle-Point Subgradient Algorithms With Laplacian Averaging , 2015, IEEE Transactions on Automatic Control.

[40]  Na Li,et al.  Harnessing smoothness to accelerate distributed optimization , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[41]  Randy A. Freeman,et al.  Tutorial on Dynamic Average Consensus: The Problem, Its Applications, and the Algorithms , 2018, IEEE Control Systems.

[42]  Pascal Bianchi,et al.  Explicit Convergence Rate of a Distributed Alternating Direction Method of Multipliers , 2013, IEEE Transactions on Automatic Control.

[43]  Andrea Simonetto,et al.  Primal Recovery from Consensus-Based Dual Decomposition for Distributed Convex Optimization , 2015, J. Optim. Theory Appl..

[44]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[45]  Angelia Nedic,et al.  Distributed Optimization Over Time-Varying Directed Graphs , 2015, IEEE Trans. Autom. Control..