Distributed Optimization With Local Domains: Applications in MPC and Network Flows

We consider a network where each node has exclusive access to a local cost function. Our contribution is a communication-efficient distributed algorithm that finds a vector x* minimizing the sum of all the functions. We make the additional assumption that the functions have intersecting local domains, i.e., each function depends only on some components of the variable. Consequently, each node is interested in knowing only some components of x*, not the entire vector. This allows improving communication-efficiency. We apply our algorithm to distributed model predictive control (D-MPC) and to network flow problems and show, through experiments on large networks, that the proposed algorithm requires less communications to converge than prior state-of-the-art algorithms.

[1]  Georgios B. Giannakis,et al.  Consensus-Based Distributed Support Vector Machines , 2010, J. Mach. Learn. Res..

[2]  José Mario Martínez,et al.  Nonmonotone Spectral Projected Gradient Methods on Convex Sets , 1999, SIAM J. Optim..

[3]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[4]  Alex Zelikovsky,et al.  Improved Steiner tree approximation in graphs , 2000, SODA '00.

[5]  Albert,et al.  Emergence of scaling in random networks , 1999, Science.

[6]  Aric Hagberg,et al.  Exploring Network Structure, Dynamics, and Function using NetworkX , 2008 .

[7]  M. Projected Newton Methods and Optimization of Multicommodity Flows , 2022 .

[8]  Eduardo Camponogara,et al.  Distributed model predictive control , 2002 .

[9]  Georgios B. Giannakis,et al.  Distributed Robust Power System State Estimation , 2012, IEEE Transactions on Power Systems.

[10]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[11]  Joao F. C. Mota,et al.  Communication-Efficient Algorithms For Distributed Optimization , 2013, 1312.0263.

[12]  Eduardo Camponogara,et al.  Distributed Optimization for Model Predictive Control of Linear Dynamic Networks With Control-Input and Output Constraints , 2011, IEEE Transactions on Automation Science and Engineering.

[13]  Frank Kelly,et al.  Charging and rate control for elastic traffic , 1997, Eur. Trans. Telecommun..

[14]  David S. Johnson,et al.  The Rectilinear Steiner Problem is NP-Complete , 1977 .

[15]  HeBingsheng,et al.  The direct extension of ADMM for multi-block convex minimization problems is not necessarily convergent , 2016 .

[16]  Riccardo Scattolini,et al.  Architectures for distributed and hierarchical Model Predictive Control - A review , 2009 .

[17]  Alejandro Ribeiro,et al.  Accelerated dual descent for network optimization , 2011, Proceedings of the 2011 American Control Conference.

[18]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[19]  Ion Necoara,et al.  Parallel and distributed optimization methods for estimation and control in networks , 2011, 1302.3103.

[20]  Dorit S. Hochbaum,et al.  Approximation Algorithms for NP-Hard Problems , 1996 .

[21]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[22]  Bingsheng He,et al.  Linearized Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming , 2011 .

[23]  Xiaoming Yuan,et al.  A Note on the Alternating Direction Method of Multipliers , 2012, J. Optim. Theory Appl..

[24]  Alejandro Ribeiro,et al.  Accelerated Dual Descent for Network Flow Optimization , 2014, IEEE Transactions on Automatic Control.

[25]  Yurii Nesterov,et al.  Introductory Lectures on Convex Optimization - A Basic Course , 2014, Applied Optimization.

[26]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[27]  David P. Williamson The primal-dual method for approximation algorithms , 2002, Math. Program..

[28]  S. Low,et al.  Understanding Vegas: a duality model , 2002 .

[29]  Wotao Yin,et al.  On the Global and Linear Convergence of the Generalized Alternating Direction Method of Multipliers , 2016, J. Sci. Comput..

[30]  P Moroşan,et al.  Distributed model predictive control for building temperature regulation , 2010, Proceedings of the 2010 American Control Conference.

[31]  Georgios B. Giannakis,et al.  Distributed In-Network Channel Decoding , 2009, IEEE Transactions on Signal Processing.

[32]  Jay H. Lee,et al.  Model predictive control: past, present and future , 1999 .

[33]  José M. F. Moura,et al.  Fast Distributed Gradient Methods , 2011, IEEE Transactions on Automatic Control.

[34]  Zhi-Quan Luo,et al.  On the linear convergence of the alternating direction method of multipliers , 2012, Mathematical Programming.

[35]  João M. F. Xavier,et al.  Distributed Basis Pursuit , 2010, IEEE Transactions on Signal Processing.

[36]  David K. Smith Network Flows: Theory, Algorithms, and Applications , 1994 .

[37]  D. Bertsekas,et al.  Projected Newton methods and optimization of multicommodity flows , 1982, 1982 21st IEEE Conference on Decision and Control.

[38]  Parinya Chalermsook,et al.  Simple Distributed Algorithms for Approximating Minimum Steiner Trees , 2005, COCOON.

[39]  Manfred Morari,et al.  Computational aspects of distributed optimization in model predictive control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[40]  John Lygeros,et al.  Distributed model predictive consensus via the Alternating Direction Method of Multipliers , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[41]  David A. Wismer,et al.  Optimization methods for large-scale systems ... with applications , 1971 .

[42]  Palle Andersen,et al.  Distributed Model Predictive Control via Dual Decomposition , 2014 .

[43]  I. Jktroduction Distributed Asynchronous Optimal Routing in Data Networks , 2001 .

[44]  P. Aguiar,et al.  A Proof of Convergence For the Alternating Direction Method of Multipliers Applied to Polyhedral-Constrained Functions , 2011, 1112.2295.

[45]  Francesco Borrelli,et al.  Decentralized receding horizon control for large scale dynamically decoupled systems , 2009, Autom..

[46]  John N. Tsitsiklis,et al.  Distributed asynchronous optimal routing in data networks , 1986 .

[47]  Convex Optimization in Signal Processing and Communications , 2010 .

[48]  João M. F. Xavier,et al.  Distributed ADMM for model predictive control and congestion control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[49]  David P. Williamson,et al.  Primal-Dual Approximation Algorithms for Integral Flow and Multicut in Trees, with Applications to Matching and Set Cover , 1993, ICALP.