Partition-based multi-agent optimization in the presence of lossy and asynchronous communication

Abstract We address the problem of multi-agent partition-based convex optimization which arises, for example, in robot localization problems and in regional state estimation in smart grids. More specifically, the global cost function is the sum of locally coupled cost functions that depend only on each agent variables and their neighbors’ variables. Inspired by a generalized gradient descent strategy, namely the Block Jacobi iteration, we propose an algorithm amenable to a scalable distributed implementation, i.e., each agent eventually computes only the optimal values for its own variables via local communication with its neighbors. In particular, we provide sufficient conditions for global and semi-global exponential stability for the proposed algorithms even in the presence of lossy communications and asynchronous updates. The theoretical analysis relies on novel tools on Lyapunov theory based on separation of time scales and averaging theory for discrete-time systems. Finally, the proposed algorithm is numerically tested on the IEEE 123 nodes distribution feeder in the context of multi-area robust state estimation of smart grids in the presence of measurement outliers.

[1]  Ruggero Carli,et al.  An Asynchronous Consensus-Based Algorithm for Estimation From Noisy Relative Measurements , 2014, IEEE Transactions on Control of Network Systems.

[2]  Pascal Bianchi,et al.  Asynchronous distributed optimization using a randomized alternating direction method of multipliers , 2013, 52nd IEEE Conference on Decision and Control.

[3]  Georgios B. Giannakis,et al.  Distributed Robust Power System State Estimation , 2012, IEEE Transactions on Power Systems.

[4]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[5]  João M. F. Xavier,et al.  Distributed Optimization With Local Domains: Applications in MPC and Network Flows , 2013, IEEE Transactions on Automatic Control.

[6]  Ruggero Carli,et al.  Robust Distributed Estimation for Localization in Lossy Sensor Networks , 2016 .

[7]  Jing Huang,et al.  State Estimation in Electric Power Grids: Meeting New Challenges Presented by the Requirements of the Future Grid , 2012, IEEE Signal Processing Magazine.

[8]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[9]  S.-Y. Bin,et al.  An implementable distributed state estimator and distributed bad data processing schemes for electric power systems , 1994 .

[10]  Michael G. Rabbat,et al.  Push-Sum Distributed Dual Averaging for convex optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[11]  Reinaldo Sanchez,et al.  An ℓ1-algorithm for underdetermined systems and applications , 2011, 2011 Annual Meeting of the North American Fuzzy Information Processing Society.

[12]  Xiangfeng Wang,et al.  Asynchronous Distributed ADMM for Large-Scale Optimization—Part I: Algorithm and Convergence Analysis , 2015, IEEE Transactions on Signal Processing.

[13]  Daniel Pérez Palomar,et al.  A tutorial on decomposition methods for network utility maximization , 2006, IEEE Journal on Selected Areas in Communications.

[14]  João M. F. Xavier,et al.  D-ADMM: A Communication-Efficient Distributed Algorithm for Separable Optimization , 2012, IEEE Transactions on Signal Processing.

[15]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[16]  Alejandro Ribeiro,et al.  Accelerated Dual Descent for Network Flow Optimization , 2014, IEEE Transactions on Automatic Control.

[17]  Tomaso Erseghe,et al.  A Distributed and Scalable Processing Method Based Upon ADMM , 2012, IEEE Signal Processing Letters.

[18]  Ruggero Carli,et al.  Distributed Partitioned Big-Data Optimization via Asynchronous Dual Decomposition , 2018, IEEE Transactions on Control of Network Systems.

[19]  Damiano Varagnolo,et al.  Newton-Raphson Consensus for Distributed Convex Optimization , 2015, IEEE Transactions on Automatic Control.

[20]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[21]  Fabio Fagnani,et al.  Distributed Estimation From Relative and Absolute Measurements , 2017, IEEE Transactions on Automatic Control.

[22]  Asuman E. Ozdaglar,et al.  On the O(1=k) convergence of asynchronous distributed alternating Direction Method of Multipliers , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[23]  Na Li,et al.  Harnessing Smoothness to Accelerate Distributed Optimization , 2016, IEEE Transactions on Control of Network Systems.

[24]  Damiano Varagnolo,et al.  Consensus‐based distributed sensor calibration and least‐square parameter identification in WSNs , 2010 .

[25]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[26]  Ming Yan,et al.  ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updates , 2015, SIAM J. Sci. Comput..

[27]  Minyue Fu,et al.  Distributed weighted least-squares estimation with fast convergence for large-scale systems , 2015, 52nd IEEE Conference on Decision and Control.

[28]  Ruggero Carli,et al.  A Robust Block-Jacobi Algorithm for Quadratic Programming under Lossy Communications , 2015 .

[29]  J. Hespanha,et al.  Estimation on graphs from relative measurements , 2007, IEEE Control Systems.

[30]  Ion Necoara,et al.  Parallel and distributed optimization methods for estimation and control in networks , 2011, 1302.3103.

[31]  Gesualdo Scutari,et al.  NEXT: In-Network Nonconvex Optimization , 2016, IEEE Transactions on Signal and Information Processing over Networks.

[32]  Jing Wang,et al.  Control approach to distributed optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[33]  Richard G. Baraniuk,et al.  Fast Alternating Direction Optimization Methods , 2014, SIAM J. Imaging Sci..

[34]  Bart De Schutter,et al.  Accelerated gradient methods and dual decomposition in distributed model predictive control , 2013, Autom..

[35]  Pascal Bianchi,et al.  A Coordinate Descent Primal-Dual Algorithm and Application to Distributed Asynchronous Optimization , 2014, IEEE Transactions on Automatic Control.

[36]  Ruggero Carli,et al.  State estimation in power distribution networks with poorly synchronized measurements , 2014, 53rd IEEE Conference on Decision and Control.

[37]  Aryan Mokhtari,et al.  Network Newton Distributed Optimization Methods , 2017, IEEE Transactions on Signal Processing.

[38]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[39]  Pascal Bianchi,et al.  A stochastic coordinate descent primal-dual algorithm and applications , 2014, 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[40]  A.J. Conejo,et al.  An Optimization Approach to Multiarea State Estimation , 2007, IEEE Transactions on Power Systems.