Distributed primal-dual optimisation method with uncoordinated time-varying step-sizes

ABSTRACT This paper is concerned with the distributed optimisation problem over a multi-agent network, where the objective function is described by a sum of all the local objectives of agents. The target of agents is to collectively reach an optimal solution while minimising the global objective function. Under the assumption that the information exchange among agents is depicted by a sequence of time-varying undirected graphs, a distributed optimisation algorithm with uncoordinated time-varying step-sizes is presented, which signifies that the step-sizes of agents are not always uniform per iteration. In light of some reasonable assumptions, this paper fully conducts an explicit analysis for the convergence rate of the optimisation method. A striking feature is that the algorithm has a geometric convergence rate even if the step-sizes are time-varying and uncoordinated. Simulation results on two numerical experiments in power systems show effectiveness and performance of the proposed algorithm.

[1]  Tingwen Huang,et al.  Second-Order Global Consensus in Multiagent Networks With Random Directional Link Failure , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Gonzalo Mateos,et al.  Distributed Sparse Linear Regression , 2010, IEEE Transactions on Signal Processing.

[3]  Jiong Jin,et al.  Fixed-time consensus for multi-agent systems with discontinuous inherent dynamics over switching topology , 2017, Int. J. Syst. Sci..

[4]  Chengzhi Yuan,et al.  Consensus for multi-agent systems with time-varying input delays , 2017, Int. J. Syst. Sci..

[5]  Guanrong Chen,et al.  Synchronization of delayed chaotic systems with parameter mismatches by using intermittent linear state feedback , 2009 .

[6]  Fucheng Liao,et al.  Cooperative global optimal preview tracking control of linear multi-agent systems: an internal model approach , 2017, Int. J. Syst. Sci..

[7]  Tingwen Huang,et al.  Distributed parameter estimation in unreliable sensor networks via broadcast gossip algorithms , 2016, Neural Networks.

[8]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[9]  Ali H. Sayed,et al.  Diffusion Adaptation over Networks , 2012, ArXiv.

[10]  Yiguang Hong,et al.  On Convergence Rate of Distributed Stochastic Gradient Algorithm for Convex Optimization with Inequality Constraints , 2016, SIAM J. Control. Optim..

[11]  Marc P. Armstrong,et al.  Distributed LiDAR data processing in a high-memory cloud-computing environment , 2014, Ann. GIS.

[12]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[13]  Tingwen Huang,et al.  Event-Triggering Sampling Based Leader-Following Consensus in Second-Order Multi-Agent Systems , 2015, IEEE Transactions on Automatic Control.

[14]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[15]  Chuandong Li,et al.  Impulsive effects on stability of high-order BAM neural networks with time delays , 2011, Neurocomputing.

[16]  Na Li,et al.  Optimal demand response based on utility maximization in power networks , 2011, 2011 IEEE Power and Energy Society General Meeting.

[17]  Guang-Hong Yang,et al.  Cooperative tracking control for linear multi-agent systems with external disturbances under a directed graph , 2017, Int. J. Syst. Sci..

[18]  Qing Ling,et al.  On the Linear Convergence of the ADMM in Decentralized Consensus Optimization , 2013, IEEE Transactions on Signal Processing.

[19]  Shengyuan Xu,et al.  Regularized Primal–Dual Subgradient Method for Distributed Constrained Optimization , 2016, IEEE Transactions on Cybernetics.

[20]  David J. Hill,et al.  Event-triggered asynchronous intermittent communication strategy for synchronization in complex dynamical networks , 2015, Neural Networks.

[21]  Ufuk Topcu,et al.  Optimal decentralized protocol for electric vehicle charging , 2011, IEEE Transactions on Power Systems.

[22]  José M. F. Moura,et al.  Cooperative Convex Optimization in Networked Systems: Augmented Lagrangian Algorithms With Directed Gossip Communication , 2010, IEEE Transactions on Signal Processing.

[23]  Xiaofeng Liao,et al.  Reinforcement Learning for Constrained Energy Trading Games With Incomplete Information , 2017, IEEE Transactions on Cybernetics.

[24]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[25]  Asuman E. Ozdaglar,et al.  A fast distributed proximal-gradient method , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[26]  Shengyuan Xu,et al.  Zeroth-Order Method for Distributed Optimization With Approximate Projections , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[27]  Tingwen Huang,et al.  Attraction Region Seeking for Power Grids , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[28]  Wei Shi,et al.  Achieving Geometric Convergence for Distributed Optimization Over Time-Varying Graphs , 2016, SIAM J. Optim..

[29]  Chuandong Li,et al.  Robust Exponential Stability of Uncertain Delayed Neural Networks With Stochastic Perturbation and Impulse Effects , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[31]  Dimitri P. Bertsekas,et al.  Network optimization : continuous and discrete models , 1998 .

[32]  Zhiyong Yu,et al.  Leader-following consensus of fractional-order multi-agent systems via adaptive pinning control , 2015, Int. J. Control.

[33]  Dimitri P. Bertsekas,et al.  Distributed asynchronous computation of fixed points , 1983, Math. Program..

[34]  Zhigang Zeng,et al.  Multistability of Recurrent Neural Networks With Time-varying Delays and the Piecewise Linear Activation Function , 2010, IEEE Transactions on Neural Networks.

[35]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[36]  Asuman E. Ozdaglar,et al.  On the O(1=k) convergence of asynchronous distributed alternating Direction Method of Multipliers , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[37]  Angelia Nedic,et al.  Asynchronous Broadcast-Based Convex Optimization Over a Network , 2011, IEEE Transactions on Automatic Control.

[38]  José M. F. Moura,et al.  Fast Distributed Gradient Methods , 2011, IEEE Transactions on Automatic Control.

[39]  Thinh T. Doan,et al.  On the geometric convergence rate of distributed economic dispatch/demand response in power networks , 2016, 1609.06660.

[40]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..