A distributed Newton–Raphson-based coordination algorithm for multi-agent optimization with discrete-time communication

This paper proposes a novel distributed continuous-time Newton–Raphson algorithm for distributed convex optimization problem, where the components of the goal are obtainable at different agents. To accelerate convergence speed, we focus on introducing Newton descent idea in our algorithm and extending it in a distributed setting. It is proved that the proposed algorithm can converge to the global optimal point with exponential convergence rate under weight-balanced directed graphs. Motivated by practical considerations, an event-triggered broadcasting strategy is further developed for each agent. Therein, the implementation of communication is driven by the designed triggered condition monitored by agents. Consequently, the proposed continuous-time algorithm can be executed with discrete-time communication, thus being able to greatly save communication expenditure. Moreover, the strategy is proved to be free of Zeno behavior. Eventually, the simulation results illustrate the advantages of the proposed algorithm.

[1]  Shuai Liu,et al.  Event-Triggered Communication and Data Rate Constraint for Distributed Optimization of Multiagent Systems , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Choon Yik Tang,et al.  Zero-gradient-sum algorithms for distributed convex optimization: The continuous-time case , 2011, Proceedings of the 2011 American Control Conference.

[3]  Li Xiao,et al.  Event-triggered sampling scheme for pinning control in multi-agent networks with general nonlinear dynamics , 2016, Neural Computing and Applications.

[4]  Wenxin Liu,et al.  Distributed Dynamic Programming-Based Approach for Economic Dispatch in Smart Grids , 2015, IEEE Transactions on Industrial Informatics.

[5]  Li Xiao,et al.  Consensus in networked dynamical systems with event-triggered control inputs and random switching topologies , 2017, Neural Computing and Applications.

[6]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[7]  Jay A. Farrell,et al.  Distributed Continuous-Time Optimization: Nonuniform Gradient Gains, Finite-Time Convergence, and Convex Constraint Set , 2017, IEEE Transactions on Automatic Control.

[8]  Damiano Varagnolo,et al.  Newton-Raphson Consensus for Distributed Convex Optimization , 2015, IEEE Transactions on Automatic Control.

[9]  Martin J. Wainwright,et al.  Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling , 2010, IEEE Transactions on Automatic Control.

[10]  Sonia Martínez,et al.  Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication , 2014, Autom..

[11]  Haibo He,et al.  GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Lihua Xie,et al.  Distributed constrained optimal consensus of multi-agent systems , 2016, Autom..

[13]  Daniel W. C. Ho,et al.  Randomized Gradient-Free Method for Multiagent Optimization Over Time-Varying Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Changyun Wen,et al.  Event-Based Consensus for Linear Multiagent Systems Without Continuous Communication. , 2017, IEEE transactions on cybernetics.

[15]  Huaguang Zhang,et al.  Event-Triggered-Based Distributed Cooperative Energy Management for Multienergy Systems , 2019, IEEE Transactions on Industrial Informatics.

[16]  Derong Liu,et al.  Value Iteration Adaptive Dynamic Programming for Optimal Control of Discrete-Time Nonlinear Systems , 2016, IEEE Transactions on Cybernetics.

[17]  Ding Wang,et al.  Connectivity preserved nonlinear time-delayed multiagent systems using neural networks and event-based mechanism , 2016, Neural Computing and Applications.

[18]  Juan C. Vasquez,et al.  Distributed Nonlinear Control With Event-Triggered Communication to Achieve Current-Sharing and Voltage Regulation in DC Microgrids , 2018, IEEE Transactions on Power Electronics.

[19]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[20]  Xinghu Wang,et al.  Distributed Optimization for a Class of Nonlinear Multiagent Systems With Disturbance Rejection , 2016, IEEE Transactions on Cybernetics.

[21]  Juan C. Vasquez,et al.  Aalborg Universitet Containment and Consensus-Based Distributed Coordination Control to Achieve Bounded Voltage and Precise Reactive Power Sharing in Islanded AC Microgrids , 2017 .

[22]  Lihua Xie,et al.  Distributed Parameter Estimation With Quantized Communication via Running Average , 2014, IEEE Transactions on Signal Processing.

[23]  Tingwen Huang,et al.  Event-Triggered Distributed Average Consensus Over Directed Digital Networks With Limited Communication Bandwidth , 2016, IEEE Transactions on Cybernetics.

[24]  Jianguo Zhou,et al.  Distributed Optimal Energy Management for Energy Internet , 2017, IEEE Transactions on Industrial Informatics.

[25]  Aryan Mokhtari,et al.  Network Newton Distributed Optimization Methods , 2017, IEEE Transactions on Signal Processing.

[26]  Daniel E. Quevedo,et al.  Event-Triggered Quantized Communication-Based Distributed Convex Optimization , 2018, IEEE Transactions on Control of Network Systems.

[27]  Wei Ren,et al.  Event-triggered zero-gradient-sum distributed consensus optimization over directed networks , 2016, Autom..

[28]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[29]  Wenxin Liu,et al.  Distributed Online Optimal Energy Management for Smart Grids , 2015, IEEE Transactions on Industrial Informatics.

[30]  Hans-Arno Jacobsen,et al.  Distributed Convex Optimization for Electric Vehicle Aggregators , 2017, IEEE Transactions on Smart Grid.

[31]  Alejandro Ribeiro,et al.  Accelerated Dual Descent for Network Flow Optimization , 2014, IEEE Transactions on Automatic Control.