A Lagrange Multiplier Method for Distributed Optimization Based on Multi-Agent Network With Private and Shared Information

In this paper, a Lagrange multiplier method is investigated for designing distributed optimization algorithm, which convergence is analyzed from the view of multi-agent networks with connected graphs. In the network, each agent is with both private and shared information. The shared information is shared with the agent’s neighbors via a network with a connected graph. Furthermore, a Lagrange-multiplier-based algorithm with parallel computing architecture is designed for distributed optimization. Under mild conditions, the convergence of the algorithm, corresponding to the consensus of the Lagrange multipliers, is presented and proved. The experiments with simulations are presented to illustrate the performance of the proposed method.

[1]  R. Mudumbai,et al.  Distributed Control for Optimal Economic Dispatch of a Network of Heterogeneous Power Generators , 2012, IEEE Transactions on Power Systems.

[2]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[3]  Qingshan Liu,et al.  A Second-Order Multi-Agent Network for Bound-Constrained Distributed Optimization , 2015, IEEE Transactions on Automatic Control.

[4]  Qingshan Liu,et al.  A Multi-Agent System With a Proportional-Integral Protocol for Distributed Constrained Optimization , 2017, IEEE Transactions on Automatic Control.

[5]  D. Kinderlehrer,et al.  An introduction to variational inequalities and their applications , 1980 .

[6]  Dong Yue,et al.  Distributed Model Predictive Control for Hybrid Energy Resource System With Large-Scale Decomposition Coordination Approach , 2016, IEEE Access.

[7]  Yongqing Yang,et al.  Global exponential system of projection neural networks for system of generalized variational inequalities and related nonlinear minimax problems , 2010, Neurocomputing.

[8]  Fernando Paganini,et al.  Stability of primal-dual gradient dynamics and applications to network optimization , 2010, Autom..

[9]  Qingshan Liu,et al.  A Collective Neurodynamic Approach to Distributed Constrained Optimization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[10]  Nikos D. Hatziargyriou,et al.  Fully distributed economic dispatch of distributed generators in active distribution networks considering losses , 2017 .

[11]  Hanzhen Xiao,et al.  Leader-Follower Consensus Multi-Robot Formation Control Using Neurodynamic-Optimization-Based Nonlinear Model Predictive Control , 2019, IEEE Access.

[12]  Angelia Nedic,et al.  A new class of distributed optimization algorithms: application to regression of distributed data , 2012, Optim. Methods Softw..

[13]  Qingshan Liu,et al.  A Collaborative Neurodynamic Approach to Multiple-Objective Distributed Optimization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Xiaolin Hu,et al.  Design of Recurrent Neural Networks for Solving Constrained Least Absolute Deviation Problems , 2010, IEEE Transactions on Neural Networks.

[15]  Dae-Hyun Choi,et al.  Distributed Optimization Framework for Energy Management of Multiple Smart Homes With Distributed Energy Resources , 2017, IEEE Access.

[16]  Xiaolin Hu,et al.  An Improved Dual Neural Network for Solving a Class of Quadratic Programming Problems and Its $k$-Winners-Take-All Application , 2008, IEEE Transactions on Neural Networks.

[17]  Jinde Cao,et al.  Cooperative Optimization of Dual Multiagent System for Optimal Resource Allocation , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[18]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[19]  Tingwen Huang,et al.  One-Layer Continuous-and Discrete-Time Projection Neural Networks for Solving Variational Inequalities and Related Optimization Problems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[21]  Xinghuo Yu,et al.  Distributed Event-Triggered Scheme for Economic Dispatch in Smart Grids , 2016, IEEE Transactions on Industrial Informatics.

[22]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[23]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[24]  Xinghu Wang,et al.  Distributed Optimization for a Class of Nonlinear Multiagent Systems With Disturbance Rejection , 2016, IEEE Transactions on Cybernetics.

[25]  Yiguang Hong,et al.  Constrained Consensus Algorithms With Fixed Step Size for Distributed Convex Optimization Over Multiagent Networks , 2017, IEEE Transactions on Automatic Control.

[26]  Zheng Yan,et al.  A Neurodynamic Approach to Distributed Optimization With Globally Coupled Constraints , 2018, IEEE Transactions on Cybernetics.

[27]  Qingshan Liu,et al.  Cooperative–Competitive Multiagent Systems for Distributed Minimax Optimization Subject to Bounded Constraints , 2019, IEEE Transactions on Automatic Control.