A Distributed Algorithm Based on Multi-agent Network for Solving Linear Algebraic Equation

This paper presents a distributed discrete-time consensus algorithm based on multi-agent network to solve large-scale linear algebraic equation (LAE). The matrix in the LAE is divided into submatrices by the columns. Each agent in the network only has its own local data on the LAE and all the agents collaboratively find the solutions while they communicate with their neighbors. Based on the Lyapunov method for difference equation, the multi-agent network is analyzed to reach consensus at the solutions under some mild conditions. Compared with existing algorithms for LAE, the proposed algorithm is capable of solving large-scale distributed LAE problems with fixed step size.

[1]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[2]  Tingwen Huang,et al.  Cooperative Distributed Optimization in Multiagent Networks With Delays , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Shouyang Wang,et al.  Distributed continuous-time approximate projection protocols for shortest distance optimization problems , 2015, Autom..

[4]  Angelia Nedic,et al.  A new class of distributed optimization algorithms: application to regression of distributed data , 2012, Optim. Methods Softw..

[5]  Angelia Nedic,et al.  Distributed Stochastic Subgradient Projection Algorithms for Convex Optimization , 2008, J. Optim. Theory Appl..

[6]  Xinghu Wang,et al.  Distributed Optimization for a Class of Nonlinear Multiagent Systems With Disturbance Rejection , 2016, IEEE Transactions on Cybernetics.

[7]  Antonis Papachristodoulou,et al.  A Decomposition/Synchronization Scheme for Formulating and Solving Optimization Problems* *Supported financially by EPSRC. , 2009 .

[8]  Qingshan Liu,et al.  Distributed Optimization Based on a Multiagent System in the Presence of Communication Delays , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[9]  Lihua Xie,et al.  Distributed constrained optimal consensus of multi-agent systems , 2016, Autom..

[10]  Qingshan Liu,et al.  A Second-Order Multi-Agent Network for Bound-Constrained Distributed Optimization , 2015, IEEE Transactions on Automatic Control.

[11]  Choon Yik Tang,et al.  Zero-gradient-sum algorithms for distributed convex optimization: The continuous-time case , 2011, Proceedings of the 2011 American Control Conference.

[12]  Shaoshuai Mou,et al.  A distributed algorithm for solving a linear algebraic equation , 2015, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[13]  Russell Merris,et al.  The Laplacian Spectrum of a Graph II , 1994, SIAM J. Discret. Math..

[14]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[15]  Qingshan Liu,et al.  A Collective Neurodynamic Approach to Distributed Constrained Optimization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Shengyuan Xu,et al.  Distributed Primal–Dual Subgradient Method for Multiagent Optimization via Consensus Algorithms , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Giuseppe Notarstefano,et al.  A Polyhedral Approximation Framework for Convex and Robust Distributed Optimization , 2013, IEEE Transactions on Automatic Control.

[18]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[19]  Yongduan Song,et al.  Distributed multi-agent optimization subject to nonidentical constraints and communication delays , 2016, Autom..

[20]  Asuman E. Ozdaglar,et al.  Distributed multi-agent optimization with state-dependent communication , 2010, Math. Program..

[21]  Yiguang Hong,et al.  Constrained Consensus Algorithms With Fixed Step Size for Distributed Convex Optimization Over Multiagent Networks , 2017, IEEE Transactions on Automatic Control.

[22]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..