A Fast Distributed Solver for Linear Systems Under Generalized Diagonal Dominance

This article proposes a new distributed algorithm for solving linear systems associated with a sparse graph under a generalized diagonal dominance assumption. The algorithm runs iteratively on each node of the graph, with low complexities on local information exchange between neighboring nodes, local computation, and local storage. For an acyclic graph under the condition of diagonal dominance, the algorithm is shown to converge to the correct solution in a finite number of iterations, equaling the graph diameter. For a loopy graph, the algorithm is shown to converge to the correct solution asymptotically. Simulations verify that the proposed algorithm significantly outperforms the classical Jacobi method and an orthogonal projection-based method.

[1]  Shaoshuai Mou,et al.  A distributed algorithm for solving a linear algebraic equation , 2015, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[3]  Minyue Fu,et al.  Distributed weighted least-squares estimation with fast convergence for large-scale systems , 2015, 52nd IEEE Conference on Decision and Control.

[4]  Minyue Fu,et al.  A Fast Converging Distributed Solver for Linear Systems with Generalised Diagonal Dominance , 2019, 1904.12313.

[5]  Shaoshuai Mou,et al.  Asynchronous Distributed Algorithms for Solving Linear Algebraic Equations , 2018, IEEE Transactions on Automatic Control.

[6]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems , 1988 .

[7]  Dmitry M. Malioutov,et al.  Walk-Sums and Belief Propagation in Gaussian Graphical Models , 2006, J. Mach. Learn. Res..

[8]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[9]  M. Tsatsomeros,et al.  An iterative criterion for H-Matrices , 1998 .

[10]  Nathan Ida,et al.  Introduction to the Finite Element Method , 1997 .

[11]  William T. Freeman,et al.  Correctness of Belief Propagation in Gaussian Graphical Models of Arbitrary Topology , 1999, Neural Computation.

[12]  Minyue Fu,et al.  Convergence Rate of a Message-passing Algorithm for Solving Linear Systems , 2020, ArXiv.

[13]  Xuan Wang,et al.  Improvement of a Distributed Algorithm for Solving Linear Equations , 2017, IEEE Transactions on Industrial Electronics.