Distributed asynchronous Cholesky decomposition

The Cholesky decomposition represents a fundamental building block in order to solve several matrix-related problems, ranging from matrix inversion to determinant calculation, and it finds application in several contexts, e.g., in Unscented Kalman Filters or other least-square estimation problems. In this paper we develop a distributed algorithm for performing the Cholesky decomposition of a sparse matrix. We model a network of n agents as a connected undirected graph, and we consider a symmetric positive definite n × n matrix M with the same structure as the graph (i.e., except for the diagonal entries, nonzero coefficients mij are allowed only if there is a link between the i-th and the j-th agent). We develop an asynchronous and distributed algorithm to let each agent i calculate the nonzero coefficients in the i-th column of the Cholesky decomposition of M. With respect to the state of the art, the proposed algorithm does not require orchestrators and finds application in sparse networks with limited bandwidth and memory requirements at each node.

[1]  Henrique Marra Menegaz,et al.  A Systematization of the Unscented Kalman Filter Theory , 2015, IEEE Transactions on Automatic Control.

[2]  Jing Wang,et al.  Solving Systems of Linear Equations by Distributed Convex Optimization in the Presence of Stochastic Uncertainty , 2014 .

[4]  Benoît Champagne,et al.  Mobile Localization in Non-Line-of-Sight Using Constrained Square-Root Unscented Kalman Filter , 2014, IEEE Transactions on Vehicular Technology.

[5]  Cleve Ashc Raft The fan-both family of column-based distributed Cholesky factorization algorithms , 1993 .

[6]  Aravindh Krishnamoorthy,et al.  Matrix inversion using Cholesky decomposition , 2011, 2013 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA).

[7]  Gene H. Golub,et al.  Matrix computations , 1983 .

[8]  Magdy A. Bayoumi,et al.  Energy-Aware Distributed QR Decomposition on Wireless Sensor Nodes , 2011, Comput. J..

[9]  Minyue Fu,et al.  Distributed weighted least-squares estimation with fast convergence for large-scale systems , 2015, 52nd IEEE Conference on Decision and Control.

[10]  Shay Kutten,et al.  Sublinear Bounds for Randomized Leader Election , 2013, ICDCN.

[11]  Cleve Ashcraft,et al.  A Fan-In Algorithm for Distributed Sparse Numerical Factorization , 1990, SIAM J. Sci. Comput..

[12]  George Bosilca,et al.  Power profiling of Cholesky and QR factorizations on distributed memory systems , 2012, Computer Science - Research and Development.

[13]  Keshav Pingali,et al.  Left-Looking to Right-Looking and Vice Versa: An Application of Fractal Symbolic Analysis to Linear Algebra Code Restructuring , 2000, Euro-Par.

[14]  Alexandre P. Francisco,et al.  Spanning edge betweenness , 2013 .

[15]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[16]  S. Särkkä,et al.  On Unscented Kalman Filtering for State Estimation of Continuous-Time Nonlinear Systems , 2007, IEEE Transactions on Automatic Control.