A class of multilevel parallel preconditioning strategies

In this paper, we introduce a class of recursive multilevel preconditioning strategies suited for solving large sparse linear systems of equations on modern day architectures. They are based on a reordering of the input matrix into a nested bordered block diagonal form, which allows a nested formulation of the preconditioners. The first one, which we refer to as nested SSOR (NSSOR), requires only the factorization of diagonal blocks at the innermost level of the recursive formulation. Hence, its construction is embarassingly parallel, and the memory requirements are very limited. Next two are nested versions of Modified ILU preconditioner with row sum (NMILUR) and colsum (NMILUC) property. We compare these methods in terms of iteration number, memory requirements, and overall solve time, with ILU(0) with natural ordering and nested dissection ordering, and MILU. We find that NSSOR compares favorably with ILU(0) with nested dissection ordering, while NMILUR and NMILUC outperform the other methods for certain matrices in our test set. It is proved that the NSSOR method is convergent when the input matrix is SPD. The preconditioners are designed to be suitable for parallel computing.

[1]  Yousef Saad,et al.  ARMS: an algebraic recursive multilevel solver for general sparse linear systems , 2002, Numer. Linear Algebra Appl..

[2]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[3]  Y. Saad,et al.  A PARALLEL MULTILEVEL ILU FACTORIZATION BASED ON A HIERARCHICAL GRAPH DECOMPOSITION , 2022 .

[4]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[5]  D. Bartuschat Algebraic Multigrid , 2007 .

[6]  M. Benzi,et al.  A comparative study of sparse approximate inverse preconditioners , 1999 .

[7]  Azzam Haidar,et al.  Parallel algebraic hybrid solvers for large 3D convection-diffusion problems , 2008, Numerical Algorithms.

[8]  Vipin Kumar,et al.  Highly Scalable Parallel Algorithms for Sparse Matrix Factorization , 1997, IEEE Trans. Parallel Distributed Syst..

[9]  K. St A review of algebraic multigrid , 2001 .

[10]  Michele Benzi,et al.  A Sparse Approximate Inverse Preconditioner for the Conjugate Gradient Method , 1996, SIAM J. Sci. Comput..

[11]  Andrea Toselli,et al.  Domain decomposition methods : algorithms and theory , 2005 .

[12]  J. W. Ruge,et al.  4. Algebraic Multigrid , 1987 .

[13]  Timothy A. Davis,et al.  The university of Florida sparse matrix collection , 2011, TOMS.

[14]  Barry F. Smith,et al.  Domain Decomposition: Parallel Multilevel Methods for Elliptic Partial Differential Equations , 1996 .

[15]  Laura Grigori,et al.  Combinative preconditioning based on Relaxed Nested Factorization and Tangential Filtering preconditioner , 2009 .