Robust and effective eSIF preconditioning for general SPD matrices

We propose an unconditionally robust and highly effective preconditioner for general symmetric positive definite (SPD) matrices based on structured incomplete factorization (SIF), called enhanced SIF (eSIF) preconditioner. The original SIF strategy proposed recently derives a structured preconditioner by applying block diagonal preprocessing to the matrix and then compressing appropriate scaled off-diagonal blocks. Here, we use an enhanced scaling-and-compression strategy to design the new eSIF preconditioner. Some subtle modifications are made, such as the use of two-sided block triangular preprocessing. A practical multilevel eSIF scheme is then designed. We give rigorous analysis for both the enhanced scaling-and-compression strategy and the multilevel eSIF preconditioner. The new eSIF framework has some significant advantages and overcomes some major limitations of the SIF strategy. (i) With the same tolerance for compressing the off-diagonal blocks, the eSIF preconditioner can approximate the original matrix to a much higher accuracy. (ii) The new preconditioner leads to much more significant reductions of condition numbers due to an accelerated magnification effect for the decay in the singular values of the scaled off-diagonal blocks. (iii) With the new preconditioner, the eigenvalues of the preconditioned matrix are much better clustered around $1$. (iv) The multilevel eSIF preconditioner is further unconditionally robust or is guaranteed to be positive definite without the need of extra stabilization, while the multilevel SIF preconditioner has a strict requirement in order to preserve positive definiteness. Comprehensive numerical tests are used to show the advantages of the eSIF preconditioner in accelerating the convergence of iterative solutions.

[1]  Z. Drmač,et al.  On the Perturbation of the Cholesky Factorization , 1994 .

[2]  Xiaoye S. Li,et al.  Direction-Preserving and Schur-Monotonic Semiseparable Approximations of Symmetric Positive Definite Matrices , 2009, SIAM J. Matrix Anal. Appl..

[3]  Jianlin Xia and Zixing Xin Effective and Robust Preconditioning of General SPD Matrices via Structured Incomplete Factorization , 2017 .

[4]  Per-Gunnar Martinsson,et al.  Randomized algorithms for the low-rank approximation of matrices , 2007, Proceedings of the National Academy of Sciences.

[5]  Jianlin Xia,et al.  Effective and Robust Preconditioning of General SPD Matrices via Structured Incomplete Factorization , 2017, SIAM J. Matrix Anal. Appl..

[6]  Yousef Saad,et al.  Schur complement‐based domain decomposition preconditioners with low‐rank corrections , 2015, Numer. Linear Algebra Appl..

[7]  Jianlin Xia,et al.  Effectiveness and robustness revisited for a preconditioning technique based on structured incomplete factorization , 2020, Numer. Linear Algebra Appl..

[8]  Emmanuel Agullo,et al.  Low-Rank Factorizations in Data Sparse Hierarchical Algorithms for Preconditioning Symmetric Positive Definite Matrices , 2018, SIAM J. Matrix Anal. Appl..

[9]  Edmond Chow,et al.  Preserving Positive Definiteness in Hierarchically Semiseparable Matrix Approximations , 2018, SIAM J. Matrix Anal. Appl..

[10]  Eric Darve,et al.  An Algebraic Sparsified Nested Dissection Algorithm Using Low-Rank Approximations , 2019, SIAM J. Matrix Anal. Appl..

[11]  Jianlin Xia,et al.  New Efficient and Robust HSS Cholesky Factorization of SPD Matrices , 2012, SIAM J. Matrix Anal. Appl..

[12]  Michele Benzi,et al.  Robust Approximate Inverse Preconditioning for the Conjugate Gradient Method , 2000, SIAM J. Sci. Comput..

[13]  Yousef Saad,et al.  An Algebraic Multilevel Preconditioner with Low-Rank Corrections for Sparse Symmetric Matrices , 2016, SIAM J. Matrix Anal. Appl..

[14]  Lexing Ying,et al.  Recursively preconditioned hierarchical interpolative factorization for elliptic partial differential equations , 2018, Communications in Mathematical Sciences.

[15]  Jianlin Xia,et al.  Robust Approximate Cholesky Factorization of Rank-Structured Symmetric Positive Definite Matrices , 2010, SIAM J. Matrix Anal. Appl..

[16]  D. Kershaw The incomplete Cholesky—conjugate gradient method for the iterative solution of systems of linear equations , 1978 .

[17]  Yousef Saad,et al.  Low-Rank Correction Methods for Algebraic Domain Decomposition Preconditioners , 2015, SIAM J. Matrix Anal. Appl..

[18]  Owe Axelsson,et al.  Diagonally compensated reduction and related preconditioning methods , 1994, Numer. Linear Algebra Appl..

[19]  Yousef Saad,et al.  Divide and Conquer Low-Rank Preconditioners for Symmetric Matrices , 2013, SIAM J. Sci. Comput..

[20]  John P. Boyd,et al.  Numerical experiments on the condition number of the interpolation matrices for radial basis functions , 2011 .

[21]  Jianlin Xia,et al.  Fast algorithms for hierarchically semiseparable matrices , 2010, Numer. Linear Algebra Appl..