The importance of structure in incomplete factorization preconditioners

In this paper, we consider level-based preconditioning, which is one of the basic approaches to incomplete factorization preconditioning of iterative methods. It is well-known that while structure-based preconditioners can be very useful, excessive memory demands can limit their usefulness. Here we present an improved strategy that considers the individual entries of the system matrix and restricts small entries to contributing to fewer levels of fill than the largest entries. Using symmetric positive-definite problems arising from a wide range of practical applications, we show that the use of variable levels of fill can yield incomplete Cholesky factorization preconditioners that are more efficient than those resulting from the standard level-based approach. The concept of level-based preconditioning, which is based on the structural properties of the system matrix, is then transferred to the numerical incomplete decomposition. In particular, the structure of the incomplete factorization determined in the symbolic factorization phase is explicitly used in the numerical factorization phase. Further numerical results demonstrate that our level-based approach can lead to much sparser but efficient incomplete factorization preconditioners.

[1]  Alex Pothen,et al.  Level-based Incomplete LU Factorization: Graph Model and Algorithms , 2002 .

[2]  Ole Østerby,et al.  Direct Methods for Space Matrices , 1983, Lecture Notes in Computer Science.

[3]  J. Meijerink,et al.  An iterative solution method for linear systems of which the coefficient matrix is a symmetric -matrix , 1977 .

[4]  N. I. Buleev A numerical method for solving two-dimensional diffusion equations , 1960 .

[5]  I. Gustafsson A class of first order factorization methods , 1978 .

[6]  Timothy A. Davis,et al.  The university of Florida sparse matrix collection , 2011, TOMS.

[7]  Miroslav Tuma,et al.  Balanced Incomplete Factorization , 2008, SIAM J. Sci. Comput..

[8]  M. A. Ajiz,et al.  A robust incomplete Choleski‐conjugate gradient algorithm , 1984 .

[9]  Matthias Bollhöfer,et al.  A Robust and Efficient ILU that Incorporates the Growth of the Inverse Triangular Factors , 2003, SIAM J. Sci. Comput..

[10]  Roland W. Freund,et al.  An Implementation of the Look-Ahead Lanczos Algorithm for Non-Hermitian Matrices , 1993, SIAM J. Sci. Comput..

[11]  Yousef Saad,et al.  ILUT: A dual threshold incomplete LU factorization , 1994, Numer. Linear Algebra Appl..

[12]  Michele Benzi,et al.  Preconditioning Highly Indefinite and Nonsymmetric Matrices , 2000, SIAM J. Sci. Comput..

[13]  W. James,et al.  A Conjugate Gradient-Truncated Direct Method for the Iterative Solution of the Reservoir Simulation Pressure Equation , 1981 .

[14]  D. J. Evans,et al.  Preconditioning methods : analysis and applications , 1983 .

[15]  Jorge J. Moré,et al.  Benchmarking optimization software with performance profiles , 2001, Math. Program..

[16]  José MarÍn José Mas Rafael Bru,et al.  Balanced Incomplete Factorization , 2008 .

[17]  Yousef Saad,et al.  On the Relations between ILUs and Factored Approximate Inverses , 2002, SIAM J. Matrix Anal. Appl..

[18]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[19]  E. D'Azevedo,et al.  Drop tolerance preconditioning for incompressible viscous flow , 1992 .

[20]  David W. Zingg,et al.  Efficient Newton-Krylov Solver for Aerodynamic Computations , 1998 .

[21]  J. Meijerink,et al.  Guidelines for the usage of incomplete decompositions in solving sets of linear equations as they occur in practical problems , 1981 .

[22]  N. Munksgaard,et al.  Solving Sparse Symmetric Sets of Linear Equations by Preconditioned Conjugate Gradients , 1980, TOMS.

[23]  D. Kershaw The incomplete Cholesky—conjugate gradient method for the iterative solution of systems of linear equations , 1978 .

[24]  R. Langer Boundary Problems in Differential Equations , 1960 .

[25]  T. Oliphant An extrapolation procedure for solving linear systems , 1962 .

[26]  D. Rose,et al.  Algorithmic aspects of vertex elimination on directed graphs. , 1975 .

[27]  Pascal Hénon,et al.  On finding approximate supernodes for an efficient block-ILU(k , 2008, Parallel Comput..

[28]  I. Duff,et al.  The effect of ordering on preconditioned conjugate gradients , 1989 .

[29]  An implicit, numerical method for solving the two-dimensional heat equation , 1960 .

[30]  R. Kouhia,et al.  Stabilized and block approximate inverse preconditioners for problems in solid and structural mechanics , 2001 .

[31]  Alex Pothen,et al.  A Scalable Parallel Algorithm for Incomplete Factor Preconditioning , 2000, SIAM J. Sci. Comput..

[32]  Robert E. Tarjan,et al.  Algorithmic Aspects of Vertex Elimination on Graphs , 1976, SIAM J. Comput..

[33]  O. Østerby,et al.  Direct Methods for Sparse Matrices , 1983 .

[34]  Stanley C. Eisenstat,et al.  Yale sparse matrix package I: The symmetric codes , 1982 .

[35]  Chih-Jen Lin,et al.  Incomplete Cholesky Factorizations with Limited Memory , 1999, SIAM J. Sci. Comput..

[36]  Matthias Bollhöfer,et al.  A robust ILU with pivoting based on monitoring the growth of the inverse factors , 2001 .

[37]  Miroslav Tuma,et al.  Improved Balanced Incomplete Factorization , 2010, SIAM J. Matrix Anal. Appl..

[38]  Mark T. Jones,et al.  An improved incomplete Cholesky factorization , 1995, TOMS.

[39]  V P Il'in Iterative Incomplete Factorization Methods , 1992 .