Preconditioning techniques for large linear systems: a survey

This article surveys preconditioning techniques for the iterative solution of large linear systems, with a focus on algebraic methods suitable for general sparse matrices. Covered topics include progress in incomplete factorization methods, sparse approximate inverses, reorderings, parallelization issues, and block and multilevel extensions. Some of the challenges ahead are also discussed. An extensive bibliography completes the paper.

[1]  C. Jacobi.  Ueber eine neue Auflösungsart der bei der Methode der kleinsten Quadrate vorkommenden lineären Gleichungen , 1845 .

[2]  H. D. Huskey,et al.  NOTES ON THE SOLUTION OF ALGEBRAIC LINEAR SIMULTANEOUS EQUATIONS , 1948 .

[3]  A. Turing.  ROUNDING-OFF ERRORS IN MATRIX PROCESSES , 1948 .

[4]  M. Hestenes,et al.  Methods of conjugate gradients for solving linear systems , 1952 .

[5]  C. Lanczos.  Solution of Systems of Linear Equations by Minimized Iterations1 , 1952 .

[6]  D. Young.  Iterative methods for solving partial difference equations of elliptic type , 1954 .

[7]  H. H. Rachford,et al.  The Numerical Solution of Parabolic and Elliptic Differential Equations , 1955 .

[8]  On the numerical solution of elliptic difference equations , 1955 .

[9]  H. H. Rachford,et al.  On the numerical solution of heat conduction problems in two and three space variables , 1956 .

[10]  C. Lanczos,et al.  Iterative Solution of Large-Scale Linear Systems , 1958 .

[11]  E. Stiefel,et al.  Refined Iterative Methods for Computation of the Solution and the Eigenvalues of Self-Adjoint Boundary Value Problems , 1959 .

[12]  N. I. Buleev.  A numerical method for solving two-dimensional diffusion equations , 1960 .

[13]  J. Gillis,et al.  Matrix Iterative Analysis , 1961 .

[14]  T. Oliphant.  An extrapolation procedure for solving linear systems , 1962 .

[15]  R. P. Fedorenko.  A relaxation method for solving elliptic difference equations , 1962 .

[16]  R. P. Fedorenko.  The speed of convergence of one iterative process , 1964 .

[17]  Alston S. Householder,et al.  The Theory of Matrices in Numerical Analysis , 1964 .

[18]  O. Widlund,et al.  Iterative solution of elliptic systems : and applications to the neutron diffusion equations of reactor physics , 1967 .

[19]  Richard S. Varga,et al.  Iterative Solution of Elliptic Systems and Applications to the Neutron Diffusion Equations of Reactor Physics (Eugene L. Wachspress) , 1967 .

[20]  R. P. Kendall,et al.  An Approximate Factorization Procedure for Solving Self-Adjoint Elliptic Difference Equations , 1968 .

[21]  D. J. Evans,et al.  The Use of Pre-conditioning in Iterative Methods for Solving Linear Equations with Symmetric Positive Definite Matrices , 1968 .

[22]  Louis A. Hageman,et al.  Iterative Solution of Large Linear Systems. , 1971 .

[23]  Elizabeth Cuthill,et al.  Several Strategies for Reducing the Bandwidth of Matrices , 1972 .

[24]  O. Axelsson.  A generalized SSOR method , 1972 .

[25]  A. George.  Nested Dissection of a Regular Finite Element Mesh , 1973 .

[26]  J. Reid.  Large Sparse Sets of Linear Equations , 1973 .

[27]  Robert Piessens,et al.  The evaluation and application of some modified moments , 1973 .

[28]  M. Saunders,et al.  Solution of Sparse Indefinite Systems of Linear Equations , 1975 .

[29]  R. Fletcher.  Conjugate gradient methods for indefinite systems , 1976 .

[30]  William G. Poole,et al.  An algorithm for reducing the bandwidth and profile of a sparse matrix , 1976 .

[31]  D. Rose,et al.  Generalized nested dissection , 1977 .

[32]  J. Meijerink,et al.  An iterative solution method for linear systems of which the coefficient matrix is a symmetric -matrix , 1977 .

[33]  D. Brandt,et al.  Multi-level adaptive solutions to boundary-value problems math comptr , 1977 .

[34]  D. Kershaw.  The incomplete Cholesky—conjugate gradient method for the iterative solution of systems of linear equations , 1978 .

[35]  I. Gustafsson.  A class of first order factorization methods , 1978 .

[36]  R. Varga,et al.  Incomplete Factorizations of Matrices and Connections with H-Matrices , 1980 .

[37]  T. Manteuffel.  An incomplete factorization technique for positive definite linear systems , 1980 .

[38]  H. V. D. Vorst,et al.  Iterative solution methods for certain sparse linear systems with a non-symmetric matrix arising from PDE-problems☆ , 1981 .

[39]  Alan George,et al.  Computer Solution of Large Sparse Positive Definite , 1981 .

[40]  Philip E. Gill,et al.  Practical optimization , 1981 .

[41]  W. James,et al.  A Conjugate Gradient-Truncated Direct Method for the Iterative Solution of the Reservoir Simulation Pressure Equation , 1981 .

[42]  S. Eisenstat.  Efficient Implementation of a Class of Preconditioned Conjugate Gradient Methods , 1981 .

[43]  J. Dendy.  Black box multigrid , 1982 .

[44]  Edward W. Larsen,et al.  UNCONDITIONALLY STABLE DIFFUSION-SYNTHETIC ACCELERATION METHODS FOR THE SLAB GEOMETRY DISCRETE ORDINATES EQUATIONS. PART II: NUMERICAL RESULTS. , 1982 .

[45]  Yves Robert,et al.  Regular incomplete factorizations of real positive definite matrices , 1982 .

[46]  J. Pasciak,et al.  Computer solution of large sparse positive definite systems , 1982 .

[47]  Edward W. Larsen,et al.  UNCONDITIONALLY STABLE DIFFUSION-SYNTHETIC ACCELERATION METHODS FOR THE SLAB GEOMETRY DISCRETE ORDINATES EQUATIONS. PART I: THEORY. , 1982 .

[48]  Peter A. Forsyth,et al.  Comparison of Fast Iterative Methods for Symmetric Systems , 1983 .

[49]  K. Stüben.  Algebraic multigrid (AMG): experiences and comparisons , 1983 .

[50]  C. Micchelli,et al.  Polynomial Preconditioners for Conjugate Gradient Calculations , 1983 .

[51]  William F. Moss,et al.  Decay rates for inverses of band matrices , 1984 .

[52]  Hoon Liong Ong,et al.  Fast approximate solution of large scale sparse linear systems , 1984 .

[53]  M. A. Ajiz,et al.  A robust incomplete Choleski‐conjugate gradient algorithm , 1984 .

[54]  O. Axelsson,et al.  On some versions of incomplete block-matrix factorization iterative methods , 1984 .

[55]  Anne Greenbaum,et al.  Analysis of a Multigrid Method as an Iterative Technique for Solving Linear Systems , 1984 .

[56]  Owe Axelsson,et al.  A survey of preconditioned iterative methods for linear systems of algebraic equations , 1985 .

[57]  Joseph W. H. Liu,et al.  Modification of the minimum-degree algorithm by multiple elimination , 1985, TOMS.

[58]  G. Golub,et al.  Block Preconditioning for the Conjugate Gradient Method , 1985 .

[59]  Wolfgang Hackbusch,et al.  Multi-grid methods and applications , 1985, Springer series in computational mathematics.

[60]  H. Elman.  A stability analysis of incomplete LU factorizations , 1986 .

[61]  Y. Saad,et al.  GMRES: a generalized minimal residual algorithm for solving nonsymmetric linear systems , 1986 .

[62]  S. Sloan.  An algorithm for profile and wavefront reduction of sparse matrices , 1986 .

[63]  O. Axelsson.  A general incomplete block-matrix factorization method , 1986 .

[64]  L. Kolotilina,et al.  On a family of two-level preconditionings of the incomplete block factorization type , 1986 .

[65]  William L. Briggs,et al.  A multigrid tutorial , 1987 .

[66]  J. W. Ruge,et al.  4. Algebraic Multigrid , 1987 .

[67]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[68]  Henk A. van der Vorst,et al.  Large tridiagonal and block tridiagonal linear systems on vector and parallel computers , 1987, Parallel Comput..

[69]  E. L. Poole,et al.  Multicolor ICCG methods for vector computers , 1987 .

[70]  Y. Saad.  Preconditioning techniques for nonsymmetric and indefinite linear systems , 1988 .

[71]  L. Yu. Kolotilina,et al.  Explicit preconditioning of systems of linear algebraic equations with dense matrices , 1988 .

[72]  C. W. Gear,et al.  Sparsity structure and Gaussian elimination , 1988, SGNM.

[73]  O. Axelsson,et al.  Vectorizable preconditioners for elliptic difference equations in three space dimensions , 1989 .

[74]  Wolfgang Dahmen,et al.  Algebraic Multigrid Methods and the Schur Complement , 1989 .

[75]  Alan George,et al.  The Evolution of the Minimum Degree Ordering Algorithm , 1989, SIAM Rev..

[76]  G. Wittum.  On the Robustness of ILU Smoothing , 1989 .

[77]  Y. Saad,et al.  Krylov Subspace Methods on Supercomputers , 1989 .

[78]  I. Duff,et al.  The effect of ordering on preconditioned conjugate gradients , 1989 .

[79]  P. Vassilevski,et al.  Algebraic multilevel preconditioning methods. I , 1989 .

[80]  T. Manteuffel,et al.  Adaptive polynomial preconditioning for hermitian indefinite linear systems , 1989 .

[81]  H. V. D. Vorst,et al.  The convergence behaviour of preconditioned CG and CG-S in the presence of rounding errors , 1991 .

[82]  O. Axelsson,et al.  Algebraic multilevel preconditioning methods, II , 1990 .

[83]  Daniel B. Szyld,et al.  A Block Ordering Method for Sparse Matrices , 1990, SIAM J. Sci. Comput..

[84]  Elizabeth Eskow,et al.  A New Modified Cholesky Factorization , 1990, SIAM J. Sci. Comput..

[85]  Maurice W. Benson,et al.  Frequency domain behavior of a set of parallel multigrid smoothing operators , 1990, Int. J. Comput. Math..

[86]  Stephen G. Nash,et al.  A history of scientific computing , 1990 .

[87]  C. Farhat,et al.  A method of finite element tearing and interconnecting and its parallel solution algorithm , 1991 .

[88]  E. D'Azevedo,et al.  Two variants of minimum discarded fill ordering , 1991 .

[89]  V. Eijkhout.  Analysis of parallel incomplete point factorizations , 1991 .

[90]  M. Tismenetsky,et al.  A new preconditioning technique for solving large sparse linear systems , 1991 .

[91]  Patrick H. Worley.  Limits on Parallelism in the Numerical Solution of Linear Partial Differential Equations , 1991, SIAM J. Sci. Comput..

[92]  Maurice W. Benson,et al.  An approximate inverse based multigrid approach to the biharmonic problem , 1991, Int. J. Comput. Math..

[93]  V. Eijkhout.  Beware Of Unperturbed Modified Incomplete Factorizations , 1991 .

[94]  R. Freund,et al.  QMR: a quasi-minimal residual method for non-Hermitian linear systems , 1991 .

[95]  S. Doi.  On parallelism and convergence of incomplete LU factorizations , 1991 .

[96]  H. Elman,et al.  Ordering Effects on Relaxation Methods Applied to The Discrete One-Dimensional Convection-Diffusion , 1992 .

[97]  A. Griewank,et al.  Approximate inverse preconditionings for sparse linear systems , 1992 .

[98]  Gérard Meurant,et al.  A Review on the Inverse of Symmetric Tridiagonal and Block Tridiagonal Matrices , 1992, SIAM J. Matrix Anal. Appl..

[99]  V P Il'in.  Iterative Incomplete Factorization Methods , 1992 .

[100]  Anne Greenbaum,et al.  Predicting the Behavior of Finite Precision Lanczos and Conjugate Gradient Computations , 2015, SIAM J. Matrix Anal. Appl..

[101]  Henk A. van der Vorst,et al.  Bi-CGSTAB: A Fast and Smoothly Converging Variant of Bi-CG for the Solution of Nonsymmetric Linear Systems , 1992, SIAM J. Sci. Comput..

[102]  B. M. Fulk.  MATH , 1992 .

[103]  R. C. Malone,et al.  Parallel ocean general circulation modeling , 1992 .

[104]  C. Brand.  An incomplete-factorization preconditioning using repeated red-black ordering , 1992 .

[105]  Wei-Pai Tang,et al.  Ordering Methods for Preconditioned Conjugate Gradient Methods Applied to Unstructured Grid Problems , 1992, SIAM J. Matrix Anal. Appl..

[106]  G. Golub,et al.  Iterative solution of linear systems , 1991, Acta Numerica.

[107]  Yousef Saad,et al.  A Flexible Inner-Outer Preconditioned GMRES Algorithm , 1993, SIAM J. Sci. Comput..

[108]  L. Kolotilina,et al.  Factorized Sparse Approximate Inverse Preconditionings I. Theory , 1993, SIAM J. Matrix Anal. Appl..

[109]  W. Hackbusch.  Iterative Solution of Large Sparse Systems of Equations , 1993 .

[110]  曹志浩,et al.  ON ALGEBRAIC MULTILEVEL PRECONDITIONING METHODS , 1993 .

[111]  Roland W. Freund,et al.  A Transpose-Free Quasi-Minimal Residual Algorithm for Non-Hermitian Linear Systems , 1993, SIAM J. Sci. Comput..

[112]  L. Dutto.  The effect of ordering on preconditioned GMRES algorithm, for solving the compressible Navier-Stokes equations , 1993 .

[113]  Joseph W. H. Liu,et al.  On Finding Supernodes for Sparse Matrix Computations , 1993, SIAM J. Matrix Anal. Appl..

[114]  Steven Lewis Lee.  Krylov methods for the numerical solution of initial-value problems in differential-algebraic equations , 1993 .

[115]  Robert J. Plemmons,et al.  Nonnegative Matrices in the Mathematical Sciences , 1979, Classics in Applied Mathematics.

[116]  Youcef Saad,et al.  Highly Parallel Preconditioners for General Sparse Matrices , 1994 .

[117]  C. Farhat,et al.  Optimal convergence properties of the FETI domain decomposition method , 1994 .

[118]  Yousef Saad,et al.  ILUT: A dual threshold incomplete LU factorization , 1994, Numer. Linear Algebra Appl..

[119]  Owe Axelsson,et al.  Diagonally compensated reduction and related preconditioning methods , 1994, Numer. Linear Algebra Appl..

[120]  Mark T. Jones,et al.  Scalable Iterative Solution of Sparse Linear Systems , 1994, Parallel Comput..

[121]  Igor E. Kaporin,et al.  New convergence results and preconditioning strategies for the conjugate gradient method , 1994, Numer. Linear Algebra Appl..

[122]  J. Gilbert.  Predicting Structure in Sparse Matrix Computations , 1994 .

[123]  Richard Barrett,et al.  Templates for the Solution of Linear Systems: Building Blocks for Iterative Methods , 1994, Other Titles in Applied Mathematics.

[124]  Kincho H. Law,et al.  A robust incomplete factorization based on value and space constraints , 1995 .

[125]  M. Rozložník,et al.  Numerical stability of GMRES , 1995 .

[126]  Mark T. Jones,et al.  An improved incomplete Cholesky factorization , 1995, TOMS.

[127]  A. Bruaset.  A survey of preconditioned iterative methods , 1995 .

[128]  A. Yu. Yeremin,et al.  Factorized Sparse Approximate Inverse Preconditioning II: Solution of 3D FE Systems on Massively Parallel Computers , 1995, Int. J. High Speed Comput..

[129]  Wei-Pai Tang,et al.  Weighted graph based ordering techniques for preconditioned conjugate gradient methods , 1995 .

[130]  Peter N. Brown,et al.  A linear algebraic development of diffusion synthetic acceleration for three-dimensional transport equations , 1995 .

[131]  Elise de Doncker,et al.  Coarse Grain Preconditioned Conjugate Gradient Solver for Large Sparse Systems , 1995, PPSC.

[132]  A. C. Hindmarsh,et al.  A linear algebraic analysis of diffusion synthetic acceleration for the Boltzmann transport equation , 1995 .

[133]  Cleve Ashcraft,et al.  Compressed Graphs and the Minimum Degree Algorithm , 1995, SIAM J. Sci. Comput..

[134]  Mark T. Jones,et al.  Algorithm 740: Fortran subroutines to compute improved incomplete Cholesky factorizations , 1995, TOMS.

[135]  Arnold Reusken.  A multigrid method based on incomplete Gaussian elimination , 1996 .

[136]  Fred Wubs,et al.  Nested grids ILU-decomposition (NGILU) , 1996 .

[137]  A. Neumaier,et al.  A NEW PIVOTING STRATEGY FOR GAUSSIAN ELIMINATION , 1996 .

[138]  Barry F. Smith,et al.  Domain Decomposition: Parallel Multilevel Methods for Elliptic Partial Differential Equations , 1996 .

[139]  A. van der Ploeg,et al.  Nested grids ILU-decomposition , 1996 .

[140]  Rüdiger Weiss,et al.  Parameter-Free Iterative Linear Solvers , 1996 .

[141]  Alfio Quarteroni,et al.  Domain Decomposition Methods for Partial Differential Equations , 1999 .

[142]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[143]  Arnold Reusken,et al.  A Multigrid Method Based on Incomplete Gaussian Elimination , 1996, Numer. Linear Algebra Appl..

[144]  Michele Benzi,et al.  A Sparse Approximate Inverse Preconditioner for the Conjugate Gradient Method , 1996, SIAM J. Sci. Comput..

[145]  Anne Greenbaum,et al.  Any Nonincreasing Convergence Curve is Possible for GMRES , 1996, SIAM J. Matrix Anal. Appl..

[146]  Patrick R. Amestoy,et al.  An Approximate Minimum Degree Ordering Algorithm , 1996, SIAM J. Matrix Anal. Appl..

[147]  D. Szyld,et al.  Application of threshold partitioning of sparse matrices to Markov chains , 1996, Proceedings of IEEE International Computer Performance and Dependability Symposium.

[148]  B. Fischer.  Polynomial Based Iteration Methods for Symmetric Linear Systems , 1996 .

[149]  Yousef Saad,et al.  ILUM: A Multi-Elimination ILU Preconditioner for General Sparse Matrices , 1996, SIAM J. Sci. Comput..

[150]  Robert Beauwens,et al.  HIGH-PERFORMANCE PCG SOLVERS FOR FEM STRUCTURAL ANALYSIS , 1996 .

[151]  V. Kumar,et al.  Parallel Threshold-based ILU Factorization , 1997, ACM/IEEE SC 1997 Conference (SC'97).

[152]  Iain S. Duff,et al.  The Rutherford-Boeing sparse matrix collection , 1997 .

[153]  Anne Greenbaum,et al.  Iterative methods for solving linear systems , 1997, Frontiers in applied mathematics.

[154]  I. Hlad.  ROBUST PRECONDITIONERS FOR LINEAR ELASTICITY FEM ANALYSES , 1997 .

[155]  Michael P. Chernesky,et al.  On preconditioned Krylov subspace methods for discrete convection–diffusion problems , 1997 .

[156]  Robert L. Clay,et al.  A Portable MPI Implementation of the SPAI Preconditioner in ISIS++ , 1997, PPSC.

[157]  Y. Saad,et al.  Experimental study of ILU preconditioners for indefinite matrices , 1997 .

[158]  Claude Brezinski,et al.  Projection methods for systems of equations , 1997 .

[159]  Edmond Chow,et al.  Approximate Inverse Techniques for Block-Partitioned Matrices , 1997, SIAM J. Sci. Comput..

[160]  Marcus J. Grote,et al.  Parallel Preconditioning with Sparse Approximate Inverses , 1997, SIAM J. Sci. Comput..

[161]  T. Chan,et al.  Wavelet sparse approximate inverse preconditioners , 1997 .

[162]  Claude Brezinski,et al.  Projection methods for linear systems , 1997 .

[163]  T. Chan,et al.  Approximate and Incomplete Factorizations , 1997 .

[164]  L. Trefethen,et al.  Numerical linear algebra , 1997 .

[165]  Edmond Chow,et al.  ILUS: An incomplete LU preconditioner in sparse skyline format , 1997 .

[166]  Ke Chen,et al.  On a Class of Preconditioning Methods for Dense Linear Systems from Boundary Elements , 1998, SIAM Journal on Scientific Computing.

[167]  Michele Benzi,et al.  A Sparse Approximate Inverse Preconditioner for Nonsymmetric Linear Systems , 1998, SIAM J. Sci. Comput..

[168]  C. Farhat,et al.  The two-level FETI method for static and dynamic plate problems Part I: An optimal iterative solver for biharmonic systems , 1998 .

[169]  Y. Saad,et al.  Inexact newton preconditioning techniques for large symmetric eigenvalue problems , 1998 .

[170]  Andrew Knyazev,et al.  Preconditioned Eigensolvers - an Oxymoron? , 1998 .

[171]  Edmond Chow,et al.  Approximate Inverse Preconditioners via Sparse-Sparse Iterations , 1998, SIAM J. Sci. Comput..

[172]  Michele Benzi,et al.  Numerical experiments with two approximate inverse preconditioners , 1998 .

[173]  Jack Dongarra,et al.  Numerical Linear Algebra for High-Performance Computers , 1998 .

[174]  Igor E. Kaporin,et al.  High quality preconditioning of a general symmetric positive definite matrix based on its UTU + UTR + RTU-decomposition , 1998, Numer. Linear Algebra Appl..

[175]  Cornelis Vuik,et al.  Parallelism in ILU-preconditioned GMRES , 1998, Parallel Comput..

[176]  Gundolf Haase.  Parallel Incomplete Cholesky Preconditioners Based on the Non-Overlapping Data Distribution , 1998, Parallel Comput..

[177]  N. Gould,et al.  Sparse Approximate-Inverse Preconditioners Using Norm-Minimization Techniques , 1998, SIAM J. Sci. Comput..

[178]  Michele Benzi,et al.  AN ASSESSMENT OF SOME PRECONDITIONING TECHNIQUES IN SHELL PROBLEMS , 1998 .

[179]  Igor E. Kaporin,et al.  High quality preconditioning of a general symmetric positive definite matrix based on its U , 1998 .

[180]  Edmond Chow,et al.  An object-oriented framework for block preconditioning , 1998, TOMS.

[181]  Yvan Notay,et al.  Using approximate inverses in algebraic multilevel methods , 1998, Numerische Mathematik.

[182]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[183]  K. Chen,et al.  DISCRETE WAVELET TRANSFORMS ACCELERATED SPARSE PRECONDITIONERS FOR DENSE BOUNDARY ELEMENT SYSTEMS , 1999 .

[184]  A. Yu. Yeremin,et al.  Factorized sparse approximate inverse preconditionings. IV: Simple approaches to rising efficiency , 1999 .

[185]  E. F. F. Botta,et al.  Matrix Renumbering ILU: An Effective Algebraic Multilevel ILU Preconditioner for Sparse Matrices , 1999, SIAM J. Matrix Anal. Appl..

[186]  Marcus J. Grote,et al.  A Block Version of the SPAI Preconditioner , 1999, PP.

[187]  Iain S. Duff,et al.  The Design and Use of Algorithms for Permuting Large Entries to the Diagonal of Sparse Matrices , 1999, SIAM J. Matrix Anal. Appl..

[188]  Robert Beauwens,et al.  Problem-dependent preconditioners for iterative solvers in FE elastostatics , 1999 .

[189]  Luis M. Bernardo,et al.  An MPI Implementation of the SPAI Preconditioner on the T3E , 1997, Int. J. High Perform. Comput. Appl..

[190]  Robert Bridson,et al.  Ordering, Anisotropy, and Factored Sparse Approximate Inverses , 1999, SIAM J. Sci. Comput..

[191]  Weng Cho Chew,et al.  Numerical Study of Approximate Inverse Preconditioner for Two-Dimensional Engine Inlet Problems , 1999 .

[192]  T. Huckle.  Approximate sparsity patterns for the inverse of a matrix and preconditioning , 1999 .

[193]  M. Benzi,et al.  A comparative study of sparse approximate inverse preconditioners , 1999 .

[194]  W. Joubert,et al.  Numerical experiments with parallel orderings for ILU preconditioners. , 1999 .

[195]  Yvan Notay,et al.  A multilevel block incomplete factorization preconditioning , 1999 .

[196]  Jun Zhang,et al.  BILUTM: A Domain-Based Multilevel Block ILUT Preconditioner for General Sparse Matrices , 1999, SIAM J. Matrix Anal. Appl..

[197]  G. Meurant.  Computer Solution of Large Linear Systems , 1999 .

[198]  John L. Volakis,et al.  Preconditioned generalized minimal residual iterative scheme for perfectly matched layer terminated applications , 1999 .

[199]  Lily Yu. Kolotilina,et al.  Factorized sparse approximate inverse preconditionings. IV: Simple approaches to rising efficiency , 1999, Numer. Linear Algebra Appl..

[200]  Takumi Washio,et al.  Ordering strategies and related techniques to overcome the trade-off between parallelism and convergence in incomplete factorizations , 1999, Parallel Comput..

[201]  M. Benzi,et al.  A Two-Level Parallel Preconditioner Based on Sparse Approximate Inverses , 1999 .

[202]  Jun Zhang,et al.  BILUM: Block Versions of Multielimination and Multilevel ILU Preconditioner for General Sparse Linear Systems , 1999, SIAM J. Sci. Comput..

[203]  Albert Cohen,et al.  Wavelet Methods for Second-Order Elliptic Problems, Preconditioning, and Adaptivity , 1999, SIAM J. Sci. Comput..

[204]  Chih-Jen Lin,et al.  Incomplete Cholesky Factorizations with Limited Memory , 1999, SIAM J. Sci. Comput..

[205]  Christian Wagner,et al.  Multilevel ILU decomposition , 1999, Numerische Mathematik.

[206]  Michele Benzi,et al.  Orderings for Incomplete Factorization Preconditioning of Nonsymmetric Problems , 1999, SIAM J. Sci. Comput..

[207]  Randolph E. Bank,et al.  The Incomplete Factorization Multigraph Algorithm , 1999, SIAM J. Sci. Comput..

[208]  Gene H. Golub,et al.  Inexact Preconditioned Conjugate Gradient Method with Inner-Outer Iteration , 1999, SIAM J. Sci. Comput..

[209]  Matt Challacombe,et al.  A simplified density matrix minimization for linear scaling self-consistent field theory , 1999 .

[210]  Y. Notay.  Flexible Conjugate Gradients , 2000, SIAM J. Sci. Comput..

[211]  Gene H. Golub,et al.  A Note on Preconditioning for Indefinite Linear Systems , 1999, SIAM J. Sci. Comput..

[212]  Yvan Notay,et al.  Optimal Order Preconditioning of Finite Difference Matrices , 1999, SIAM J. Sci. Comput..

[213]  Wei-Pai Tang,et al.  Refining an approximate inverse , 2000 .

[214]  Bruno Carpentieri,et al.  Sparse pattern selection strategies for robust Frobenius-norm minimization preconditioners in electromagnetism , 2000 .

[215]  Y. Saad,et al.  Iterative solution of linear systems in the 20th century , 2000 .

[216]  Oliver Bröker,et al.  Sparse approximate inverse smoothers for geometric and algebraic multigrid , 2002 .

[217]  Eric F Darve.  Regular ArticleThe Fast Multipole Method: Numerical Implementation , 2000 .

[218]  R. Saigal,et al.  An Incomplete Cholesky Factorization for Dense Symmetric Positive Definite Matrices , 2000 .

[219]  Michele Benzi,et al.  Robust Approximate Inverse Preconditioning for the Conjugate Gradient Method , 2000, SIAM J. Sci. Comput..

[220]  Sabine Le Borne.  Ordering Techniques for Two- and Three-Dimensional Convection-Dominated Elliptic Boundary Value Problems , 2000, Computing.

[221]  Van Emden Henson,et al.  Robustness and Scalability of Algebraic Multigrid , 1999, SIAM J. Sci. Comput..

[222]  Eric Darve,et al.  The Fast Multipole Method , 2000 .

[223]  Jacob Fish,et al.  Global‐basis two‐level method for indefinite systems. Part 2: computational issues , 2000 .

[224]  Michele Benzi,et al.  Preconditioning Highly Indefinite and Nonsymmetric Matrices , 2000, SIAM J. Sci. Comput..

[225]  Michele Benzi,et al.  Orderings for Factorized Sparse Approximate Inverse Preconditioners , 1999, SIAM J. Sci. Comput..

[226]  Ronald B. Morgan,et al.  Preconditioning eigenvalues and some comparison of solvers , 2000 .

[227]  M. Challacombe.  A general parallel sparse-blocked matrix multiply for linear scaling SCF theory , 2000 .

[228]  Eric Darve,et al.  The Fast Multipole Method I: Error Analysis and Asymptotic Complexity , 2000, SIAM J. Numer. Anal..

[229]  William J. Rider,et al.  Physics-Based Preconditioning and the Newton-Krylov Method for Non-equilibrium Radiation Diffusion , 2000 .

[230]  S. McCormick,et al.  A multigrid tutorial (2nd ed.) , 2000 .

[231]  F. Sartoretto,et al.  Approximate Inverse Preconditioning in the Parallel Solution of Sparse Eigenproblems , 2000 .

[232]  Jun Zhang.  Sparse approximate inverse and multilevel block ILU preconditioning techniques for general sparse matrices , 2000 .

[233]  Edmond Chow,et al.  A Priori Sparsity Patterns for Parallel Sparse Approximate Inverse Preconditioners , 1999, SIAM J. Sci. Comput..

[234]  Wei-Pai Tang,et al.  Sparse Approximate Inverse Smoother for Multigrid , 2000, SIAM J. Matrix Anal. Appl..

[235]  Yousef Saad,et al.  High-order ILU preconditioners for CFD problems , 2000 .

[236]  Fast wavelet iterative solvers applied to the Neumann problem , 2000 .

[237]  Robert Beauwens,et al.  Preconditioning of discrete Helmholtz operators perturbed by a diagonal complex matrix , 2000 .

[238]  Patrick Amestoy,et al.  A Fully Asynchronous Multifrontal Solver Using Distributed Dynamic Scheduling , 2001, SIAM J. Matrix Anal. Appl..

[239]  Klaus Stüben,et al.  Parallel algebraic multigrid based on subdomain blocking , 2001, Parallel Comput..

[240]  Edmond Chow,et al.  Parallel Implementation and Practical Use of Sparse Approximate Inverse Preconditioners with a Priori Sparsity Patterns , 2001, Int. J. High Perform. Comput. Appl..

[241]  Alex Pothen,et al.  A Scalable Parallel Algorithm for Incomplete Factor Preconditioning , 2000, SIAM J. Sci. Comput..

[242]  Eric F Darve.  The Fast Multipole Method , 2000 .

[243]  Erard Meurant,et al.  NUMERICAL EXPERIMENTS WITH ALGEBRAIC MULTILEVEL PRECONDITIONERS , 2001 .

[244]  Robert Bridson,et al.  Multiresolution Approximate Inverse Preconditioners , 2001, SIAM J. Sci. Comput..

[245]  K. St.  A review of algebraic multigrid , 2001 .

[246]  Henk A. van der Vorst,et al.  Parallel incomplete factorizations with pseudo-overlapped subdomains , 2001, Parallel Comput..

[247]  J. C. Diaz,et al.  Incomplete Multilevel Cholesky Factorizations , 2001, SIAM J. Matrix Anal. Appl..

[248]  Alex Pothen,et al.  New Sequential and Scalable Parallel Algorithms for Incomplete Factor Preconditioning , 2001 .

[249]  Robert Bridson,et al.  A Structural Diagnosis of Some IC Orderings , 2000, SIAM J. Sci. Comput..

[250]  Ke Chen.  An Analysis of Sparse Approximate Inverse Preconditioners for Boundary Integral Equations , 2001, SIAM J. Matrix Anal. Appl..

[251]  Owe Axelsson,et al.  Generalized Augmented Matrix Preconditioning Approach and its Application to Iterative Solution of Ill-Conditioned Algebraic Systems , 2000, SIAM J. Matrix Anal. Appl..

[252]  Iain S. Duff,et al.  On Algorithms For Permuting Large Entries to the Diagonal of a Sparse Matrix , 2000, SIAM J. Matrix Anal. Appl..

[253]  Luca Bergamaschi,et al.  Parallel preconditioning of a sparse eigensolver , 2001, Parallel Comput..

[254]  Daniel B. Szyld,et al.  FQMR: A Flexible Quasi-Minimal Residual Method with Inexact Preconditioning , 2001, SIAM J. Sci. Comput..

[255]  O. Yu. Milyukova,et al.  Parallel approximate factorization method for solving discrete elliptic equations , 2001, Parallel Comput..

[256]  A. Yu. Yeremin,et al.  A robust AINV-type method for constructing sparse approximate inverse preconditioners in factored form , 2001 .

[257]  Mardochée Magolu monga Made,et al.  Incomplete factorization-based preconditionings for solving the Helmholtz equation , 2001 .

[258]  S. A. Kharchenko,et al.  A robust AINV-type method for constructing sparse approximate inverse preconditioners in factored form , 2001, Numer. Linear Algebra Appl..

[259]  Mourad Heniche,et al.  Efficient ILU preconditioning and inexact‐Newton‐GMRES to solve the 2D steady shallow water equations , 2001 .

[260]  Matthias Bollhöfer,et al.  A robust ILU with pivoting based on monitoring the growth of the inverse factors , 2001 .

[261]  R. Kouhia,et al.  Stabilized and block approximate inverse preconditioners for problems in solid and structural mechanics , 2001 .

[262]  Arnold Reusken,et al.  Robust Parallel Smoothing for Multigrid Via Sparse Approximate Inverses , 2001, SIAM J. Sci. Comput..

[263]  Jun Zhang,et al.  A Multilevel Dual Reordering Strategy for Robust Incomplete LU Factorization of Indefinite Matrices , 2000, SIAM J. Matrix Anal. Appl..

[264]  Yousef Saad,et al.  On the Relations between ILUs and Factored Approximate Inverses , 2002, SIAM J. Matrix Anal. Appl..

[265]  Yousef Saad,et al.  ARMS: an algebraic recursive multilevel solver for general sparse linear systems , 2002, Numer. Linear Algebra Appl..

[266]  R. K. Smith,et al.  An Algebraic Multilevel Multigraph Algorithm , 2001, SIAM J. Sci. Comput..

[267]  Volker Mehrmann,et al.  Algebraic Multilevel Methods and Sparse Approximate Inverses , 2002, SIAM J. Matrix Anal. Appl..

[268]  M. Benzi,et al.  A parallel solver for large-scale Markov chains , 2002 .

[269]  Yousef Saad,et al.  A Factored Approximate Inverse Preconditioner with Pivoting , 2001, SIAM J. Matrix Anal. Appl..

[270]  Igor E. Kaporin,et al.  A parallel block overlap preconditioning with inexact submatrix inversion for linear elasticity problems , 2002, Numer. Linear Algebra Appl..

[271]  V. E. Henson,et al.  BoomerAMG: a parallel algebraic multigrid solver and preconditioner , 2002 .

[272]  Yousef Saad,et al.  Finding Exact and Approximate Block Structures for ILU Preconditioning , 2002, SIAM J. Sci. Comput..

[273]  M. Benzi,et al.  A robust incomplete factorization preconditioner for positive definite matrices , 2003, Numer. Linear Algebra Appl..

[274]  J. S. WARSA,et al.  Solution ofthe Discontinuous P1 Equations in Two-Dimensional Cartesian Geometry with Two-Level Preconditioning , 2002, SIAM J. Sci. Comput..

[275]  Matthias Bollhöfer,et al.  A Robust and Efficient ILU that Incorporates the Growth of the Inverse Triangular Factors , 2003, SIAM J. Sci. Comput..

[276]  D. Chen,et al.  VAIDYA'S PRECONDITIONERS: IMPLEMENTATION AND EXPERIMENTAL STUDY , 2003 .

[277]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[278]  Cornelis Vuik,et al.  On a Class of Preconditioners for Solving the Helmholtz Equation , 2003 .

[279]  Masha Sosonkina,et al.  pARMS: a parallel version of the algebraic recursive multilevel solver , 2003, Numer. Linear Algebra Appl..

[280]  Mardochée Magolu monga Made,et al.  Experimental comparison of three-dimensional point and line modified incomplete factorizations , 2004, Numerical Algorithms.

[281]  Gerard L. G. Sleijpen,et al.  Exploiting Multilevel Preconditioning Techniques in Eigenvalue Computations , 2003, SIAM J. Sci. Comput..

[282]  Gérard Meurant,et al.  A Multilevel AINV Preconditioner , 2002, Numerical Algorithms.

[283]  Thomas Huckle.  Factorized Sparse Approximate Inverses for Preconditioning , 2004, The Journal of Supercomputing.

[284]  Sivan Toledo,et al.  Maximum‐weight‐basis preconditioners , 2004, Numer. Linear Algebra Appl..

[285]  Guillaume Alléon,et al.  Sparse approximate inverse preconditioning for dense linear systems arising in computational electromagnetics , 1997, Numerical Algorithms.

[286]  Activity Report of the Parallel Algorithms Project at Cerfacs , 2022 .