Parallel Randomized and Matrix-Free Direct Solvers for Large Structured Dense Linear Systems

We design efficient and distributed-memory parallel randomized direct solvers for large structured dense linear systems, including a fully matrix-free version based on matrix-vector multiplications and a partially matrix-free one. The dense coefficient matrix $A$ has an off-diagonal low-rank structure, as often encountered in practical applications such as Toeplitz systems and discretized integral and partial differential equations. A distributed-memory parallel framework for randomized structured solution is shown. Scalable adaptive randomized sampling and hierarchical compression algorithms are designed to approximate $A$ by hierarchically semiseparable (HSS) matrices. Systematic process grid storage schemes are given for different HSS forms. Parallel hierarchical algorithms are proposed for the resulting HSS forms. As compared with existing work on parallel HSS methods, our algorithms have several remarkable advantages, including the matrix-free schemes that avoid directly using dense $A$, a synchroniz...

[1]  W. Hackbusch,et al.  Introduction to Hierarchical Matrices with Applications , 2003 .

[2]  Ming Gu,et al.  Efficient Algorithms for Computing a Strong Rank-Revealing QR Factorization , 1996, SIAM J. Sci. Comput..

[3]  Jianlin Xia,et al.  On the Complexity of Some Hierarchical Structured Matrix Algorithms , 2012, SIAM J. Matrix Anal. Appl..

[4]  B. Uscinski,et al.  The multiple scattering of waves in irregular media. II. Spatial autocorrelation functions , 1968, Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences.

[5]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[6]  V. Rokhlin,et al.  A fast randomized algorithm for the approximation of matrices ✩ , 2007 .

[7]  Jianlin Xia,et al.  Massively parallel structured multifrontal solver for time-harmonic elastic waves in 3-D anisotropic media , 2012 .

[8]  Jianlin Xia,et al.  Efficient Scalable Algorithms for Solving Dense Linear Systems with Hierarchically Semiseparable Structures , 2013, SIAM J. Sci. Comput..

[9]  Steffen Börm,et al.  Data-sparse Approximation by Adaptive ℋ2-Matrices , 2002, Computing.

[10]  C. Chui,et al.  Article in Press Applied and Computational Harmonic Analysis a Randomized Algorithm for the Decomposition of Matrices , 2022 .

[11]  Eugene E. Tyrtyshnikov,et al.  Incomplete Cross Approximation in the Mosaic-Skeleton Method , 2000, Computing.

[12]  Jianlin Xia,et al.  On the Stability of Some Hierarchical Rank Structured Matrix Algorithms , 2016, SIAM J. Matrix Anal. Appl..

[13]  Shivkumar Chandrasekaran,et al.  A Fast ULV Decomposition Solver for Hierarchically Semiseparable Representations , 2006, SIAM J. Matrix Anal. Appl..

[14]  Jr. Harold Page Starr.  On the numerical solution of one-dimensional integral and differential equations , 1992 .

[15]  Fast Structured Direct Spectral Methods for Differential Equations with Variable Coefficients, I. The One-Dimensional Case , 2016, SIAM J. Sci. Comput..

[16]  Jianlin Xia,et al.  Fast algorithms for hierarchically semiseparable matrices , 2010, Numer. Linear Algebra Appl..

[17]  Leslie Greengard,et al.  A fast algorithm for particle simulations , 1987 .

[18]  L. Foldy,et al.  The Multiple Scattering of Waves. I. General Theory of Isotropic Scattering by Randomly Distributed Scatterers , 1945 .

[19]  Per-Gunnar Martinsson,et al.  Randomized algorithms for the low-rank approximation of matrices , 2007, Proceedings of the National Academy of Sciences.

[20]  Miguel Moscoso,et al.  Imaging Strong Localized Scatterers with Sparsity Promoting Optimization , 2013, SIAM J. Imaging Sci..

[21]  Per-Gunnar Martinsson,et al.  A Fast Randomized Algorithm for Computing a Hierarchically Semiseparable Representation of a Matrix , 2011, SIAM J. Matrix Anal. Appl..

[22]  I. Gohberg,et al.  On a new class of structured matrices , 1999 .

[23]  Raymond H. Chan,et al.  A Fast Randomized Eigensolver with Structured LDL Factorization Update , 2014, SIAM J. Matrix Anal. Appl..

[24]  Alle-Jan van der Veen,et al.  Some Fast Algorithms for Sequentially Semiseparable Representations , 2005, SIAM J. Matrix Anal. Appl..

[25]  Jianlin Xia,et al.  Effective matrix-free preconditioning for the augmented immersed interface method , 2015, J. Comput. Phys..

[26]  Jianlin Xia,et al.  Superfast and Stable Structured Solvers for Toeplitz Least Squares via Randomized Sampling , 2014, SIAM J. Matrix Anal. Appl..

[27]  Lexing Ying,et al.  Fast construction of hierarchical matrix representation from matrix-vector multiplication , 2009, J. Comput. Phys..

[28]  Jianlin Xia,et al.  Randomized Sparse Direct Solvers , 2013, SIAM J. Matrix Anal. Appl..

[29]  W. Hackbusch,et al.  An introduction to hierarchical matrices , 2001 .

[30]  Jianlin Xia,et al.  Superfast Multifrontal Method for Large Structured Linear Systems of Equations , 2009, SIAM J. Matrix Anal. Appl..

[31]  R. Coifman,et al.  The fast multipole method for the wave equation: a pedestrian prescription , 1993, IEEE Antennas and Propagation Magazine.

[32]  Jianlin Xia,et al.  A Superfast Structured Solver for Toeplitz Linear Systems via Randomized Sampling , 2012, SIAM J. Matrix Anal. Appl..