sparse Matrix Computations on the Hypercube and Related Networks

In this paper we present some parallel algorithms for matrix addition, matrix multiplication, Gaussian elimination, and other related computations on sparse matrices. Our algorithms are designed for the hypercube and related networks, but they can be easily implemented on any other local memory machine. We prove that, under certain assumptions, on a hypercube or related network with p processors our algorithms achieve a speedup proportional to p/log p.

[1]  Sergio Pissanetzky,et al.  Sparse Matrix Technology , 1984 .

[2]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[3]  Michael T. Heath,et al.  Parallel Algorithms for Sparse Linear Systems , 1991, SIAM Rev..

[4]  F. Leighton,et al.  Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes , 1991 .

[5]  Joel H. Saltz,et al.  Aggregation Methods for Solving Sparse Triangular Systems on Multiprocessors , 1990, SIAM J. Sci. Comput..

[6]  Rami G. Melhem,et al.  Parallel solution of linear systems with striped sparse matrices , 1988, Parallel Comput..

[7]  Iain S. Duff,et al.  Parallel implementation of multifrontal schemes , 1986, Parallel Comput..

[8]  Alan George,et al.  Communication results for parallel sparse Cholesky factorization on a hypercube , 1989, Parallel Comput..

[9]  Michael T. Heath,et al.  Sparse Cholesky factorization on a local-memory multiprocessor , 1988 .

[10]  Gita Alaghband.  Parallel pivoting combined with parallel reduction and fill-in control , 1989, Parallel Comput..

[11]  Michael T. Heath,et al.  Symbolic Cholesky factorization on a local-memory multiprocessor , 1987, Parallel Comput..

[12]  Giovanni Manzini.  Large Sorting and Routing Problems on the Hypercube and Related Networks , 1991, Parallel Process. Lett..

[13]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[14]  Larry Rudolph,et al.  Techniques for Parallel Manipulation of Sparse Matrices , 1989, Theor. Comput. Sci..

[15]  Yousef Saad,et al.  Solving Sparse Triangular Linear Systems on Parallel Computers , 1989, Int. J. High Speed Comput..

[16]  T. Davis,et al.  A nondeterministic parallel algorithm for general unsymmetric sparse lu factorization , 1990 .

[17]  Alan George,et al.  Parallel sparse Gaussian elimination with partial pivoting , 1990 .

[18]  Z. Zlatev.  On Some Pivotal Strategies in Gaussian Elimination by Sparse Technique , 1980 .

[19]  Selim G. Akl,et al.  Parallel Sorting Algorithms , 1985 .