An Implementation of A Parallel Iterative Algorithm for the Solution of Large Banded System on A Cluster of Workstations

Abstract In this paper, we present a parallel iterative solution for large banded systems of linear equations based on incomplete LU-factorization (ILU). A master—workers parallel computing scheme is used. The proposed algorithm incurs reduced storage and communication overhead as compared to previous methods. The reduction in communication overhead has been achieved by pipelining the inter-workers message passing and limiting the communication between master and workers to initial work distribution and final results collection. The performance of the proposed algorithm is evaluated analytically and experimentally using Parallel Virtual Machine (PVM) as a parallel programming environment on a cluster of Linux work-stations. The obtained performance results show that the proposed algorithm exhibits higher efficiency for coarse grain computations corresponding to large matrix sizes and reduced number of processors.

[1]  Cornelis Vuik,et al.  Parallelism in ILU-preconditioned GMRES , 1998, Parallel Comput..

[2]  David J. Kuck,et al.  Practical Parallel Band Triangular System Solvers , 1978, TOMS.

[3]  I. Duff,et al.  Direct Methods for Sparse Matrices , 1987 .

[4]  Henk A. van der Vorst,et al.  Developments and trends in the parallel solution of linear systems , 1999, Parallel Comput..

[5]  Beresford N. Parlett.  For tridiagonals T replace T with LDL t , 2000 .

[6]  Henk A. van der Vorst,et al.  Data transport in Wang's partition method , 1988, Parallel Comput..

[7]  P. Groen.  Base- p -cyclic reduction for tridiagonal systems of equations , 1991 .

[8]  Gundolf Haase.  Parallel Incomplete Cholesky Preconditioners Based on the Non-Overlapping Data Distribution , 1998, Parallel Comput..

[9]  Volker Mehrmann,et al.  Divide and Conquer Methods for Block Tridiagonal Systems , 1993, Parallel Comput..

[10]  H. H. Wang,et al.  A Parallel Method for Tridiagonal Equations , 1981, TOMS.

[11]  T. Ebisuzaki,et al.  Performance of Parallel Solution of a Block-Tridiagonal Linear System on Fujitsu VPP500 , 1998, Parallel Comput..

[12]  Jack J. Dongarra,et al.  Solving banded systems on a parallel processor , 1987, Parallel Comput..

[13]  Anthony T. Chronopoulos,et al.  Parallel Iterative S-Step Methods for Unsymmetric Linear Systems , 1996, Parallel Comput..

[14]  Harold S. Stone,et al.  Parallel Tridiagonal Equation Solvers , 1975, TOMS.

[15]  Swarn P. Kumar,et al.  Solving Tridiagonal Linear Systems On the Butterfly Parallel Computer , 1989, Int. J. High Perform. Comput. Appl..

[16]  Harold S. Stone,et al.  An Efficient Parallel Algorithm for the Solution of a Tridiagonal Linear System of Equations , 1973, JACM.

[17]  J.J.F.M. Schlichting,et al.  Solving bidiagonal systems of linear equations on the CDC CYBER 205 , 1987 .

[18]  S. P. Kumar,et al.  Parallel algorithms for recurrence and tridiagonal equations , 1985 .