A Partitioning Strategy for Nonuniform Problems on Multiprocessors

We consider the partitioning of a problem on a domain with unequal work estimates in different subdomains in a way that balances the workload across multiple processors. Such a problem arises for example in solving partial differential equations using an adaptive method that places extra grid points in certain subregions of the domain. We use a binary decomposition of the domain to partition it into rectangles requiring equal computational effort. We then study the communication costs of mapping this partitioning onto different multiprocessors: a mesh- connected array, a tree machine, and a hypercube. The communication cost expressions can be used to determine the optimal depth of the above partitioning.

[1]  Dennis Gannon,et al.  Parallel Architectures for Iterative Methods on Adaptive, Block Structured Grids , 1984 .

[2]  Abraham Waksman,et al.  A Permutation Network , 1968, JACM.

[3]  H. F. Jordan,et al.  Is SOR Color-Blind? , 1986 .

[4]  M. Berger,et al.  Adaptive mesh refinement for hyperbolic partial differential equations , 1982 .

[5]  S. McCormick,et al.  The fast adaptive composite grid (FAC) method for elliptic equation , 1986 .

[6]  Christos H. Papadimitriou,et al.  A Communication-Time Tradeoff , 1984, FOCS.

[7]  Narsingh Deo,et al.  Graph Theory with Applications to Engineering and Computer Science , 1975, Networks.

[8]  Achi Brandt,et al.  Local mesh refinement multilevel techniques , 1987 .

[9]  Christos H. Papadimitriou,et al.  A Communication-Time Tradeoff , 1987, SIAM J. Comput..

[10]  S. B. Baden.  DYNAMIC LOAD BALANCING OF A VORTEX CALCULATION RUNNING ON MULTIPROCESSORS , 1986 .

[11]  Jon Louis Bentley,et al.  Multidimensional divide-and-conquer , 1980, CACM.

[12]  Ralph Grishman,et al.  The NYU Ultracomputer—Designing an MIMD Shared Memory Parallel Computer , 1983, IEEE Transactions on Computers.

[13]  M. Berger,et al.  Automatic adaptive grid refinement for the Euler equations , 1985 .

[14]  William Gropp,et al.  Local uniform mesh refinement on loosely-coupled parallel processors☆ , 1988 .

[15]  Pamela Zave,et al.  Design of an Adaptive, Parallel Finite-Element System , 1979, TOMS.

[16]  John Roger Van Rosendale.  Rapid solution of finite-element equations on locally refined grids by multi-level methods , 1980 .

[17]  H. F. Jordan.  A Special Purpose Architecture for Finite Element Analysis , 1978 .

[18]  Kevin P. McAuliffe,et al.  The IBM Research Parallel Processor Prototype (RP3): Introduction and Architecture , 1985, ICPP.

[19]  Shahid H. Bokhari,et al.  On the Mapping Problem , 1981, IEEE Transactions on Computers.