Non-uniform Partitioning of Finite Diierence Methods Running on Smp Clusters

A multicomputer or workstation cluster with multiprocessor nodes introduces signiicant need and opportunity for overlapping communication with computation. We evaluate partitioning strategies for an important application class, nite diierence methods, running on clusters of symmetric multiprocessors. Our results show that even for a regular, uniform nite diierence method, a non-uniform partitioning can give the best performance by judiciously overlapping communication and computation. We present an analytic performance model and experimental results to evaluate partitioning strategies, and discuss implications for SMP cluster programming models.

[1]  Paul R. Woodward Perspectives on Supercomputing: Three Decades of Change , 1996, Computer.

[2]  Ian T. Foster,et al.  The Nexus Approach to Integrating Multithreading and Communication , 1996, J. Parallel Distributed Comput..

[3]  Scott B. Baden,et al.  Flexible Communication Mechanisms for Dynamic Structured Applications , 1996, IRREGULAR.

[4]  E. L. Lusk,et al.  A taxonomy of programming models for symmetric multiprocessors and SMP clusters , 1995, Programming Models for Massively Parallel Computers.

[5]  Joel H. Saltz,et al.  An Integrated Runtime and Compile-Time Approach for Parallelizing Structured and Block Structured Applications , 1995, IEEE Trans. Parallel Distributed Syst..

[6]  V. Vatsa,et al.  An Integrated Runtime and Compile-time Approach for Parallelizing Structured and Block Structured Applications , 1995 .

[7]  Matthew Haines,et al.  On the design of Chant: a talking threads package , 1994, Proceedings of Supercomputing '94.

[8]  Fidelma M. Hayes,et al.  Design of the AlphaServer Multiprocessor Server Systems , 1994, Digit. Tech. J..

[9]  Ian Foster,et al.  Designing and building parallel programs , 1994 .

[10]  Message Passing Interface Forum MPI: A message - passing interface standard , 1994 .

[11]  A. Malony,et al.  Implementing a parallel C++ runtime system for scalable parallel systems , 1993, Supercomputing '93.

[12]  Dynamic data distributions in Vienna Fortran , 1993, Supercomputing '93. Proceedings.

[13]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).