The "Annai" environment for portable distributed parallel programming

We are developing a portable integrated tool environment, called "Annai", for distributed memory parallel processors (DMPPs), as part of the joint CSCS-ETH/NEC collaboration in parallel processing. As we design and implement a sequence of tool prototypes, these are used and evaluated by a team of application developers. This close interaction allows rapid feedback, as requests from the application developers for functionality enhancements can be promptly considered for inclusion in future tool designs and prototypes. Our tool environment consists of an extended High Performance Fortran (HPF) compiler, a performance monitor and analyzer and a source-level debugger for distributed programs, all sharing a common user interface. The recently-defined Message Passing Interface (MPI) serves as our low-level machine interface and allows portability independent of the target hardware architecture. The key features of the tool environment comprise HPF language extensions to allow dynamic data distributions, and support for both high-level data-parallel and low-level message-passing programming paradigms by the interactive debugger and the interactive performance monitor and analyzer. The language extensions are particularly useful for the efficient parallelization of unstructured problems, and they are fully supported by both the debugger and the performance analyzer. We outline the structure of the tool environment, and summarize the functionality of its components. We also demonstrate an example user session and present performance results on two DMPPs.<<ETX>>

[1]  Roland Rühl,et al.  Migration of Vectorized Iterative Solvers to Distributed-Memory Architectures , 1996, SIAM J. Sci. Comput..

[2]  Subhash Saini,et al.  NAS Parallel Benchmarks Results 3-95 , 1995 .

[3]  Message P Forum,et al.  MPI: A Message-Passing Interface Standard , 1994 .

[4]  Rice UniversityCORPORATE,et al.  High performance Fortran language specification , 1993 .

[5]  Barton P. Miller,et al.  Optimal tracing and replay for debugging message-passing parallel programs , 1992, Proceedings Supercomputing '92.

[6]  David H. Bailey,et al.  NAS parallel benchmark results , 1992, Proceedings Supercomputing '92.

[7]  Michael Gerndt,et al.  Intel Paragon XP/S - Architecture, Software Environment, and Performance , 1994 .

[8]  Roland Rühl A parallelizing compiler for distributed memory parallel processors , 1992 .

[9]  Don Allen,et al.  Data Visualization and Performance Analysis in the Prism Programming Environment , 1992, Programming Environments for Parallel Computing.

[10]  C. M. Pancake Transportable programs for parallel and heterogeneous systems , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[11]  Michael T. Heath,et al.  Visualizing the performance of parallel programs , 1991, IEEE Software.

[12]  Harry Berryman,et al.  Execution time support for adaptive scientific algorithms on distributed memory machines , 1991, Concurr. Pract. Exp..

[13]  Message Passing Interface Forum MPI: A message - passing interface standard , 1994 .

[14]  Roland Rühl A parallelizing compiler for distributed memory parallel processors , 1992 .