Language Constructs for Data Partitioning and Distribution

This article presents a survey of language features for distributed memory multiprocessor systems (DMMs), in particular, systems that provide features for data partitioning and distribution. In these systems the programmer is freed from consideration of the low-level details of the target architecture in that there is no need to program explicit processes or specify interprocess communication. Programs are written according to the shared memory programming paradigm but the programmer is required to specify, by means of directives, additional syntax or interactive methods, how the data of the program are decomposed and distributed.

[1]  Jean-Louis Pazat,et al.  Pandore: a system to manage data distribution , 1990, ICS '90.

[2]  Henk Sips,et al.  Booster : a high-level language for portable parallel algorithms , 1991 .

[3]  Siegfried Benkner,et al.  Vienna Fortran 90 , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[4]  Nicholas Carriero,et al.  Distributed data structures in Linda , 1986, POPL '86.

[5]  Hans P. Zima,et al.  Compiling for distributed-memory systems , 1993 .

[6]  John H. Merlin,et al.  Techniques for the Automatic Parallelisation of `Distributed Fortran 90 , 1992 .

[7]  Barbara M. Chapman,et al.  Programming in Vienna Fortran , 1992, Sci. Program..

[8]  Bobby Schnabel,et al.  An Overview of Dino - A New Language for Numerical Computation on Distributed Memory Multiprocessors , 1987, PPSC.

[9]  John H. Merlin,et al.  ADAPTing Fortran 90 Array Programs for Distributed Memory Architectures , 1991, ACPC.

[10]  Harry Berryman,et al.  A manual for PARTI runtime primitives , 1990 .

[11]  P.-S. Tseng.  A parallelizing compiler for distributed memory parallel computers , 1989, PLDI 1989.

[12]  Charles Koelbel,et al.  Supporting shared data structures on distributed memory architectures , 1990, PPOPP '90.

[13]  Charles Koelbel,et al.  Semi-Automatic Domain Decomposition in BLAZE , 1987, ICPP.

[14]  M. Baber.  Hypertasking Support for Dynamically Redistributable and Resizeable Arrays on the iPSC , 1991, The Sixth Distributed Memory Computing Conference, 1991. Proceedings.

[15]  Piyush Mehrotra,et al.  Vienna Fortran—a Fortran language extension for distributed memory multiprocessors , 1992 .

[16]  Charles Koelbel,et al.  Compiling Global Name-Space Parallel Loops for Distributed Execution , 1991, IEEE Trans. Parallel Distributed Syst..

[17]  Michael Gerndt,et al.  Automatic parallelization for distributed-memory multiprocessing systems , 1989 .

[18]  Jingke Li,et al.  Index domain alignment: minimizing cost of cross-referencing between distributed arrays , 1990, [1990 Proceedings] The Third Symposium on the Frontiers of Massively Parallel Computation.

[19]  Anne Rogers,et al.  Process decomposition through locality of reference , 1989, PLDI '89.

[20]  Thomas Rauber,et al.  Automatic Parallelization for Distributed Memory Multiprocessors , 1994, Automatic Parallelization.

[21]  Ken Kennedy,et al.  Computer support for machine-independent parallel programming in Fortran D , 1992 .

[22]  Mary E. Mace.  Memory storage patterns in parallel processing , 1987, The Kluwer international series in engineering and computer science.

[23]  Jean-Louis Pazat,et al.  Compiling sequential programs for distributed memory parallel computers with Pandore II , 1993 .

[24]  Rice UniversityCORPORATE,et al.  High performance Fortran language specification , 1993 .

[25]  Marco Annaratone,et al.  Parallelization of FORTRAN code on distributed-memory parallel processors , 1990, ICS '90.

[26]  Geoffrey C. Fox,et al.  An Automatic and Symbolic Parallelization System for Distributed Memory Parallel Computers , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..

[27]  David B. Loveman.  High performance Fortran , 1993, IEEE Parallel & Distributed Technology: Systems & Applications.

[28]  Piyush Mehrotra,et al.  The BLAZE language: A parallel language for scientific programming , 1987, Parallel Comput..

[29]  Ken Kennedy,et al.  Compiler optimizations for Fortran D on MIMD distributed-memory machines , 1991, Proceedings of the 1991 ACM/IEEE Conference on Supercomputing (Supercomputing '91).

[30]  Anne Rogers,et al.  1 Compiling Devices : Locality in a TMS , 2022 .

[31]  E.M.R.M. Paalvast,et al.  Programming for Parallelism and Compiling for Efficiency , 1992 .

[32]  Philip J. Hatcher,et al.  Data-Parallel Programming on MIMD Computers , 1991, IEEE Trans. Parallel Distributed Syst..

[33]  Ken Kennedy,et al.  An Overview of the Fortran D Programming System , 1991, LCPC.

[34]  Thomas Fahringer,et al.  Automatic performance prediction to support parallelization of Fortran programs for massively parallel systems , 1992, ICS '92.

[35]  Michael Gerndt,et al.  SUPERB: A tool for semi-automatic MIMD/SIMD parallelization , 1988, Parallel Comput..

[36]  Marina C. Chen,et al.  Compiling Communication-Efficient Programs for Massively Parallel Machines , 1991, IEEE Trans. Parallel Distributed Syst..

[37]  Peter Brezany,et al.  Vienna Fortran - A Language Specification. Version 1.1 , 1992 .

[38]  Nicholas Carriero,et al.  How to write parallel programs - a first course , 1990 .

[39]  Harry Berryman,et al.  Distributed Memory Compiler Design for Sparse Problems , 1995, IEEE Trans. Computers.

[40]  Alan H. Karp,et al.  Programming for Parallelism , 1987, Computer.

[41]  F. Andre,et al.  Data Distribution in Pandor , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..