Supporting Irregular and Dynamic Computations in Data Parallel Languages

Data parallel languages support a single instruction flow; the parallelism is expressed at the instruction level. Actually, data parallel languages have chosen arrays to support the parallelism. This regular data structure allows a natural development of regular parallel algorithms. The implementation of irregular algorithms necessitates a programming effort to project the irregular data structures onto regular structures. In this article we present the different techniques used to manage the irregularity in data parallel languages. Each of them will be illustrated with standard or experimental data parallel language constructions.

[1]  Siegfried Benkner.  Vienna Fortran 90 and its Compilation , 1994 .

[2]  P. Clermont,et al.  Handling and optimizing unstructured computations in data-parallel languages , 1992, A Workshop on Future Directions of Massively Parallel Processing, The New Frontiers.

[3]  Robert Schreiber.  An Introduction to HPF , 1996, The Data Parallel Programming Model.

[4]  Cyril Fonlupt.  Distribution dynamique de données sur machine SIMD , 1994 .

[5]  Robert S. Schreiber,et al.  Hpf-2 scope of activities and motivating applications , 1994 .

[6]  Peter Brezany,et al.  Vienna Fortran - A Language Specification. Version 1.1 , 1992 .

[7]  Cyril Fonlupt,et al.  Analysis of Synchronous Dynamic Load Balancing Algorithms , 1995, PARCO.

[8]  Andreas Müller,et al.  Extending high performance Fortran for the support of unstructured computations , 1995, ICS '95.

[9]  Thomas Bräunl.  Structured SIMD Programming in Parallaxis , 1989, Struct. Program..

[10]  E. D. Dahl,et al.  Mapping and Compiled Communication on the Connection Machine System , 1990, Proceedings of the Fifth Distributed Memory Computing Conference, 1990..

[11]  Barbara M. Chapman,et al.  New data-parallel language features for sparse matrix computations , 1995, Proceedings of 9th International Parallel Processing Symposium.

[12]  Barbara M. Chapman,et al.  Programming in Vienna Fortran , 1992, Sci. Program..

[13]  Barbara M. Chapman,et al.  Extending HPF for Advanced Data-Parallel Applications , 1994, IEEE Parallel & Distributed Technology: Systems & Applications.

[14]  Jean-Luc Dekeyser,et al.  A geometrical data-parallel language , 1994, SIGP.

[15]  Rice UniversityCORPORATE,et al.  High performance Fortran language specification , 1993 .

[16]  Massachusetts Cambridge,et al.  C"# language reference manual , 1991 .

[17]  Dominique Lazure.  Programmation géométrique à parallélisme de données : modèle, langage et compilation , 1995 .

[18]  Anthony J. G. Hey,et al.  An Introduction to High Performance Fortran , 1995, Sci. Program..