Programming Research Group Primitive Operations on the Bsp Model Primitive Operations on the Bsp Model

The design of a complex algorithm relies heavily on a set of primitive operations and the instruments required to compile these operations into an algorithm. In this work, we examine some of these basic primitive operations and present algorithms that are suitable for the Bulk-Synchronous Parallel model. In particular, we consider algorithms for the following primitive operations: broadcasting, parallel-preex, merging, generalized and integer sorting. While our algorithms are fairly simple themselves, description of their performance in terms of the BSP parameters is somewhat complicated. The main reward for quantifying these complications, is that it enables software to be written once and for all that can be migrated eeciently among a variety of parallel machines.

[1]  Uzi Vishkin,et al.  Finding the Maximum, Merging, and Sorting in a Parallel Computation Model , 1981, J. Algorithms.

[2]  F. Leighton,et al.  Introduction to Parallel Algorithms and Architectures: Arrays, Trees, Hypercubes , 1991 .

[3]  W. F. McColl,et al.  General purpose parallel computing , 1993 .

[4]  Leslie G. Valiant,et al.  A Combining Mechanism for Parallel Computers , 1992, Heinz Nixdorf Symposium.

[5]  Sartaj Sahni,et al.  Parallel permutation and sorting algorithms and a new generalized connection network , 1982, JACM.

[6]  Guy E. Blelloch,et al.  Scans as Primitive Parallel Operations , 1989, ICPP.

[7]  Leslie G. Valiant,et al.  General Purpose Parallel Architectures , 1991, Handbook of Theoretical Computer Science, Volume A: Algorithms and Complexity.

[8]  Torben Hagerup,et al.  Optimal Merging and Sorting on the Erew Pram , 1989, Inf. Process. Lett..

[9]  Kenneth E. Batcher,et al.  Sorting networks and their applications , 1968, AFIPS Spring Joint Computing Conference.

[10]  William F. McColl,et al.  Scalable Parallel Computing: A Grand Unified Theory and its Practical Development , 1994, IFIP Congress.

[11]  Richard M. Karp,et al.  Parallel sorting with limited bandwidth , 1995, SPAA '95.

[12]  Leslie G. Valiant,et al.  Direct Bulk-Synchronous Parallel Algorithms , 1992, J. Parallel Distributed Comput..

[13]  Constantinos J. SiniolakisPRG,et al.  Concurrent Heaps on the BSP Model , 1996 .

[14]  Donald E. Knuth,et al.  The Art of Computer Programming: Volume 3: Sorting and Searching , 1998 .

[15]  Sanguthevar Rajasekaran,et al.  Optimal and Sublogarithmic Time Randomized Parallel Sorting Algorithms , 1989, SIAM J. Comput..

[16]  Ben H. H. Juurlink,et al.  Communication Primitives for BSP Computers , 1996, Inf. Process. Lett..

[17]  Leslie G. Valiant,et al.  A bridging model for parallel computation , 1990, CACM.

[18]  Gérard M. Baudet,et al.  Optimal Sorting Algorithms for Parallel Computers , 1978, IEEE Transactions on Computers.

[19]  Alexandros V. Gerbessiotis,et al.  Deterministic sorting and randomized median finding on the BSP model , 1996, SPAA '96.