A Survey of Models of Parallel

Serial computing's popularity can be attributed to the von Neumann model providing a single, general model of serial computation. This has led to portability, predictability and programmability in serial computation. However, there is no such single model in parallel computation. Rather, numerous models abound with some being more popular than others, but there is as yet no clear leader. This survey presents several such candidate models of parallel computation. Each of the surveyed models is described and criticised, and assessed as to how it satisses a series of requirements for a model of parallel computation. This report came about as a result of lecturing undertaken by the author in the area of models of parallel computation. It attempts to provide an introduction to the area and a justiication of its study, along with a survey of numerous key models.

[1]  G. Harcos,et al.  The Institute for Advanced Study , 1933, Nature.

[2]  A. Turing.  On Computable Numbers, with an Application to the Entscheidungsproblem. , 1937 .

[3]  C. Lanczos,et al.  Some improvements in practical Fourier analysis and their application to x-ray scattering from liquids , 1942 .

[4]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[5]  Richard P. Brent,et al.  The Parallel Evaluation of General Arithmetic Expressions , 1974, JACM.

[6]  Steven Fortune,et al.  Parallelism in random access machines , 1978, STOC.

[7]  Mihalis Yannakakis,et al.  Towards an architecture-independent analysis of parallel algorithms , 1990, STOC '88.

[8]  Herman H. Goldstine,et al.  Preliminary discussion of the logical design of an electronic computing instrument (1946) , 1989 .

[9]  Richard S. Bird,et al.  Lectures on Constructive Functional Programming , 1989 .

[10]  Phillip B. Gibbons.  A more practical PRAM model , 1989, SPAA '89.

[11]  Alok Aggarwal,et al.  On communication latency in PRAM computations , 1989, SPAA '89.

[12]  Richard Cole,et al.  The APRAM: incorporating asynchrony into the PRAM model , 1989, SPAA '89.

[13]  David B. Skillicorn,et al.  Architecture-independent parallel computation , 1990, Computer.

[14]  Leslie G. Valiant,et al.  A bridging model for parallel computation , 1990, CACM.

[15]  Guy E. Blelloch,et al.  Vector Models for Data-Parallel Computing , 1990 .

[16]  Clyde P. Kruskal,et al.  Towards a single model of efficient computation in real parallel machines , 1991, Future Gener. Comput. Syst..

[17]  David B. Skillicorn,et al.  Parallelism and the Bird-Meertens Formalism , 1992 .

[18]  Sanjay Ranka,et al.  A Practical Hierarchical Model of Parallel Computation. II. Binary Tree and FFT Algorithms , 1992, J. Parallel Distributed Comput..

[19]  Sanjay Ranka,et al.  A Practical Hierarchical Model of Parallel Computation. I. The Model , 1992, J. Parallel Distributed Comput..

[20]  Seth Copen Goldstein,et al.  Active Messages: A Mechanism for Integrated Communication and Computation , 1992, [1992] Proceedings the 19th Annual International Symposium on Computer Architecture.

[21]  Alexander V. Shafarenko,et al.  F-Code and its Implementation: A Portable Software Platform for Data Parallelism , 1993, Comput. J..

[22]  Wolfgang J. Paul,et al.  On the Physical Design of PRAMs , 1992, Comput. J..

[23]  John von Neumann,et al.  First draft of a report on the EDVAC , 1993, IEEE Annals of the History of Computing.

[24]  W. F. McColl,et al.  General purpose parallel computing , 1993 .

[25]  R. Karp,et al.  LogP: towards a realistic model of parallel computation , 1993, PPOPP '93.

[26]  David B. Skillicorn,et al.  Deriving Parallel Programs from specification Susing Cost Information , 1993, Sci. Comput. Program..

[27]  David B. Skillicorn,et al.  The Bird-Meertens Formalism as a Parallel Model , 1993 .

[28]  Tim J. Harris,et al.  A survey of PRAM simulation techniques , 1994, CSUR.

[30]  David B. Skillicorn,et al.  Data Parallel Geometric Operations on Lists , 1995, Parallel Comput..

[31]  Wentong Cai,et al.  A Cost Calculus for Parallel Functional Programming , 1995, J. Parallel Distributed Comput..

[33]  Further Results with Algorithmic Skeletons for the CLUMPS Model of Parallel Computation , 1996 .

[34]  Martin Dyer,et al.  Scalable and portable computing using the WPRAM model , 1997 .

[35]  Yossi Matias,et al.  The Queue-Read Queue-Write PRAM Model: Accounting for Contention in Parallel Algorithms , 1999, SIAM J. Comput..