Parallel computations on the CHARM heterogeneous workstation cluster

In recent years parallel computing on a fast network of high performance and low cost workstations has become a viable and an economic option, compared to that on an expensive high performance parallel supercomputer for solving large Grand Challenge scientific problems. This paper focuses on how to efficiently exploit the computing resources of a set of heterogeneous Unix workstations. We have further developed the CHARM parallel programming environment to allow programs written in the CHARM language execute adjacently on such a cluster. We have also developed a new scheme to schedule tasks statically and balance the load dynamically to achieve high effective utilization. Performance results for several applications programs including ray-tracing, all-pairs shortest path, and matrix multiply on a heterogeneous cluster of Sun Sparcs, IBM RS/6000s and HP-PA 7100s show a significant improvement in execution time over sequential execution.<<ETX>>

[1]  Willy Zwaenepoel,et al.  The distributed V kernel and its performance for diskless workstations , 1983, SOSP '83.

[2]  Volker Strumpen,et al.  The Parform - A High Performance Platform for Parallel Computation ina Distributed Workstation Environment , 1992 .

[3]  Vaidy S. Sunderam,et al.  PVM: A Framework for Parallel Distributed Computing , 1990, Concurr. Pract. Exp..

[4]  Michael J. Quinn,et al.  Data-parallel programming on a network of heterogeneous workstations , 1992, Proceedings of the First International Symposium on High-Performance Distributed Computing. (HPDC-1).

[5]  Henri E. Bal,et al.  Programming a distributed system using shared objects , 1993, [1993] Proceedings The 2nd International Symposium on High Performance Distributed Computing.

[6]  Laxmikant V. Kalé,et al.  Supporting Machine Independent Programming on Diverse Parallel Architectures , 1991, ICPP.

[7]  Peter Steenkiste,et al.  Automatic generation of parallel programs with dynamic load balancing , 1994, Proceedings of 3rd IEEE International Symposium on High Performance Distributed Computing.

[8]  Bu-Sung Lee,et al.  Dynamic Load Balancing in a Message Passing Virtual Parallel Machine Dynamic Load Balancing in a Message Passing Virtual Parallel Machine , 1995 .

[9]  Peter M. A. Sloot,et al.  A dynamic load balancing system for parallel cluster computing , 1996, Future Gener. Comput. Syst..

[10]  Robbert van Renesse,et al.  Experiences with the Amoeba distributed operating system , 1990, CACM.

[11]  Michael J. Quinn,et al.  Data-parallel programming on a network of heterogeneous workstations , 1993, Concurr. Pract. Exp..

[12]  Anthony P. Reeves,et al.  High performance computing on a cluster of workstations , 1992, Proceedings of the First International Symposium on High-Performance Distributed Computing. (HPDC-1).