On the prediction of master-slave algorithms over heterogeneous clusters

We study the performance of master-slave algorithms on heterogeneous networks. The word heterogeneity refers here to both the processing and communication capabilities. Following an inductive approach, we derive a formula that predicts the performance for the general case. The computational results carried out on a heterogeneous cluster of PCs prove the effectiveness of the approach and the accuracy of the predictions. The numerical minimization of this function provides an efficient approach for an optimal distribution of the work.

[1]  Jack J. Dongarra,et al.  A Portable Programming Interface for Performance Evaluation on Modern Processors , 2000, Int. J. High Perform. Comput. Appl..

[2]  Yves Robert,et al.  The Master-Slave Paradigm with Heterogeneous Processors , 2001, CLUSTER.

[3]  A. Marcela Printista,et al.  A tool for performance modeling of parallel programs , 2003, Sci. Program..

[4]  Michael Goldsmith,et al.  Programming in occam 2 , 1985, Prentice Hall international series in computer science.

[5]  Dhabaleswar K. Panda,et al.  Communication modeling of heterogeneous networks of workstations for performance characterization of collective operations , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[6]  Francisco Almeida,et al.  Prediction of parallel algorithms performance on bus-based networks using PVM , 1998, Proceedings of the Sixth Euromicro Workshop on Parallel and Distributed Processing - PDP '98 -.

[7]  Pawel Wolniewicz,et al.  Experiments with Scheduling Divisible Tasks in Clusters of Workstations , 2000, Euro-Par.