A general framework to understand parallel performance in heterogeneous clusters: analysis of a new adaptive parallel genetic algorithm

This paper presents a general model to define, measure and predict the efficiency of applications running on heterogeneous parallel computer systems. Using this framework, it is possible to understand the influence that the heterogeneity of the hardware has on the efficiency of an algorithm. This methodology is used to compare an existing parallel genetic algorithm with a new adaptive parallel model. All the performance measurements were taken in a loosely coupled cluster of processors.

[1]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[2]  Yong Yan,et al.  Modeling and characterizing parallel computing performance on heterogeneous networks of workstations , 1995, Proceedings.Seventh IEEE Symposium on Parallel and Distributed Processing.

[3]  Enrique Alba,et al.  Improving flexibility and efficiency by adding parallelism to genetic algorithms , 2002, Stat. Comput..

[4]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[5]  Quinn Snell,et al.  Improving cluster utilization through set based allocation policies , 2001, Proceedings International Conference on Parallel Processing Workshops.

[6]  Michael J. Quinn,et al.  Designing Efficient Algorithms for Parallel Computers , 1987 .

[7]  박정우,et al.  전기자동차 Infrastructure 개발 추이 , 1997 .

[8]  Li Xiao,et al.  Effective load sharing on heterogeneous networks of workstations , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[9]  Francine Berman,et al.  Program Speedup in a Heterogeneous Computing Network , 1994, J. Parallel Distributed Comput..

[10]  YONG YAN,et al.  An Effective and Practical Performance Prediction Model for Parallel Computing on Nondedicated Heterogeneous NOW , 1996, J. Parallel Distributed Comput..

[11]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[12]  John L. Gustafson,et al.  Reevaluating Amdahl's law , 1988, CACM.

[13]  Francine Berman,et al.  Grid Computing: Making the Global Infrastructure a Reality , 2003 .

[14]  Alan H. Karp,et al.  Measuring parallel processor performance , 1990, CACM.

[15]  Xiaodong Zhang,et al.  Erratum: "An Effective and Practical Performance Prediction Model for Parallel Computing on Nondedicated Heterogeneous NOW" , 1997, J. Parallel Distributed Comput..

[16]  Li Xiao,et al.  Dynamic Cluster Resource Allocations for Jobs with Known and Unknown Memory Demands , 2002, IEEE Trans. Parallel Distributed Syst..

[17]  Tiffani L. Williams,et al.  The Heterogeneous Bulk Synchronous Parallel Model , 2000, IPDPS Workshops.

[18]  Richard S. Barr,et al.  On Reporting the Speedup of Parallel Algorithms: a Survey of Issues and Experts , 1992, Computer Science and Operations Research.

[19]  Jameela Al-Jaroodi,et al.  Modeling parallel applications performance on heterogeneous systems , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[20]  Enrique Alba,et al.  Heterogeneous Computing and Parallel Genetic Algorithms , 2002, J. Parallel Distributed Comput..

[21]  Lawrence A. Crowl.  How to measure, present, and compare parallel performance , 1994, IEEE Parallel & Distributed Technology: Systems & Applications.