A Grid-based Virtual Reactor: Parallel performance and adaptive load balancing

We address the problem of porting parallel distributed applications from static homogeneous cluster environments to dynamic heterogeneous Grid resources. We introduce a generic technique for adaptive load balancing of parallel applications on heterogeneous resources and evaluate it using a case study application: a Virtual Reactor for simulation of plasma chemical vapour deposition. This application has a modular architecture with a number of loosely coupled components suitable for distribution over the Grid. It requires large parameter space exploration that allows using Grid resources for high-throughput computing. The Virtual Reactor contains a number of parallel solvers originally designed for homogeneous computer clusters that needed adaptation to the heterogeneity of the Grid. In this paper we study the performance of one of the parallel solvers, apply the technique developed for adaptive load balancing, evaluate the efficiency of this approach and outline an automated procedure for optimal utilization of heterogeneous Grid resources for high-performance parallel computing.

[1]  David W. Walker,et al.  The software architecture of a distributed problem‐solving environment , 2000 .

[2]  Valeria V. Krzhizhanovskaya,et al.  Dynamic Load Balancing of Black-Box Applications with a Resource Selection Mechanism on Heterogeneous Resources of the Grid , 2007, PaCT.

[3]  Francine Berman,et al.  Adaptive Computing on the Grid Using AppLeS , 2003, IEEE Trans. Parallel Distributed Syst..

[4]  Peter M. A. Sloot,et al.  Distributed Simulation of Silicon-Based Film Growth , 2001, PPAM.

[5]  Zhiling Lan,et al.  Dynamic Load Balancing of SAMR Applications on Distributed Systems , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[6]  Joseph E. Flaherty,et al.  Resource-aware scientific computation on a heterogeneous cluster , 2005, Computing in Science & Engineering.

[7]  Peter M. A. Sloot,et al.  Computational Engineering on the Grid: Crafting a Distributed Virtual Reactor , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[8]  Valeria V. Krzhizhanovskaya,et al.  Benchmarking and Adaptive Load Balancing of the Virtual Reactor Application on the Russian-Dutch Grid , 2006, International Conference on Computational Science.

[9]  Valeria V. Krzhizhanovskaya,et al.  Workload Balancing in Heterogeneous Grid Environment: A Virtual Reactor Case Study , 2006 .

[10]  Peter M. A. Sloot,et al.  The implementation of dynamite: an environment for migrating PVM tasks , 2000, OPSR.

[11]  Francine Berman,et al.  Master/slave computing on the Grid , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[12]  Rick Kufrin,et al.  PerfSuite: An Accessible, Open Source Performance Analysis Environment for Linux , 2005 .

[13]  Eric Violard,et al.  Source Code Transformations Strategies to Load-Balance Grid Applications , 2002, GRID.

[14]  Amnon Barak,et al.  The MOSIX Distributed Operating System: Load Balancing for UNIX , 1993 .

[15]  Peter M. A. Sloot,et al.  A 3D Virtual Reactor for Simulation of Silicon-Based Film Production , 2004 .

[16]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[17]  Yongbing Zhang,et al.  A performance comparison of adaptive and static load balancing in heterogeneous distributed systems , 1995, Proceedings of Simulation Symposium.

[18]  V. V. Krzhizhanovskaya,et al.  Grid-Based Simulation of Industrial Thin-Film Production , 2005, Simul..

[19]  Amnon Barak,et al.  The MOSIX Distributed Operating System , 1993, Lecture Notes in Computer Science.

[20]  G. C. Fox,et al.  Solving Problems on Concurrent Processors , 1988 .

[21]  Sau-Ming Lau,et al.  An adaptive load balancing algorithm for heterogeneous distributed systems with multiple task classes , 1996, Proceedings of 16th International Conference on Distributed Computing Systems.

[22]  Shweta Sinha,et al.  Adaptive runtime partitioning of AMR applications on heterogeneous clusters , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.

[23]  Ming Wu,et al.  Grid Harvest Service: a system for long-term, application-level task scheduling , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[24]  Peter M. A. Sloot,et al.  Load balancing by redundant decomposition and mapping , 1997, Future Gener. Comput. Syst..