A Load Balancing Policy for Heterogeneous Computational Grids

Computational grids have the potential computing power for solving large-scale scientific computing applications. To improve the global throughput of these applications, workload has to be evenly distributed among the available computational resources in the grid environment. This paper addresses the problem of scheduling and load balancing in heterogeneous computational grids. We proposed a two-level load balancing policy for the multi-cluster grid environment where computational resources are dispersed in different administrative domains or clusters which are located in different local area networks. The proposed load balancing policy takes into account the heterogeneity of the computational resources. It distributes the system workload based on the processing elements capacity which leads to minimize the overall job mean response time and maximize the system utilization and throughput at the steady state. An analytical model is developed to evaluate the performance of the proposed load balancing policy. The results obtained analytically are validated by simulating the model using Arena simulation package. The results show that the overall mean job response time obtained by simulation is very close to that obtained analytically. Also, the simulation results show that the performance of the proposed load balancing policy outperforms that of the random and uniform distribution load balancing policies in terms of mean job response time. The improvement ratio increases as the system workload increases and the maximum improvement ratio obtained is about 72% in the range of system parameter values examined. Keywords-grid computing; resource management; load balancing; performance evaluation; queuing theory; simulation models.

[1]  Said Fathy El-Zoghdy Studies on Braess-like Paradoxes for Non-Cooperative Dynamic Load Balancing in Distributed Computer Systems , 2006, Parallel and Distributed Computing and Networks.

[2]  Faraneh Zarafshan,et al.  PAV: Parallel Average Voting Algorithm for Fault-Tolerant Systems , 2011 .

[3]  Jie Li,et al.  Load Balancing Problems for Multiclass Jobs in Distributed/Parallel Computer Systems , 1998, IEEE Trans. Computers.

[4]  Helen D. Karatza,et al.  Resource Allocation Strategies in a 2-Level Hierarchical Grid System , 2008, 41st Annual Simulation Symposium (anss-41 2008).

[5]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..

[6]  Asser N. Tantawi,et al.  Optimal static load balancing in distributed computer systems , 1985, JACM.

[7]  Said Fathy El-Zoghdy,et al.  Numerical Studies on Braess-Like Paradoxes for Non-Cooperative Load Balancing in Distributed Computer Systems , .

[8]  Keqin Li,et al.  Optimal load distribution in nondedicated heterogeneous cluster and grid computing environments , 2008, J. Syst. Archit..

[9]  Abderezak Touzene,et al.  Analytical Model for Performance Evaluation of Load Balancing Algorithm for Grid Computing , 2007 .

[10]  Yahya Slimani,et al.  Task Load Balancing Strategy for Grid Computing , 2007 .

[11]  Abderezak Touzene,et al.  Load Balancing Grid Computing Middleware , 2005, Web Technologies, Applications, and Services.

[12]  Srinivasan Parthasarathy,et al.  Customized dynamic load balancing for a network of workstations , 1996, Proceedings of 5th IEEE International Symposium on High Performance Distributed Computing.

[13]  Guangwen Yang,et al.  An analytical model for performance evaluation in a computational grid , 2007, China HPC.

[14]  Michael Schmitz,et al.  Decentralized Dynamic Load Balancing: The Particles Approach , 1995, Inf. Sci..

[15]  Jie Li,et al.  A Decomposition Algorithm for Optimal Static Load Balancing in Tree Hierarchy Network Configurations , 1994, IEEE Trans. Parallel Distributed Syst..

[16]  E. Saravanakumar,et al.  A novel Load Balancing algorithm for computational Grid , 2010, 2010 International Conference on Innovative Computing Technologies (ICICT).

[17]  Maode Ma,et al.  A hybrid load balancing strategy of sequential tasks for grid computing environments , 2009, Future Gener. Comput. Syst..

[18]  Ahmad Abusukhon,et al.  Analyzing the Load Balance of Term-based Partitioning , 2011 .

[19]  亀田 壽夫,et al.  Optimal load balancing in distributed computer systems , 1997 .

[20]  Saeed Parsa,et al.  RASA: A New Task Scheduling Algorithm in Grid Environment , 2009 .

[21]  Donald F. Towsley,et al.  Adaptive Load Sharing in Heterogeneous Distributed Systems , 1990, J. Parallel Distributed Comput..

[22]  Yves Robert,et al.  Steady-state scheduling on heterogeneous clusters , 2005, Int. J. Found. Comput. Sci..

[23]  Kai Lu,et al.  On the performance-driven load distribution for heterogeneous computational grids , 2007, J. Comput. Syst. Sci..

[24]  Jie Li,et al.  Numerical studies on a paradox for non-cooperative static load balancing in distributed computer systems , 2006, Comput. Oper. Res..

[25]  Amnon Barak,et al.  The MOSIX multicomputer operating system for high performance cluster computing , 1998, Future Gener. Comput. Syst..