Performance evaluation of bag of gangs scheduling in a heterogeneous distributed system

Distributed systems deliver a cost-effective and scalable solution to the increasing performance intensive applications by utilizing several shared resources. Gang scheduling is considered to be an efficient time-space sharing scheduling algorithm for parallel and distributed systems. In this paper we examine the performance of scheduling strategies of jobs which are bags of independent gangs in a heterogeneous system. A simulation model is used to evaluate the performance of bag of gangs scheduling in the presence of high priority jobs implementing migrations. The simulation results reveal the significant role of the implemented migration scheme as a load balancing factor in a heterogeneous environment. Another significant aspect of implementing migrations presented in this paper is the reduction of the fragmentation caused in the schedule by gang scheduled jobs and the alleviation of the performance impact of the high priority jobs.

[1]  Anand Sivasubramaniam,et al.  An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration , 2001, JSSPP.

[2]  Dror G. Feitelson,et al.  Paired Gang Scheduling , 2003, IEEE Trans. Parallel Distributed Syst..

[3]  Angela C. Sodan,et al.  Gang scheduling and adaptive resource allocation to mitigate advance reservation impact , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[4]  Wenfei Fan,et al.  Keys with Upward Wildcards for XML , 2001, DEXA.

[5]  Helen D. Karatza,et al.  Performance of gang scheduling strategies in a parallel system , 2009, Simul. Model. Pract. Theory.

[6]  Xiaoying Wang,et al.  Multi-cluster Load Balancing Based on Process Migration , 2007, APPT.

[7]  Helen D. Karatza.  Scheduling in Distributed Systems , 2003, MASCOTS Tutorials.

[8]  Achim Streit.  Enhancements to the Decision Process of the Self-Tuning dynP Scheduler , 2004, JSSPP.

[9]  Dimiter R. Avresky,et al.  Method for Task Migration in Grid Environments , 2005, Fourth IEEE International Symposium on Network Computing and Applications.

[10]  Helen D. Karatza,et al.  Performance evaluation of gang scheduling in a two-cluster system with migrations , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[11]  Averill M. Law,et al.  Simulation modelling and analysis , 1991 .

[12]  Hassan Rajaei,et al.  Simulation of Job Scheduling for Small Scale Clusters , 2006, Proceedings of the 2006 Winter Simulation Conference.

[13]  Helen D. Karatza,et al.  Scheduling Gangs with Different Distributions in Gangs' Degree of Parallelism in a Multi-Site System , 2009, 2009 Fourth Balkan Conference in Informatics.

[14]  Evgenia Smirni,et al.  Multiple-Queue Backfilling Scheduling with Priorities and Reservations for Parallel Systems , 2002, JSSPP.

[15]  Liu Zheng,et al.  A Task Migration Constrained Energy-Efficient Scheduling Algorithm for Multiprocessor Real-time Systems , 2007, 2007 International Conference on Wireless Communications, Networking and Mobile Computing.

[16]  Helen D. Karatza,et al.  Gang scheduling in a two-cluster system with critical sporadic jobs and migrations , 2009, 2009 International Symposium on Performance Evaluation of Computer & Telecommunication Systems.

[17]  Anirban Mondal,et al.  Effective Load-Balancing via Migration and Replication in Spatial Grids , 2003, DEXA.

[18]  Anand Sivasubramaniam,et al.  The Impact of Migration on Parallel Job Scheduling for Distributed Systems , 2000, Euro-Par.

[19]  Francis Neelamkavil.  Computer Simulation and Modelling , 1987 .

[20]  Cong Du,et al.  Dynamic Scheduling with Process Migration , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[21]  Dejan S. Milojicic,et al.  Process migration , 1999, ACM Comput. Surv..

[22]  H. Karatza.  SCHEDULING GANGS IN A DISTRIBUTED SYSTEM , 2006 .

[23]  Jun Huang,et al.  A heterogeneity-aware approach to load balancing of computational tasks: a theoretical and simulation study , 2008, Cluster Computing.

[24]  Laxmikant V. Kalé,et al.  Proactive Fault Tolerance in MPI Applications Via Task Migration , 2006, HiPC.

[25]  Phil Andrews,et al.  Impact of Reservations on Production Job Scheduling , 2007, JSSPP.

[26]  Bharadwaj Veeravalli,et al.  Design and performance evaluation of combined first-fit task allocation and migration strategies in mesh multiprocessor systems , 2008, Parallel Comput..

[27]  Helen D. Karatza,et al.  The impact of task service time variability on gang scheduling performance in a two-cluster system , 2009, Simul. Model. Pract. Theory.

[28]  Uwe Schwiegelshohn,et al.  Online scheduling in grids , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[29]  P. Sadayappan,et al.  Scheduling of Parallel Jobs in a Heterogeneous Multi-site Environement , 2003, JSSPP.