SCHEDULING GANGS IN A DISTRIBUTED SYSTEM

In this paper we study the performance of parallel job scheduling in a distributed system. A special type of scheduling called gang scheduling is considered. In gang scheduling jobs consist of a number of interacting tasks, which are scheduled to run simultaneously on distinct processors. Two gang scheduling policies are used to schedule parallel jobs for two different types of job parallelism. Also, we present the average performance of all jobs as well as the relative performance of small and large gangs. We examine various workloads using simulation techniques. The results show that the policy, which gives priority to large gangs performs better than the one that does not take job characteristics into account while making the ordering decision.

[1]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[2]  Roland Sauerbrey,et al.  Biography , 1992, Ann. Pure Appl. Log..

[3]  Patrick Sobalvarro,et al.  Demand-Based Coscheduling of Parallel Jobs on Multiprogrammed Multiprocessors , 1995, JSSPP.

[4]  Larry Rudolph,et al.  Evaluation of Design Choices for Gang Scheduling Using Distributed Hierarchical Control , 1996, J. Parallel Distributed Comput..

[5]  Marios C. Papaefthymiou,et al.  Stochastic Analysis of Gang Scheduling in Parallel and Distributed Systems , 1996, Perform. Evaluation.

[6]  Dror G. Feitelson,et al.  Improved Utilization and Responsiveness with Gang Scheduling , 1997, JSSPP.

[7]  Helen D. Karatza.  A simulation-based performance analysis of gang scheduling in a distributed system , 1999, Proceedings 32nd Annual Simulation Symposium.

[8]  Kento Aida.  Effect of Job Size Characteristics on Job Scheduling Performance , 2000, JSSPP.

[9]  Helen D. Karatza.  Gang Scheduling Performance under Different Distributions of Gang Size , 2001, Scalable Comput. Pract. Exp..

[10]  HELEN D. KARATZA.  PERFORMANCE ANALYSIS OF GANG SCHEDULING IN A DISTRIBUTED SYSTEM UNDER PROCESSOR FAILURES , 2001 .

[11]  Anand Sivasubramaniam,et al.  An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration , 2001, JSSPP.

[12]  Helen D. Karatza.  Gang scheduling performance on a cluster of non-dedicated workstations , 2002, Proceedings 35th Annual Simulation Symposium. SS 2002.

[13]  Dror G. Feitelson,et al.  Paired Gang Scheduling , 2003, IEEE Trans. Parallel Distributed Syst..

[14]  Helen D. Karatza.  Gang scheduling in a distributed system under processor failures and time-varying gang size , 2003, The Ninth IEEE Workshop on Future Trends of Distributed Computing Systems, 2003. FTDCS 2003. Proceedings..

[15]  Anand Sivasubramaniam,et al.  Gang Scheduling Extensions for I/O Intensive Workloads , 2003, JSSPP.

[16]  Dror G. Feitelson,et al.  Adaptive parallel job scheduling with flexible coscheduling , 2005, IEEE Transactions on Parallel and Distributed Systems.