Dynamic Job Scheduling on Heterogeneous Clusters

This paper addresses the problem of scheduling dynamicallymulti-user and independent jobs on clusters, both homogeneous and heterogeneous. The dynamic behaviormeans that the scheduler is able to adapt the schedulingwhen new jobs are submitted and also when processorsavailability changes. The scheduler has two main featurescomparing to other solutions: it considers a job as beingdescribed by a direct acyclic graph (DAG) and it is ableto schedule parallel tasks, when appropriate, instead of the common dynamic mapping approach that assigns an entirejob to a processor or a fixed set of processors. The scheduling method is divided in a scheduling strategy and a scheduler algorithm, so that other scheduling algorithms can be incorporated. In this paper two static DAG schedulers for heterogeneous machines are considered. The results show the behavior of the scheduling method for the short completion time of a batch of jobs. These results show better performance when compared to the common schedulers strategies that fix the number of processors per job or assign one processor per job.

[1]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[2]  Jorge G. Barbosa,et al.  Static scheduling of dependent parallel tasks on heterogeneous clusters , 2005, 2005 IEEE International Conference on Cluster Computing.

[3]  Ishfaq Ahmad,et al.  On multiprocessor task scheduling using efficient state space search approaches , 2005, J. Parallel Distributed Comput..

[4]  Wei Sun,et al.  Dynamic Task Flow Scheduling for Heterogeneous Distributed Computing: Algorithm and Strategy , 2007, IEICE Trans. Inf. Syst..

[5]  Y.-K. Kwok,et al.  Static scheduling algorithms for allocating directed task graphs to multiprocessors , 1999, CSUR.

[6]  Leonel Sousa,et al.  List scheduling: extension for contention awareness and evaluation of node priorities for heterogeneous cluster architectures , 2004, Parallel Comput..

[7]  Anthony A. Maciejewski,et al.  Dynamically mapping tasks with priorities and multiple deadlines in a heterogeneous environment , 2007, J. Parallel Distributed Comput..

[8]  Gyung-Leen Park Performance evaluation of a list scheduling algorithm in distributed memory multiprocessor systems , 2004, Future Gener. Comput. Syst..

[9]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[10]  Robert A. van de Geijn,et al.  SUMMA: scalable universal matrix multiplication algorithm , 1995, Concurr. Pract. Exp..

[11]  R. F. Freund,et al.  Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[12]  Denis Trystram,et al.  Scheduling parallel applications using malleable tasks on clusters , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[13]  Denis Trystram,et al.  An approximation algorithm for scheduling trees of malleable tasks , 2002, Eur. J. Oper. Res..

[14]  Anthony A. Maciejewski,et al.  Mapping of subtasks with multiple versions in a heterogeneous ad hoc grid environment , 2004, Third International Symposium on Parallel and Distributed Computing/Third International Workshop on Algorithms, Models and Tools for Parallel Computing on Heterogeneous Networks.

[15]  Behrooz Shirazi,et al.  Analysis and Evaluation of Heuristic Methods for Static Task Scheduling , 1990, J. Parallel Distributed Comput..

[16]  Klaus Jansen,et al.  Scheduling Malleable Parallel Tasks: An Asymptotic Fully Polynomial-Time Approximation Scheme , 2002, ESA.

[17]  Jorge G. Barbosa,et al.  Linear algebra algorithms in a heterogeneous cluster of personal computers , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[18]  Jacek Blazewicz,et al.  Scheduling Malleable Tasks on Parallel Processors to Minimize the Makespan , 2004, Ann. Oper. Res..

[19]  Alex Pentland,et al.  Modal Matching for Correspondence and Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Jorge G. Barbosa,et al.  A List Scheduling Algorithm for Scheduling Multi-user Jobs on Clusters , 2008, VECPAR.