Task Group Scheduling in Distributed Systems

One of the main challenges in distributed systems is efficient scheduling of parallel applications. This paper addresses issues of scheduling parallel jobs that are bags-of-tasks on a cluster of distributed processors. It considers task group scheduling algorithms in two different cases of task routing. The goal is to examine the performance of the scheduling strategies in each of the task routing cases. Simulation is employed to evaluate the performance of the algorithms in different cases of system load. The simulation results reveal that the impact of the scheduling policies on the system performance depends on the employed routing policy, as well as the system load.

[1]  Helen D. Karatza,et al.  Scheduling bags of tasks and gangs in a distributed system , 2015, 2015 International Conference on Computer, Information and Telecommunication Systems (CITS).

[2]  Helen D. Karatza,et al.  Simulation-Based Performance Evaluation of an Energy-Aware Heuristic for the Scheduling of HPC Applications in Large-Scale Distributed Systems , 2017, ICPE Companion.

[3]  Helen D. Karatza,et al.  Scheduling multiple task graphs with end-to-end deadlines in distributed real-time systems utilizing imprecise computations , 2010, J. Syst. Softw..

[4]  Helen D. Karatza.  A simulation model of task cluster scheduling in distributed systems , 1999, Proceedings 7th IEEE Workshop on Future Trends of Distributed Computing Systems.

[5]  Helen D. Karatza,et al.  Scheduling real-time DAGs in heterogeneous clusters by combining imprecise computations and bin packing techniques for the exploitation of schedule holes , 2012, Future Gener. Comput. Syst..

[6]  Tran Ngoc Minh,et al.  Towards a profound analysis of bags-of-tasks in parallel systems and their performance impact , 2011, HPDC '11.

[7]  Helen D. Karatza,et al.  A meta-heuristic optimization approach to the scheduling of bag-of-tasks applications on heterogeneous clouds with multi-level arrivals and critical jobs , 2015, Simul. Model. Pract. Theory.

[8]  Helen D. Karatza.  Periodic Task Cluster Scheduling in Distributed Systems , 2006 .

[9]  Helen D. Karatza,et al.  Task cluster scheduling in a grid system , 2010, Simul. Model. Pract. Theory.

[10]  L Stavrinides Georgios,et al.  Scheduling real-time parallel applications in SaaS clouds in the presence of transient software failures , 2016 .

[11]  Michael Mitzenmacher,et al.  The Power of Two Choices in Randomized Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[12]  Albert Y. Zomaya,et al.  Non-clairvoyant Assignment of Bag-of-Tasks Applications Across Multiple Clouds , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[13]  Helen D. Karatza,et al.  Multi-criteria scheduling of Bag-of-Tasks applications on heterogeneous interlinked clouds with simulated annealing , 2015, J. Syst. Softw..

[14]  Helen D. Karatza,et al.  Periodic scheduling of mixed workload in distributed systems , 2017, 2017 International Conference on Engineering, Technology and Innovation (ICE/ITMC).

[15]  Helen D. Karatza,et al.  The impact of resource heterogeneity on the timeliness of hard real-time complex jobs , 2014, PETRA '14.

[16]  Thilo Kielmann,et al.  Stochastic Tail-Phase Optimization for Bag-of-Tasks Execution in Clouds , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.