Scheduling a Job Mix of Bag-of-Tasks and Bag-of-Task-Chains on Distributed Resources

There is a broad spectrum of complex jobs that run on distributed computational resources. The performance of such platforms mainly depends on resource allocation and job scheduling. In this paper, we study scheduling of a job mix consisting of two types of complex jobs, bag-of-tasks and bag-of-task-chains. Two workload scheduling techniques are utilized in a cluster of distributed processors. Discrete-event simulation is used to evaluate system performance, for the types of jobs under study. The simulation results show that the performance of the scheduling algorithms depends on the characteristics of the jobs.

[1]  Helen D. Karatza,et al.  Communication cost effective scheduling policies of nonclairvoyant jobs with load balancing in a grid , 2009, J. Syst. Softw..

[2]  Helen D. Karatza,et al.  Scheduling real‐time bag‐of‐tasks applications with approximate computations in SaaS clouds , 2020, Concurr. Comput. Pract. Exp..

[3]  Helen D. Karatza,et al.  Simulation-Based Performance Evaluation of an Energy-Aware Heuristic for the Scheduling of HPC Applications in Large-Scale Distributed Systems , 2017, ICPE Companion.

[4]  Helen D. Karatza,et al.  The impact of workload variability on the energy efficiency of large-scale heterogeneous distributed systems , 2018, Simul. Model. Pract. Theory.

[5]  Helen D. Karatza,et al.  The impact of checkpointing interval selection on the scheduling performance of real‐time fine‐grained parallel applications in SaaS clouds under various failure probabilities , 2018, Concurr. Comput. Pract. Exp..

[6]  Helen D. Karatza,et al.  The impact of data locality on the performance of a SaaS cloud with real-time data-intensive applications , 2017, 2017 IEEE/ACM 21st International Symposium on Distributed Simulation and Real Time Applications (DS-RT).

[7]  Thilo Kielmann,et al.  Stochastic Tail-Phase Optimization for Bag-of-Tasks Execution in Clouds , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[8]  Helen D. Karatza,et al.  Gang scheduling in multi-core clusters implementing migrations , 2011, Future Gener. Comput. Syst..

[9]  Lilia Zaourar,et al.  Approximation Algorithm for Scheduling a Chain of Tasks on Heterogeneous Systems , 2017, Euro-Par Workshops.

[10]  Helen D. Karatza,et al.  Scheduling Single-Task Jobs along with Bag-of-Task-Chains in Distributed Systems , 2019, ICFNDS.

[11]  Helen D. Karatza,et al.  Task Group Scheduling in Distributed Systems , 2018, 2018 International Conference on Computer, Information and Telecommunication Systems (CITS).

[12]  Helen D. Karatza,et al.  A meta-heuristic optimization approach to the scheduling of bag-of-tasks applications on heterogeneous clouds with multi-level arrivals and critical jobs , 2015, Simul. Model. Pract. Theory.

[13]  Helen D. Karatza,et al.  Scheduling Bag-of-Task-Chains in Distributed Systems , 2019, 2019 IEEE 14th International Symposium on Autonomous Decentralized System (ISADS).

[14]  Michael Mitzenmacher,et al.  The Power of Two Choices in Randomized Load Balancing , 2001, IEEE Trans. Parallel Distributed Syst..

[15]  Rolf Ernst,et al.  Response-Time Analysis for Task Chains in Communicating Threads , 2016, 2016 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS).

[16]  Helen D. Karatza,et al.  The Effect of Workload Computational Demand Variability on the Performance of a SaaS Cloud with a Multi-tier SLA , 2017, 2017 IEEE 5th International Conference on Future Internet of Things and Cloud (FiCloud).

[17]  Georgios L. Stavrinides,et al.  Scheduling Real-Time Jobs in Distributed Systems-Simulation and Performance Analysis , 2015 .

[18]  Helen D. Karatza,et al.  Scheduling Data-Intensive Workloads in Large-Scale Distributed Systems: Trends and Challenges , 2018, Modeling and Simulation in HPC and Cloud Systems.

[19]  Albert Y. Zomaya,et al.  Non-clairvoyant Assignment of Bag-of-Tasks Applications Across Multiple Clouds , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[20]  Joseph Y.-T. Leung,et al.  Scheduling Chain-Structured Tasks to Minimize Makespan and Mean Flow Time , 1991, Inf. Comput..

[21]  Helen D. Karatza,et al.  Scheduling bags of tasks and gangs in a distributed system , 2015, 2015 International Conference on Computer, Information and Telecommunication Systems (CITS).

[22]  Helen D. Karatza,et al.  Periodic scheduling of mixed workload in distributed systems , 2017, 2017 International Conference on Engineering, Technology and Innovation (ICE/ITMC).

[23]  Helen D. Karatza,et al.  Fault-tolerant Gang Scheduling in Distributed Real-time Systems Utilizing Imprecise Computations , 2009, Simul..

[24]  Helen D. Karatza,et al.  Performance evaluation of a SaaS cloud under different levels of workload computational demand variability and tardiness bounds , 2019, Simul. Model. Pract. Theory.