Improving task scheduling with parallelism awareness in heterogeneous computational environments

Abstract Task scheduling is a key function for executing tasks in heterogeneous computational environments, efficiently. While the available computing resources are not fully used when applying existing scheduling methods as they consider that a task is executed on one single core or on a server without parallel tasks by assuming that the task exhausts the server. Therefore, in this paper, we focus on the problem of executing tasks with deadline constraints with parallelism awareness where the parallel degree of each task can be tuned between one and its maximum according to the available cores of the server it assigned to during its execution. We first model the problem as an optimization problem maximizing the overall utilization of servers, and propose a set of scheduling methods with parallelism awareness (SPA), each of which iteratively allocates as much resources and as soon as possible to the assigned task with the earliest deadline on a server, based on existing scheduling algorithms, and present two SPA instances to illustrate the implement of SPA. Experiment results show a great performance improvement in various aspects, e.g., resource utilization, task violations, finish time, and energy efficiency, when executing tasks heterogeneous computational systems using SPA.

[1]  Miguel A. Vega-Rodríguez,et al.  Fattened backfilling: An improved strategy for job scheduling in parallel systems , 2016, J. Parallel Distributed Comput..

[2]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[3]  Henri Casanova,et al.  Resource allocation algorithms for virtualized service hosting platforms , 2010, J. Parallel Distributed Comput..

[4]  Kenli Li,et al.  Scheduling Precedence Constrained Stochastic Tasks on Heterogeneous Cluster Systems , 2015, IEEE Transactions on Computers.

[5]  Kenli Li,et al.  Energy-aware task scheduling in heterogeneous computing environments , 2014, Cluster Computing.

[6]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[7]  I. Y. Kim,et al.  Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , 2005 .

[8]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[9]  Xiaohui Cheng,et al.  Energy-efficient Tasks Scheduling Heuristics with Multi-constraints in Virtualized Clouds , 2018, Journal of Grid Computing.

[10]  Yin Wang,et al.  Bistro: Scheduling Data-Parallel Jobs Against Live Production Systems , 2015, USENIX Annual Technical Conference.

[11]  Zhuzhong Qian,et al.  Be a good neighbour: Characterizing performance interference of virtual machines under xen virtualization environments , 2014, 2014 20th IEEE International Conference on Parallel and Distributed Systems (ICPADS).

[12]  Minlan Yu,et al.  Scheduling jobs across geo-distributed datacenters , 2015, SoCC.

[13]  Yu Liu,et al.  DeMS: A hybrid scheme of task scheduling and load balancing in computing clusters , 2017, J. Netw. Comput. Appl..

[14]  Wei Huang,et al.  Cooling-Aware Job Scheduling and Node Allocation for Overprovisioned HPC Systems , 2017, 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[15]  Bo Wang,et al.  Managing Deadline-constrained Bag-of-Tasks Jobs on Hybrid Clouds with Closest Deadline First Scheduling , 2016, KSII Trans. Internet Inf. Syst..

[16]  Unai Arronategui,et al.  Fair scheduling of bag-of-tasks applications on large-scale platforms , 2015, Future Gener. Comput. Syst..

[17]  Wei-Mei Chen,et al.  Task scheduling for grid computing systems using a genetic algorithm , 2014, The Journal of Supercomputing.

[18]  Jorge G. Barbosa,et al.  Dynamic scheduling of a batch of parallel task jobs on heterogeneous clusters , 2011, Parallel Comput..

[19]  Xavier Lorca,et al.  Entropy: a consolidation manager for clusters , 2009, VEE '09.

[20]  Sai Peck Lee,et al.  Cost optimization approaches for scientific workflow scheduling in cloud and grid computing: A review, classifications, and open issues , 2016, J. Syst. Softw..

[21]  Sasmita Kumari Padhy,et al.  Dynamic task scheduling using a directed neural network , 2015, J. Parallel Distributed Comput..

[22]  Alexandru Iosup,et al.  Grid Computing Workloads , 2011, IEEE Internet Computing.

[23]  Yan Zheng,et al.  Reliability-Aware Runtime Adaption Through a Statically Generated Task Schedule , 2018, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[24]  Helen D. Karatza,et al.  Power-aware Bag-of-Tasks scheduling on heterogeneous platforms , 2016, Cluster Computing.

[25]  Burkhard Stiller,et al.  A Survey of the State-of-the-Art in Fair Multi-Resource Allocations for Data Centers , 2018, IEEE Transactions on Network and Service Management.

[26]  Bharadwaj Veeravalli,et al.  Dynamic Scheduling of Hybrid Real-Time Tasks on Clusters , 2014, IEEE Transactions on Computers.

[27]  Jie Wu,et al.  Energy efficient virtual machine placement algorithm with balanced and improved resource utilization in a data center , 2013, Math. Comput. Model..

[28]  Jacek Blazewicz,et al.  Scheduling Malleable Tasks on Parallel Processors to Minimize the Makespan , 2004, Ann. Oper. Res..

[29]  Yu Zhang,et al.  An Application-Level Scheduling with Task Bundling Approach for Many-Task Computing in Heterogeneous Environments , 2012, NPC.

[30]  Rodney S. Tucker,et al.  Green Cloud Computing: Balancing Energy in Processing, Storage, and Transport , 2011, Proceedings of the IEEE.

[31]  Ciprian Dobre,et al.  Deadline scheduling for aperiodic tasks in inter-Cloud environments: a new approach to resource management , 2015, The Journal of Supercomputing.

[32]  Rajkumar Buyya,et al.  On minimizing total energy consumption in the scheduling of virtual machine reservations , 2018, J. Netw. Comput. Appl..

[33]  Henri Casanova,et al.  Energy-aware service allocation , 2012, Future Gener. Comput. Syst..

[34]  Keqin Li,et al.  Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems , 2017, Future Gener. Comput. Syst..

[35]  Jun Liu,et al.  Managing Deadline-constrained Bag-of-Tasks Jobs on Hybrid Clouds , 2016, HPC 2016.

[36]  Imtiaz Ahmad,et al.  Task scheduling for heterogeneous computing systems , 2017, The Journal of Supercomputing.

[37]  Roberto Rojas-Cessa,et al.  Greedy scheduling of tasks with time constraints for energy-efficient cloud-computing data centers , 2015, Journal of Cloud Computing.

[38]  Johan Tordsson,et al.  Virtualization Techniques Compared: Performance, Resource, and Power Usage Overheads in Clouds , 2018, ICPE.

[39]  Denis Trystram,et al.  Scheduling parallel applications using malleable tasks on clusters , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[40]  Tchimou N'Takpé,et al.  Concurrent scheduling of parallel task graphs on multi-clusters using constrained resource allocations , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[41]  Fabien Hermenier,et al.  Scheduling Live Migration of Virtual Machines , 2020, IEEE Transactions on Cloud Computing.

[42]  Lee Gillam,et al.  Energy efficient computing, clusters, grids and clouds: A taxonomy and survey , 2017, Sustain. Comput. Informatics Syst..

[43]  Minhaj Ahmad Khan.  Task scheduling for heterogeneous systems using an incremental approach , 2016, The Journal of Supercomputing.