Dynamic Idle Time Interval Scheduling for Hybrid Cloud Workflow Management System

To reduce the operating cost, leasing appropriate amount of public resources becomes a popular practice among small and medium sized enterprises. Many hybrid cloud workflow management systems (HCWMSs) have been developed to provision applications on both local and rented resources. One of the critical issues in the HCWMS is the dynamic resource allocation for stochastically arriving requests. Therefore, we propose a dynamic interval scheduling based heuristic for the resource allocation problem, in which stochastic requests are taken as a set of linearly dependent tasks and distributed to idle and feasible time slots on multiple virtual machines (VMs), either local or rented VMs. The objective is to minimize the idle time slots on the rented VMs, which is relative to the renting cost of VMs, especially for the on-demand pricing structure. Requests arrive at the same time are taken as a batch of tasks to schedule. Tasks are scheduled batch by batch, obeying the precedence constraint and the deadline constraint. We develop a fast heuristic integrated with an interval scheduling to obtain feasible and effective solutions. Three interval scheduling method are proposed and compared: Max Interval Number Scheduling (MINS), Max Working Time Scheduling (MWTS) and Select-the-better Method (STBM). The experimental results show that the interval scheduling based heuristic can reduces the cost of renting VMs.

[1]  Denis A. Nasonov,et al.  Workflow Scheduling Algorithms for Hard-deadline Constrained Cloud Environments , 2016, ICCS.

[2]  Sarbjeet Singh,et al.  A Budget-constrained Time and Reliability Optimization BAT Algorithm for Scheduling Workflow Applications in Clouds , 2016, EUSPN/ICTH.

[3]  Sakshi Kaushal,et al.  Pricing Models in Cloud Computing , 2014, ICTCS '14.

[4]  Bing Zeng,et al.  A Task Scheduling Algorithm based on QoS-Driven in Cloud Computing , 2013, ITQM.

[5]  R. F. Freund,et al.  Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[6]  Jan Broeckhove,et al.  Cost-Optimal Scheduling in Hybrid IaaS Clouds for Deadline Constrained Workloads , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[7]  Jyh-Horng Chou,et al.  Optimized task scheduling and resource allocation on cloud computing environment using improved differential evolution algorithm , 2013, Comput. Oper. Res..

[8]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[9]  Alexandru I. Tomescu,et al.  Interval scheduling maximizing minimum coverage , 2017, Discret. Appl. Math..

[10]  Venkatram Vishwanath,et al.  Workflow performance improvement using model-based scheduling over multiple clusters and clouds , 2016, Future Gener. Comput. Syst..

[11]  Evripidis Bampis,et al.  On-Line Bicriteria Interval Scheduling , 2005, Euro-Par.

[12]  Klavdiya Bochenina,et al.  Static scheduling of multiple workflows with soft deadlines in non-dedicated heterogeneous environments , 2016, Future Gener. Comput. Syst..

[13]  Ulrich Faigle,et al.  Randomized online algorithms for maximizing busy time interval scheduling , 2006, Computing.

[14]  Mahmood Ahmadi,et al.  Cost minimization for deadline-constrained bag-of-tasks applications in federated hybrid clouds , 2017, Future Gener. Comput. Syst..

[15]  Feifeng Zheng,et al.  Online interval scheduling: randomized and multiprocessor cases , 2008, J. Comb. Optim..

[16]  Nikolay Butakov,et al.  Hard-deadline Constrained Workflows Scheduling Using Metaheuristic Algorithms , 2015 .

[17]  Yongsheng Ding,et al.  Endocrine-based coevolutionary multi-swarm for multi-objective workflow scheduling in a cloud system , 2017, Soft Comput..

[18]  Rubén Ruiz,et al.  A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds , 2017, Future Gener. Comput. Syst..

[19]  Lina Wang,et al.  An adaptive algorithm for scheduling parallel jobs in meteorological Cloud , 2016, Knowl. Based Syst..

[20]  Hamid Arabnejad,et al.  Multi-QoS constrained and Profit-aware scheduling approach for concurrent workflows on heterogeneous systems , 2017, Future Gener. Comput. Syst..

[21]  Long Zhang,et al.  A three-dimensional virtual resource scheduling method for energy saving in cloud computing , 2017, Future Gener. Comput. Syst..

[22]  Rubén Ruiz,et al.  Scheduling Stochastic Multi-Stage Jobs to Elastic Hybrid Cloud Resources , 2018, IEEE Transactions on Parallel and Distributed Systems.

[23]  Ulrich Faigle,et al.  Note on Scheduling Intervals on-line , 1995, Discret. Appl. Math..

[24]  Adam Belloum,et al.  Execution Time Estimation for Workflow Scheduling , 2014, 2014 9th Workshop on Workflows in Support of Large-Scale Science.

[25]  Bryan Ng,et al.  Scheduling deadline constrained scientific workflows on dynamically provisioned cloud resources , 2017, Future Gener. Comput. Syst..

[26]  Pierre Hansen,et al.  Variable neighborhood search: Principles and applications , 1998, Eur. J. Oper. Res..

[27]  Henry M. Goldberg Analysis of the Earliest Due Date Scheduling Rule in Queueing Systems , 1977, Math. Oper. Res..