Minimizing Monetary Costs for Deadline Constrained Workflows in Cloud Environments

As one of the latest market-oriented resource provisioning paradigms, cloud computing has been widely adopted by a growing number of consumers due to its powerful computing ability and storage ability. Although cloud computing can achieve effective cost reduction and convenience enhancement in the development of large-scale applications, it results in a complex cost optimization problem for data-dependent tasks represented by a workflow. All tasks in a workflow should be scheduled according to a proper strategy such that the cost is minimized and the precedence constraints and timing requirements are satisfied. In this paper, we study the cost optimization problem of deadline constrained workflows on cloud computing, and propose two list scheduling algorithms named Look-back Workflow Scheduling (LBWS) and Structure Aware Workflow Scheduling (SAWS) to solve the problem. LBWS distributes the deadline over the workflow as sub-deadlines to tasks in different levels, and schedules the tasks according to their priorities to the resources which meet their sub-deadlines and the best time-cost trade off requirements. Compared with LBWS, SAWS considers tasks allocated to the same level at a time and provisions resources with minimum cost to these tasks. Experiments on scientific workflow applications with different data and computational characteristics are conducted to show that, the proposed approaches can achieve better performance in terms of success rate and monetary cost.

[1]  Miron Livny,et al.  Pegasus, a workflow management system for science automation , 2015, Future Gener. Comput. Syst..

[2]  DeelmanEwa,et al.  Algorithms for cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds , 2015 .

[3]  Rubén Ruiz,et al.  A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds , 2017, Future Gener. Comput. Syst..

[4]  Ming Mao,et al.  A Performance Study on the VM Startup Time in the Cloud , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[5]  Radu Prodan,et al.  Multi-objective energy-efficient workflow scheduling using list-based heuristics , 2014, Future Gener. Comput. Syst..

[6]  Prasanta K. Jana,et al.  A novel cost-efficient approach for deadline-constrained workflow scheduling by dynamic provisioning of resources , 2018, Future Gener. Comput. Syst..

[7]  Bryan Ng,et al.  Scheduling deadline constrained scientific workflows on dynamically provisioned cloud resources , 2017, Future Gener. Comput. Syst..

[8]  Prasanta K. Jana,et al.  A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing , 2018, Future Gener. Comput. Syst..

[9]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[10]  Hamid Arabnejad,et al.  List Scheduling Algorithm for Heterogeneous Systems by an Optimistic Cost Table , 2014, IEEE Transactions on Parallel and Distributed Systems.

[11]  Qingsheng Zhu,et al.  Deadline-Constrained Cost Optimization Approaches for Workflow Scheduling in Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[12]  Rizos Sakellariou,et al.  A Performance Model to Estimate Execution Time of Scientific Workflows on the Cloud , 2014, 2014 9th Workshop on Workflows in Support of Large-Scale Science.

[13]  Rizos Sakellariou,et al.  Budget-Deadline Constrained Workflow Planning for Admission Control , 2013, Journal of Grid Computing.

[14]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[15]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[16]  Dick H. J. Epema,et al.  Cost-driven scheduling of grid workflows using Partial Critical Paths , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[17]  Sakshi Kaushal,et al.  Cost-Time Efficient Scheduling Plan for Executing Workflows in the Cloud , 2015, Journal of Grid Computing.

[18]  Mahmoud Naghibzadeh,et al.  CCA: a deadline-constrained workflow scheduling algorithm for multicore resources on the cloud , 2017, The Journal of Supercomputing.

[19]  Bin Luo,et al.  Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds , 2018, IEEE Transactions on Services Computing.

[20]  Hamid Arabnejad,et al.  A Budget Constrained Scheduling Algorithm for Workflow Applications , 2014, Journal of Grid Computing.

[21]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms and Systems Development , 1992 .

[22]  Xiaohui Liu,et al.  Evolutionary Multi-Objective Workflow Scheduling in Cloud , 2016, IEEE Transactions on Parallel and Distributed Systems.

[23]  Kenli Li,et al.  Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems , 2017, Inf. Sci..

[24]  Fei Xie,et al.  Scheduling non-preemptive tasks with strict periods in multi-core real-time systems , 2018, J. Syst. Archit..

[25]  Erol Gelenbe,et al.  Adaptive Dispatching of Tasks in the Cloud , 2015, IEEE Transactions on Cloud Computing.

[26]  Keqin Li,et al.  Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems , 2017, Future Gener. Comput. Syst..

[27]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[28]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..

[29]  Jian Li,et al.  Cost-efficient task scheduling for executing large programs in the cloud , 2013, Parallel Comput..

[30]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[31]  Yu Xie,et al.  Cost-Efficient Consolidating Service for Aliyun’s Cloud-Scale Computing , 2019, IEEE Transactions on Services Computing.

[32]  Bryan Ng,et al.  Budget and Deadline Aware e-Science Workflow Scheduling in Clouds , 2019, IEEE Transactions on Parallel and Distributed Systems.

[33]  Deo Prakash Vidyarthi,et al.  A Cost-Effective Deadline-Constrained Dynamic Scheduling Algorithm for Scientific Workflows in a Cloud Environment , 2018, IEEE Transactions on Cloud Computing.

[34]  Victor I. Chang,et al.  Multi-objective scheduling for scientific workflow in multicloud environment , 2018, J. Netw. Comput. Appl..