An Effective Cloud Workflow Scheduling Approach Combining PSO and Idle Time Slot-Aware Rules

Workflow scheduling is a key issue and remains a challenging problem in cloud computing. Faced with the large number of virtual machine (VM) types offered by cloud providers, cloud users need to choose the most appropriate VM type for each task. Multiple task scheduling sequences exist in a workflow application. Different task scheduling sequences have a significant impact on the scheduling performance. It is not easy to determine the most appropriate set of VM types for tasks and the best task scheduling sequence. Besides, the idle time slots on VM instances should be used fully to increase resources' utilization and save the execution cost of a workflow. This paper considers these three aspects simultaneously and proposes a cloud workflow scheduling approach which combines particle swarm optimization (PSO) and idle time slot-aware rules, to minimize the execution cost of a workflow application under a deadline constraint. A new particle encoding is devised to represent the VM type required by each task and the scheduling sequence of tasks. An idle time slot-aware decoding procedure is proposed to decode a particle into a scheduling solution. To handle tasks' invalid priorities caused by the randomness of PSO, a repair method is used to repair those priorities to produce valid task scheduling sequences. The proposed approach is compared with state-of-the-art cloud workflow scheduling algorithms. Experiments show that the proposed approach outperforms the comparative algorithms in terms of both of the execution cost and the success rate in meeting the deadline.

[1]  Jun Zhang,et al.  Cloud Computing Resource Scheduling and a Survey of Its Evolutionary Approaches , 2015, ACM Comput. Surv..

[2]  AbrishamiSaeid,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013 .

[3]  Jia Zhang,et al.  Dynamic Fine-Grained Resource Provisioning for Heterogeneous Applications in Virtualized Cloud Data Center , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[4]  Xiaohui Liu,et al.  Evolutionary Multi-Objective Workflow Scheduling in Cloud , 2016, IEEE Transactions on Parallel and Distributed Systems.

[5]  Ian J. Taylor,et al.  Workflows and e-Science: An overview of workflow system features and capabilities , 2009, Future Gener. Comput. Syst..

[6]  Witold Pedrycz,et al.  Uncertainty-Aware Online Scheduling for Real-Time Workflows in Cloud Service Environment , 2021, IEEE Transactions on Services Computing.

[7]  Rajkumar Buyya,et al.  Meeting Deadlines of Scientific Workflows in Public Clouds with Tasks Replication , 2014, IEEE Transactions on Parallel and Distributed Systems.

[8]  Qingsheng Zhu,et al.  Deadline-Constrained Cost Optimization Approaches for Workflow Scheduling in Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[9]  Bryan Ng,et al.  Budget and Deadline Aware e-Science Workflow Scheduling in Clouds , 2019, IEEE Transactions on Parallel and Distributed Systems.

[10]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..

[11]  MengChu Zhou,et al.  Biobjective Task Scheduling for Distributed Green Data Centers , 2021, IEEE Transactions on Automation Science and Engineering.

[12]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[13]  Prasanta K. Jana,et al.  Resource-Aware Energy Efficient Workflow Scheduling in Cloud Infrastructure , 2018, 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[14]  Kenli Li,et al.  A novel task scheduling scheme in a cloud computing environment using hybrid biogeography-based optimization , 2019, Soft Comput..

[15]  Alexandru Iosup,et al.  A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing , 2009, CloudComp.

[16]  Jun Zhang,et al.  Multiobjective Cloud Workflow Scheduling: A Multiple Populations Ant Colony System Approach , 2019, IEEE Transactions on Cybernetics.

[17]  Xiaomin Zhu,et al.  Scheduling for Workflows with Security-Sensitive Intermediate Data by Selective Tasks Duplication in Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[18]  Xuyun Zhang,et al.  EnReal: An Energy-Aware Resource Allocation Method for Scientific Workflow Executions in Cloud Environment , 2016, IEEE Transactions on Cloud Computing.

[19]  Deo Prakash Vidyarthi,et al.  A Cost-Effective Deadline-Constrained Dynamic Scheduling Algorithm for Scientific Workflows in a Cloud Environment , 2018, IEEE Transactions on Cloud Computing.

[20]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[21]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[22]  Thomas Nolte,et al.  An energy‐aware resource provisioning scheme for real‐time applications in a cloud data center , 2018, Softw. Pract. Exp..

[23]  Wei Tan,et al.  Cost-aware request routing in multi-geography cloud data centres using software-defined networking , 2017, Enterp. Inf. Syst..

[24]  Thomas Fahringer,et al.  GRP-HEFT: A Budget-Constrained Resource Provisioning Scheme for Workflow Scheduling in IaaS Clouds , 2020, IEEE Transactions on Parallel and Distributed Systems.

[25]  Qingbo Wu,et al.  Workflow scheduling in cloud: a survey , 2015, The Journal of Supercomputing.

[26]  Rajkumar Buyya,et al.  Deadline‐constrained coevolutionary genetic algorithm for scientific workflow scheduling in cloud computing , 2017, Concurr. Comput. Pract. Exp..

[27]  Bryan Ng,et al.  Scheduling deadline constrained scientific workflows on dynamically provisioned cloud resources , 2017, Future Gener. Comput. Syst..

[28]  Xianpeng Wang,et al.  An Improved Particle Swarm Optimization Algorithm for the Hybrid Flowshop Scheduling to Minimize Total Weighted Completion Time in Process Industry , 2010, IEEE Transactions on Control Systems Technology.

[29]  Jun Zhang,et al.  Deadline Constrained Cloud Computing Resources Scheduling through an Ant Colony System Approach , 2015, 2015 International Conference on Cloud Computing Research and Innovation (ICCCRI).

[30]  Jeffrey D. Ullman,et al.  NP-Complete Scheduling Problems , 1975, J. Comput. Syst. Sci..

[31]  Wei Tan,et al.  Self-Adaptive Learning PSO-Based Deadline Constrained Task Scheduling for Hybrid IaaS Cloud , 2014, IEEE Transactions on Automation Science and Engineering.

[32]  Radu Prodan,et al.  Multi-objective workflow scheduling in Amazon EC2 , 2014, Cluster Computing.

[33]  Y.-K. Kwok,et al.  Static scheduling algorithms for allocating directed task graphs to multiprocessors , 1999, CSUR.

[34]  Kenli Li,et al.  A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues , 2014, Inf. Sci..

[35]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[36]  MengChu Zhou,et al.  Application-Aware Dynamic Fine-Grained Resource Provisioning in a Virtualized Cloud Data Center , 2017, IEEE Transactions on Automation Science and Engineering.

[37]  Parmeet Kaur,et al.  Resource provisioning and work flow scheduling in clouds using augmented Shuffled Frog Leaping Algorithm , 2017, J. Parallel Distributed Comput..

[38]  Rajkumar Buyya,et al.  Budget-Driven Scheduling of Scientific Workflows in IaaS Clouds with Fine-Grained Billing Periods , 2017, ACM Trans. Auton. Adapt. Syst..

[39]  Jun Zhang,et al.  Deadline constrained cloud computing resources scheduling for cost optimization based on dynamic objective genetic algorithm , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[40]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[41]  MengChu Zhou,et al.  TTSA: An Effective Scheduling Approach for Delay Bounded Tasks in Hybrid Clouds , 2017, IEEE Transactions on Cybernetics.

[42]  Jun Zhang,et al.  An Intelligent Cloud Workflow Scheduling System With Time Estimation and Adaptive Ant Colony Optimization , 2021, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[43]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[44]  LiGuo Huang,et al.  A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds , 2016, Future Gener. Comput. Syst..

[45]  Jin Sun,et al.  Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based HEFT , 2019, Future Gener. Comput. Syst..

[46]  Xiaoping Li,et al.  Elastic Resource Provisioning for Cloud Workflow Applications , 2017, IEEE Transactions on Automation Science and Engineering.

[47]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[48]  Victor I. Chang,et al.  Multi-objective scheduling for scientific workflow in multicloud environment , 2018, J. Netw. Comput. Appl..