Cost-effective workflow scheduling approach on cloud under deadline constraint using firefly algorithm

Cloud computing, a novel and promising methodology in the distributed computing domain, provides a pay-per-use framework to solve large-scale scientific and business workflow applications. These workflow applications have a constraint that each of them must completed within the limited time (deadline constraint). Therefore, scheduling a workflow with deadline constraints is increasingly becoming a crucial research issue. However, many analytical reviews on scheduling problems reveal that existing solutions fail to provide cost-effective solutions and they do not consider the parameters like CPU performance variation, delay in acquisition and termination of Virtual Machines (VMs). This paper presents a Cost-Effective Firefly based Algorithm (CEFA) to solve workflow scheduling problems that can occur in an Infrastructure as a Service (IaaS) platform. The proposed CEFA uses a novel method for problem encoding, population initialization and fitness evaluation with an objective to provide cost-effective and optimized workflow execution within the time limit. The performance of the proposed CEFA is compared with the state-of-the-art algorithms such as IaaS Cloud-Partial Critical Path (IC-PCP), Particle Swarm Optimization (PSO), Robustness-Cost-Time (RCT), Robustness-Time-Cost (RTC), and Regressive Whale Optimization (RWO). Our experimental results demonstrate that the proposed CEFA outperforms current state-of-the-art heuristics with the criteria of achieving the deadline constraint and minimizing the cost of execution.

[1]  Mei-Hui Su,et al.  Characterization of scientific workflows , 2008, 2008 Third Workshop on Workflows in Support of Large-Scale Science.

[2]  Manu Vardhan,et al.  Efficient Utilization of Commodity Computers in Academic Institutes: A Cloud Computing Approach , 2015 .

[3]  Jarek Nabrzyski,et al.  Cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[4]  Ritu Garg,et al.  Multi-objective workflow grid scheduling using $$\varepsilon $$ε-fuzzy dominance sort based discrete particle swarm optimization , 2014, The Journal of Supercomputing.

[5]  Huifang Deng,et al.  Elastic Scheduling of Scientific Workflows under Deadline Constraints in Cloud Computing Environments , 2018, Future Internet.

[6]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[7]  Jun Zhang,et al.  Deadline constrained cloud computing resources scheduling for cost optimization based on dynamic objective genetic algorithm , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[8]  Marty Humphrey,et al.  Auto-scaling to minimize cost and meet application deadlines in cloud workflows , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[9]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[10]  Shi Mei WFMS:WORKFLOW MANAGEMENT SYSTEM , 1999 .

[11]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[12]  Rajkumar Buyya,et al.  Critical-path and priority based algorithms for scheduling workflows with parameter sweep tasks on global grids , 2005, 17th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD'05).

[13]  D. Agrawal,et al.  Handbook of Research on Cloud Computing and Big Data Applications in IoT , 2019, Advances in Computer and Electrical Engineering.

[14]  Oladayo Olufemi Olakanmi,et al.  An Efficient Privacy-preserving Approach for Secure Verifiable Outsourced Computing on Untrusted Platforms , 2019, Int. J. Cloud Appl. Comput..

[15]  Tiago Ferra de Sousa,et al.  Particle Swarm based Data Mining Algorithms for classification tasks , 2004, Parallel Comput..

[16]  Xiaohui Liu,et al.  Evolutionary Multi-Objective Workflow Scheduling in Cloud , 2016, IEEE Transactions on Parallel and Distributed Systems.

[17]  Rajkumar Buyya,et al.  A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments , 2017, Concurr. Comput. Pract. Exp..

[18]  Rajkumar Buyya,et al.  Meeting Deadlines of Scientific Workflows in Public Clouds with Tasks Replication , 2014, IEEE Transactions on Parallel and Distributed Systems.

[19]  Pon. Partheeban,et al.  Versatile provisioning and workflow scheduling in WaaS under cost and deadline constraints for cloud computing , 2018, Trans. Emerg. Telecommun. Technol..

[20]  Sai Peck Lee,et al.  Cost-aware challenges for workflow scheduling approaches in cloud computing environments: Taxonomy and opportunities , 2015, Future Gener. Comput. Syst..

[21]  Zhen Chen,et al.  Low-time complexity and low-cost binary particle swarm optimization algorithm for task scheduling and load balancing in cloud computing , 2019, Applied Intelligence.

[22]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[23]  Alexandru Iosup,et al.  A Performance Analysis of EC2 Cloud Computing Services for Scientific Computing , 2009, CloudComp.

[24]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[25]  Xin-She Yang,et al.  Chaos-Enhanced Firefly Algorithm with Automatic Parameter Tuning , 2011, Int. J. Swarm Intell. Res..

[26]  Padma Iyenghar,et al.  A Model-Driven Workflow for Energy-Aware Scheduling Analysis of IoT-Enabled Use Cases , 2018, IEEE Internet of Things Journal.

[27]  Guolong Chen,et al.  Cost-Driven Scheduling for Deadline-Based Workflow Across Multiple Clouds , 2018, IEEE Transactions on Network and Service Management.

[28]  Deo Prakash Vidyarthi,et al.  A Cost-Effective Deadline-Constrained Dynamic Scheduling Algorithm for Scientific Workflows in a Cloud Environment , 2018, IEEE Transactions on Cloud Computing.

[29]  Xiao Liu,et al.  A Revised Discrete Particle Swarm Optimization for Cloud Workflow Scheduling , 2010, 2010 International Conference on Computational Intelligence and Security.

[30]  AlkhanakEhab Nabiel,et al.  Cost-aware challenges for workflow scheduling approaches in cloud computing environments , 2015 .

[31]  Jemal H. Abawajy,et al.  An efficient meta-heuristic algorithm for grid computing , 2013, Journal of Combinatorial Optimization.

[32]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[33]  Janez Brest,et al.  A comprehensive review of firefly algorithms , 2013, Swarm Evol. Comput..

[34]  Sucha Smanchat,et al.  Taxonomies of workflow scheduling problem and techniques in the cloud , 2015, Future Gener. Comput. Syst..

[35]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[36]  Bryan Ng,et al.  Budget and Deadline Aware e-Science Workflow Scheduling in Clouds , 2019, IEEE Transactions on Parallel and Distributed Systems.

[37]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..

[38]  Ali Afzal,et al.  QoS-Constrained Stochastic Workflow Scheduling in Enterprise and Scientific Grids , 2006, GRID.

[39]  Rizos Sakellariou,et al.  Energy-Constrained Provisioning for Scientific Workflow Ensembles , 2013, 2013 International Conference on Cloud and Green Computing.

[40]  Rajkumar Buyya,et al.  Cost-based scheduling of scientific workflow applications on utility grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[41]  Radu Prodan,et al.  Performance and cost optimization for multiple large-scale grid workflow applications , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[42]  Jie Huang,et al.  The Workflow Task Scheduling Algorithm Based on the GA Model in the Cloud Computing Environment , 2014, J. Softw..

[43]  G. Narendrababu Reddy,et al.  Regressive Whale Optimization for Workflow Scheduling in Cloud Computing , 2019, Int. J. Comput. Intell. Appl..

[44]  Yun Yang,et al.  Robust Scheduling of Scientific Workflows with Deadline and Budget Constraints in Clouds , 2014, 2014 IEEE 28th International Conference on Advanced Information Networking and Applications.