A novel cloud workflow scheduling algorithm based on stable matching game theory

Workflow scheduling is one of the most popular and challenging problems in cloud computing. However, among the studies on cloud workflow scheduling, very few consider the fairness among workflow tasks which could significantly delay the workflows and hence deteriorates user satisfaction. In this paper, we propose a workflow scheduling algorithm based on stable matching game theory to minimize workflow makespan and ensure the fairness among the tasks. The local optimization methods based on critical path and task duplication are developed to improve the performance of the algorithm. In addition, a novel evaluation metric is proposed to measure the fairness among workflow tasks. Comprehensive experiments are conducted to compare the performance of the proposed algorithm with other four representative algorithms. Experimental results demonstrate that our algorithm outperforms the other compared algorithms in terms of all three performance metrics under different workflow applications.

[1]  Chung-Piaw Teo,et al.  Many-to-One Stable Matching: Geometry and Fairness , 2006, Math. Oper. Res..

[2]  Kim-Kwang Raymond Choo,et al.  A task scheduling algorithm considering game theory designed for energy management in cloud computing , 2017, Future Gener. Comput. Syst..

[3]  Long Chen,et al.  Idle block based methods for cloud workflow scheduling with preemptive and non-preemptive tasks , 2018, Future Gener. Comput. Syst..

[4]  Ahmad M. Manasrah,et al.  Workflow Scheduling Using Hybrid GA-PSO Algorithm in Cloud Computing , 2018, Wirel. Commun. Mob. Comput..

[5]  Xiao Liu,et al.  Soft error-aware energy-efficient task scheduling for workflow applications in DVFS-enabled cloud , 2018, J. Syst. Archit..

[6]  Yang Liu,et al.  An improved task scheduling algorithm for scientific workflow in cloud computing environment , 2019, Cluster Computing.

[7]  Mainak Adhikari,et al.  Cloud Computing: A Multi-workflow Scheduling Algorithm with Dynamic Reusability , 2018 .

[8]  Xiao Liu,et al.  Forecasting Duration Intervals of Scientific Workflow Activities Based on Time-Series Patterns , 2008, 2008 IEEE Fourth International Conference on eScience.

[9]  Dick H. J. Epema,et al.  Fair multiple-workflow scheduling with different quality-of-service goals , 2018, The Journal of Supercomputing.

[10]  Mohammed F. AlRahmawy,et al.  An extended Intelligent Water Drops algorithm for workflow scheduling in cloud computing environment , 2017 .

[11]  Xiao Liu,et al.  A Revised Discrete Particle Swarm Optimization for Cloud Workflow Scheduling , 2010, 2010 International Conference on Computational Intelligence and Security.

[12]  Wail Mardini,et al.  Workflow Scheduling in Cloud Computing Using Memetic Algorithm , 2019, 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT).

[13]  Ehsan Ullah Munir,et al.  MOPT: list-based heuristic for scheduling workflows in cloud environment , 2018, The Journal of Supercomputing.

[14]  Xianfu Meng,et al.  A DAG Scheduling Algorithm Based on Selected Duplication of Precedent Tasks: A DAG Scheduling Algorithm Based on Selected Duplication of Precedent Tasks , 2010 .

[15]  Claudio Fabiano Motta Toledo,et al.  Genetic-based algorithms applied to a workflow scheduling algorithm with security and deadline constraints in clouds , 2017, Comput. Electr. Eng..

[16]  Sanjay Kadam,et al.  A novel multi-objective bacteria foraging optimization algorithm (MOBFOA) for multi-objective scheduling , 2018, Appl. Soft Comput..

[17]  Yuan Zhang,et al.  A Task Scheduling Algorithm for Multi-Core-Cluster Systems , 2012, J. Comput..

[18]  Qingsheng Zhu,et al.  Fluctuation-Aware and Predictive Workflow Scheduling in Cost-Effective Infrastructure-as-a-Service Clouds , 2018, IEEE Access.

[19]  Deo Prakash Vidyarthi,et al.  A Cost-Effective Deadline-Constrained Dynamic Scheduling Algorithm for Scientific Workflows in a Cloud Environment , 2018, IEEE Transactions on Cloud Computing.

[20]  Xiaoying Zheng,et al.  Workflow Scheduling in the Cloud With Weighted Upward-Rank Priority Scheme Using Random Walk and Uniform Spare Budget Splitting , 2019, IEEE Access.

[21]  Yuan Zhang,et al.  A stable matching based elephant flow scheduling algorithm in data center networks , 2017, Comput. Networks.

[22]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[23]  Victor Chang,et al.  Security modeling and efficient computation offloading for service workflow in mobile edge computing , 2019, Future Gener. Comput. Syst..

[24]  Sudarshan Nandy,et al.  Sustainable task scheduling strategy in cloudlets , 2021, Sustain. Comput. Informatics Syst..

[25]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[26]  T. Revathi,et al.  Game multi objective scheduling algorithm for scientific workflows in cloud computing , 2015, 2015 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2015].

[27]  Prasanta K. Jana,et al.  Delay-based workflow scheduling for cost optimization in heterogeneous cloud system , 2017, 2017 Tenth International Conference on Contemporary Computing (IC3).

[28]  Ye Heng-zhou,et al.  k-HEFT: A static task scheduling algorithm in clouds , 2018 .

[29]  Indrajeet Gupta,et al.  Efficient Workflow Scheduling Algorithm for Cloud Computing System: A Dynamic Priority-Based Approach , 2018, The Arabian journal for science and engineering.

[30]  Pethuru Raj Chelliah,et al.  Energy efficient workflow scheduling with virtual machine consolidation for green cloud computing , 2018, J. Intell. Fuzzy Syst..

[31]  Ying Yin,et al.  Multi Objective Scheduling in Cloud Computing Using MOSSO , 2018, 2018 IEEE Congress on Evolutionary Computation (CEC).

[32]  Xiao Liu,et al.  A market-oriented hierarchical scheduling strategy in cloud workflow systems , 2011, The Journal of Supercomputing.

[33]  Keqin Li,et al.  Efficient task scheduling for budget constrained parallel applications on heterogeneous cloud computing systems , 2017, Future Gener. Comput. Syst..

[34]  Hamza Djigal,et al.  IPPTS: An Efficient Algorithm for Scientific Workflow Scheduling in Heterogeneous Computing Systems , 2021, IEEE Transactions on Parallel and Distributed Systems.

[35]  Manoj Singh Gaur,et al.  QuickDedup: Efficient VM deduplication in cloud computing environments , 2020, J. Parallel Distributed Comput..

[36]  Victor I. Chang,et al.  Multi-objective scheduling for scientific workflow in multicloud environment , 2018, J. Netw. Comput. Appl..

[37]  Jinman Jung,et al.  K-LZF : An efficient and fair scheduling for Edge Computing servers , 2019, Future Gener. Comput. Syst..

[38]  Prasanta K. Jana,et al.  Granularity-based workflow scheduling algorithm for cloud computing , 2017, The Journal of Supercomputing.

[39]  Prasanta K. Jana,et al.  A GSA based hybrid algorithm for bi-objective workflow scheduling in cloud computing , 2018, Future Gener. Comput. Syst..

[40]  Xiao Liu,et al.  A Cost-Effective Time-Constrained Multi-workflow Scheduling Strategy in Fog Computing , 2018, ICSOC Workshops.

[41]  Chi-Sheng Shih,et al.  Fairness scheduler for virtual machines on heterogonous multi-core platforms , 2013, SIAP.

[42]  Jinjun Chen,et al.  Cost optimization for deadline-aware scheduling of big-data processing jobs on clouds , 2017, Future Gener. Comput. Syst..

[43]  Qingsheng Zhu,et al.  A Multi-stage Dynamic Game-Theoretic Approach for Multi-Workflow Scheduling on Heterogeneous Virtual Machines from Multiple Infrastructure-as-a-Service Clouds , 2018, SCC.

[44]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[45]  Dharma P. Agrawal,et al.  Optimal Scheduling Algorithm for Distributed-Memory Machines , 1998, IEEE Trans. Parallel Distributed Syst..

[46]  Ye Yuan,et al.  An Improved Particle Swarm Optimization Algorithm Based on Adaptive Weight for Task Scheduling in Cloud Computing , 2018, CSAE '18.

[47]  Claude Tadonki,et al.  E-HEFT: Enhancement Heterogeneous Earliest Finish Time algorithm for Task Scheduling based on Load Balancing in Cloud Computing , 2018, 2018 International Conference on High Performance Computing & Simulation (HPCS).

[48]  Albert Y. Zomaya,et al.  GA-ETI: An enhanced genetic algorithm for the scheduling of scientific workflows in cloud environments , 2016, J. Comput. Sci..

[49]  Li Liu,et al.  An adaptive multi-objective evolutionary algorithm for constrained workflow scheduling in Clouds , 2018, Distributed and Parallel Databases.

[50]  Haluk Topcuoglu,et al.  Dynamic Multi-Objective Workflow Scheduling for Cloud Computing Based on Evolutionary Algorithms , 2018, 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion).

[51]  Ian J. Taylor,et al.  Workflows and e-Science: An overview of workflow system features and capabilities , 2009, Future Gener. Comput. Syst..

[52]  Yun Yang,et al.  A novel directional and non-local-convergent particle swarm optimization based workflow scheduling in cloud-edge environment , 2019, Future Gener. Comput. Syst..