Scheduling Scientific Workflow Using Multi-Objective Algorithm With Fuzzy Resource Utilization in Multi-Cloud Environment

The provision of resources and services for scientific workflow applications using a multi-cloud architecture and a pay-per-use rule has recently gained popularity within the cloud computing research domain. This is because workflow applications are computation intensive. Most of the existing studies on workflow scheduling in the cloud mainly focus on finding an ideal makespan or cost. Nevertheless, there are other important quality of service metrics that are of critical concern in workflow scheduling such as reliability and resource utilization. In this respect, this paper proposes a new multi-objective scheduling algorithm with Fuzzy resource utilization (FR-MOS) for scheduling scientific workflow based on particle swarm optimization (PSO) method. The algorithm minimizes cost and makespan while considering reliability constraint. The coding scheme jointly considers task execution location and data transportation order. Simulation experiments reveal that FR-MOS outperforms the basic MOS over the PSO algorithm.

[1]  Swarm, Evolutionary, and Memetic Computing , 2011, Lecture Notes in Computer Science.

[2]  Xiaohui Liu,et al.  Evolutionary Multi-Objective Workflow Scheduling in Cloud , 2016, IEEE Transactions on Parallel and Distributed Systems.

[3]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[4]  Jonathan E. Fieldsend,et al.  A MOPSO Algorithm Based Exclusively on Pareto Dominance Concepts , 2005, EMO.

[5]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[6]  Albert Y. Zomaya,et al.  PSO-DS: a scheduling engine for scientific workflow managers , 2017, The Journal of Supercomputing.

[7]  Rajkumar Buyya,et al.  An Algorithm for Network and Data-aware Placement of Multi-Tier Applications in Cloud Data Centers , 2017, J. Netw. Comput. Appl..

[8]  Yahya Slimani,et al.  A survey on cloud service description , 2017, J. Netw. Comput. Appl..

[9]  Kenli Li,et al.  Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems , 2017, Inf. Sci..

[10]  Rajkumar Buyya,et al.  Enhancing Reliability of Workflow Execution Using Task Replication and Spot Instances , 2016, ACM Trans. Auton. Adapt. Syst..

[11]  Radu Prodan,et al.  Multi-objective list scheduling of workflow applications in distributed computing infrastructures , 2014, J. Parallel Distributed Comput..

[12]  Saeid Abrishami,et al.  Scheduling Data-Driven Workflows in Multi-cloud Environment , 2015, 2015 IEEE 7th International Conference on Cloud Computing Technology and Science (CloudCom).

[13]  Yudi Wei,et al.  QoS Guarantees and Service Differentiation for Dynamic Cloud Applications , 2013, IEEE Transactions on Network and Service Management.

[14]  Muhammad Khurram Khan,et al.  Information collection centric techniques for cloud resource management: Taxonomy, analysis and challenges , 2017, J. Netw. Comput. Appl..

[15]  Shengxiang Yang,et al.  Shift-Based Density Estimation for Pareto-Based Algorithms in Many-Objective Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[16]  Jin Sun,et al.  Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based HEFT , 2019, Future Gener. Comput. Syst..

[17]  J. Mendel.  Fuzzy logic systems for engineering: a tutorial , 1995, Proc. IEEE.

[18]  Hans-Arno Jacobsen,et al.  Scientific Workflow Mining in Clouds , 2017, IEEE Transactions on Parallel and Distributed Systems.

[19]  Mansoor Alam,et al.  Reliability and Utilization Evaluation of a Cloud Computing System Allowing Partial Failures , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[20]  Emmanuel Jeannot,et al.  Optimizing performance and reliability on heterogeneous parallel systems: Approximation algorithms and heuristics , 2012, J. Parallel Distributed Comput..

[21]  Prasanta K. Jana,et al.  Compute-intensive workflow scheduling in multi-cloud environment , 2016, 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[22]  Soonwook Hwang,et al.  Grid workflow: a flexible failure handling framework for the grid , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[23]  Gang Sun,et al.  Live Migration for Multiple Correlated Virtual Machines in Cloud-Based Data Centers , 2018, IEEE Transactions on Services Computing.

[24]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[25]  Albert Y. Zomaya,et al.  An integrated task computation and data management scheduling strategy for workflow applications in cloud environments , 2015, J. Netw. Comput. Appl..

[26]  Naixue Xiong,et al.  Cost-Driven Scheduling for Deadline-Constrained Workflow on Multi-clouds , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium Workshop.

[27]  Kakali Chatterjee,et al.  Cloud security issues and challenges: A survey , 2017, J. Netw. Comput. Appl..

[28]  Victor I. Chang,et al.  A model to compare cloud and non-cloud storage of Big Data , 2016, Future Gener. Comput. Syst..

[29]  Mengjie Zhang,et al.  A memetic particle swarm optimization for constrained multi-objective optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[30]  Boon Thau Loo,et al.  Optimizing cost and performance trade-offs for MapReduce job processing in the cloud , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[31]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[32]  Hou-Ping Dai,et al.  Effects of Random Values for Particle Swarm Optimization Algorithm , 2018, Algorithms.

[33]  Mehdi Kargahi,et al.  Ant colony based constrained workflow scheduling for heterogeneous computing systems , 2016, Cluster Computing.

[34]  Victor I. Chang,et al.  Multi-objective scheduling for scientific workflow in multicloud environment , 2018, J. Netw. Comput. Appl..

[35]  Xiaorong Li,et al.  SABA: A security-aware and budget-aware workflow scheduling strategy in clouds , 2015, J. Parallel Distributed Comput..

[36]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[37]  Sarbjeet Singh,et al.  A Budget-constrained Time and Reliability Optimization BAT Algorithm for Scheduling Workflow Applications in Clouds , 2016, EUSPN/ICTH.

[38]  Rajkumar Buyya,et al.  Meeting Deadlines of Scientific Workflows in Public Clouds with Tasks Replication , 2014, IEEE Transactions on Parallel and Distributed Systems.

[39]  Radu Prodan,et al.  MOHEFT: A multi-objective list-based method for workflow scheduling , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[40]  Gary G. Yen,et al.  PSO-Based Multiobjective Optimization With Dynamic Population Size and Adaptive Local Archives , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Shafii Muhammad Abdulhamid,et al.  Resource scheduling for infrastructure as a service (IaaS) in cloud computing: Challenges and opportunities , 2016, J. Netw. Comput. Appl..

[42]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[43]  Bin Luo,et al.  Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds , 2018, IEEE Transactions on Services Computing.

[44]  Inderveer Chana,et al.  QoS-Aware Autonomic Resource Management in Cloud Computing , 2015, ACM Comput. Surv..

[45]  Mehdi Kargahi,et al.  Reliability-driven scheduling of time/cost-constrained grid workflows , 2016, Future Gener. Comput. Syst..

[46]  LiGuo Huang,et al.  A security and cost aware scheduling algorithm for heterogeneous tasks of scientific workflow in clouds , 2016, Future Gener. Comput. Syst..