A Hybrid Algorithm for Scheduling Scientific Workflows in Cloud Computing

Cloud computing has become the main source for executing scientific experiments. It is an effective technique for distributing and processing tasks on virtual machines. Scientific workflows are complex and demand efficient utilization of cloud resources. Scheduling of scientific workflows is considered as NP-complete. The problem is constrained by some parameters such as Quality of Service (QoS), dependencies between tasks and users’ deadlines, etc. There exists a strong literature on scheduling scientific workflows in cloud environments. Solutions include standard schedulers, evolutionary optimization techniques, etc. This article presents a hybrid algorithm for scheduling scientific workflows in cloud environments. In the first phase, the algorithm prepares tasks lists for PSO algorithm. Bottleneck tasks are processed on high priority to reduce execution time. In the next phase, tasks are scheduled with the PSO algorithm to reduce both execution time and monetary cost. The algorithm also monitors the load balance to efficiently utilize cloud resources. Benchmark scientific workflows are used to evaluate the proposed algorithm. The proposed algorithm is compared with standard PSO and specialized schedulers to validate the performance. The results show improvement in execution time, monetary cost without affecting the load balance as compared to other techniques.

[1]  Scott D. Kahn.  On the Future of Genomic Data , 2011, Science.

[2]  Rajkumar Buyya,et al.  A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments , 2017, Concurr. Comput. Pract. Exp..

[3]  Mei-Hui Su,et al.  Characterization of scientific workflows , 2008, 2008 Third Workshop on Workflows in Support of Large-Scale Science.

[4]  Chen Junjie,et al.  An optimized scheduling algorithm on a cloud workflow using a discrete particle swarm , 2014 .

[5]  Guanfeng Liu,et al.  Three Levels Load Balancing on Cloudsim , 2014 .

[6]  Yun Yang,et al.  A Chaotic Particle Swarm Optimization-Based Heuristic for Market-Oriented Task-Level Scheduling in Cloud Workflow Systems , 2015, Comput. Intell. Neurosci..

[7]  Yue Zhou,et al.  Scheduling Workflow in Cloud Computing Based on Ant Colony Optimization Algorithm , 2013, 2013 Sixth International Conference on Business Intelligence and Financial Engineering.

[8]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[9]  Jing Fan,et al.  Scheduling Budget Constrained Cloud Workflows with Particle Swarm Optimization , 2015, 2015 IEEE Conference on Collaboration and Internet Computing (CIC).

[10]  Rajkumar Buyya,et al.  Workflow scheduling algorithms for grid computing , 2008 .

[11]  Ahmad M. Manasrah,et al.  Workflow Scheduling Using Hybrid GA-PSO Algorithm in Cloud Computing , 2018, Wirel. Commun. Mob. Comput..

[12]  Sakshi Kaushal,et al.  A hybrid multi-objective Particle Swarm Optimization for scientific workflow scheduling , 2017, Parallel Comput..

[13]  Huifang Deng,et al.  Elastic Scheduling of Scientific Workflows under Deadline Constraints in Cloud Computing Environments , 2018, Future Internet.

[14]  Chee Sun Liew,et al.  A hybrid genetic algorithm for optimization of scheduling workflow applications in heterogeneous computing systems , 2016, J. Parallel Distributed Comput..

[15]  Liang Liu,et al.  A multi-objective ant colony system algorithm for virtual machine placement in cloud computing , 2013, J. Comput. Syst. Sci..

[16]  Li Liu,et al.  A Survey on Workflow Management and Scheduling in Cloud Computing , 2014, 2014 14th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[17]  Rajkumar Buyya,et al.  Deadline‐constrained coevolutionary genetic algorithm for scientific workflow scheduling in cloud computing , 2017, Concurr. Comput. Pract. Exp..

[18]  S. Jaya Nirmala,et al.  Catfish-PSO based scheduling of scientific workflows in IaaS cloud , 2016, Computing.

[19]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[20]  Albert Y. Zomaya,et al.  GA-ETI: An enhanced genetic algorithm for the scheduling of scientific workflows in cloud environments , 2016, J. Comput. Sci..

[21]  Mohammad Masdari,et al.  A Survey of PSO-Based Scheduling Algorithms in Cloud Computing , 2016, Journal of Network and Systems Management.

[22]  Arash Ghorbannia Delavar,et al.  A BI -OBJECTIVE WORKFLOW APPLICATION SCHEDULING IN CLOUD COMPUTING SYSTEMS , 2014 .

[23]  Jinjun Chen,et al.  A Hybrid Genetic Algorithm for Privacy and Cost Aware Scheduling of Data Intensive Workflow in Cloud , 2015, ICA3PP.

[24]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[25]  Muhammad Sardaraz,et al.  Evolutionary Algorithms in Cloud Computing from the Perspective of Energy Consumption: A Review , 2018, 2018 14th International Conference on Emerging Technologies (ICET).

[26]  Enda Barrett,et al.  A Learning Architecture for Scheduling Workflow Applications in the Cloud , 2011, 2011 IEEE Ninth European Conference on Web Services.

[27]  Victor I. Chang,et al.  Multi-objective scheduling for scientific workflow in multicloud environment , 2018, J. Netw. Comput. Appl..

[28]  Joel J. P. C. Rodrigues,et al.  Metaheuristic Scheduling for Cloud: A Survey , 2014, IEEE Systems Journal.

[29]  Albert Y. Zomaya,et al.  PSO-DS: a scheduling engine for scientific workflow managers , 2017, The Journal of Supercomputing.

[30]  Mohammad Masdari,et al.  Towards workflow scheduling in cloud computing: A comprehensive analysis , 2016, J. Netw. Comput. Appl..

[31]  Muhammad Tahir,et al.  Advances in high throughput DNA sequence data compression , 2016, J. Bioinform. Comput. Biol..

[32]  Gang Zhao,et al.  Cost-Aware Scheduling Algorithm Based on PSO in Cloud Computing Environment , 2014 .

[33]  Sakshi Kaushal,et al.  Cost-Time Efficient Scheduling Plan for Executing Workflows in the Cloud , 2015, Journal of Grid Computing.

[34]  Rajkumar Buyya,et al.  A taxonomy of scientific workflow systems for grid computing , 2005, SGMD.

[35]  Bertrand Granado,et al.  Multi-Objective Approach for Energy-Aware Workflow Scheduling in Cloud Computing Environments , 2013, TheScientificWorldJournal.

[36]  Amandeep Verma,et al.  Scheduling using improved genetic algorithm in cloud computing for independent tasks , 2012, ICACCI '12.

[37]  Emmanuel Ahene,et al.  A Multi-objective Optimization Approach to Workflow Scheduling in Clouds Considering Fault Recovery , 2016, KSII Trans. Internet Inf. Syst..

[38]  Sakshi Kaushal,et al.  Budget constrained priority based genetic algorithm for workflow scheduling in cloud , 2013, ARTCom 2013.

[39]  Raouf Boutaba,et al.  Cloud computing: state-of-the-art and research challenges , 2010, Journal of Internet Services and Applications.

[40]  Xiao Liu,et al.  A Revised Discrete Particle Swarm Optimization for Cloud Workflow Scheduling , 2010, 2010 International Conference on Computational Intelligence and Security.

[41]  Yang Zhaofeng,et al.  Application of Ant colony Algorithm in Cloud Resource Scheduling Based on Three Constraint Conditions , 2016 .

[42]  Takahiro Hara,et al.  A Multi-Objective Optimization Scheduling Method Based on the Ant Colony Algorithm in Cloud Computing , 2015, IEEE Access.