Meta-heuristic Approaches for Effective Scheduling in Infrastructure as a Service Cloud: A Systematic Review

Cloud computing involves a large number of shared virtual servers that are accessible from both public and private networks. It has provided scalable and multitenant computing approaches for Infrastructure as a Service, Software as a Service, and Platform as a Service to cloud users on pay-per-use bases. Over the past decades, researchers from different domains such as astronomy, physics, earth science, and bioinformatics have used scientific workflow applications to model many real-world problems in both paralleled and distributed computing environments. However, achieving efficient workflow scheduling is challenging. This is due to the large size of the task set that each workflow application generates. The complex dependencies between these workflows make it difficult to find an optimal solution to workflow scheduling problems within polynomial time. This paper analyzed workflows scheduling problems in cloud and grid computing environment through providing a comprehensive survey based on the state-of-the-art meta-heuristic algorithms. We analyzed the literature from four perspectives, including (i) existing meta-heuristics, (ii) scheduling efficiency, system performance, and execution budget, (iii) scheduling environment and (iv) quality of service performance metrics. Also, we have presented the research gaps and provided future directions for future investigation.

[1]  Mohammed Joda Usman,et al.  Performance comparison of heuristic algorithms for task scheduling in IaaS cloud computing environment , 2017, PloS one.

[2]  Fahime Moein-darbari,et al.  Scheduling of scientific workflows using a chaos-genetic algorithm , 2010, ICCS.

[3]  Hussam N. Fakhouri,et al.  Supernova Optimizer: A Novel Natural Inspired Meta-Heuristic , 2017 .

[4]  Yuhui Shi,et al.  Metaheuristic research: a comprehensive survey , 2018, Artificial Intelligence Review.

[5]  Chuntian Cheng,et al.  Optimizing Hydropower Reservoir Operation Using Hybrid Genetic Algorithm and Chaos , 2008 .

[6]  Poonam Singh,et al.  A review of task scheduling based on meta-heuristics approach in cloud computing , 2017, Knowledge and Information Systems.

[7]  Mahamed G. H. Omran,et al.  Global-best harmony search , 2008, Appl. Math. Comput..

[8]  Nelson Luis Saldanha da Fonseca,et al.  Scheduling in hybrid clouds , 2012, IEEE Communications Magazine.

[9]  Wasif Afzal,et al.  A systematic review of search-based testing for non-functional system properties , 2009, Inf. Softw. Technol..

[10]  Baozhen Yao,et al.  Improved artificial bee colony algorithm for vehicle routing problem with time windows , 2017, PloS one.

[11]  Omid Bozorg Haddad,et al.  Honey-Bees Mating Optimization (HBMO) Algorithm: A New Heuristic Approach for Water Resources Optimization , 2006 .

[12]  Yue-Shan Chang,et al.  Adaptive scheduling for parallel tasks with QoS satisfaction for hybrid cloud environments , 2013, The Journal of Supercomputing.

[13]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[14]  Pearl Brereton,et al.  Systematic literature reviews in software engineering - A systematic literature review , 2009, Inf. Softw. Technol..

[15]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[16]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[17]  Xin-She Yang,et al.  Flower pollination algorithm: A novel approach for multiobjective optimization , 2014, ArXiv.

[18]  Amandeep Kaur,et al.  Optimizing the Design of Airfoil and Optical Buffer Problems Using Spotted Hyena Optimizer , 2018 .

[19]  Mikhail Melnik,et al.  Polyrhythmic Harmony Search for Workflow Scheduling , 2015 .

[20]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[21]  A. Gandomi Interior search algorithm (ISA): a novel approach for global optimization. , 2014, ISA transactions.

[22]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[23]  Stephen A. Jarvis,et al.  Grid load balancing using intelligent agents , 2005, Future Gener. Comput. Syst..

[24]  Mehmet Fatih Tasgetiren,et al.  A discrete artificial bee colony algorithm for the lot-streaming flow shop scheduling problem , 2011, Inf. Sci..

[25]  Mehdi Sargolzaei,et al.  Swallow swarm optimization algorithm: a new method to optimization , 2012, Neural Computing and Applications.

[26]  Shengyao Wang,et al.  An effective artificial bee colony algorithm for the flexible job-shop scheduling problem , 2012 .

[27]  Takahiro Hara,et al.  A Multi-Objective Optimization Scheduling Method Based on the Ant Colony Algorithm in Cloud Computing , 2015, IEEE Access.

[28]  Hacer Güner Gören,et al.  A review of applications of genetic algorithms in lot sizing , 2010, J. Intell. Manuf..

[29]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..

[30]  Fatos Xhafa,et al.  Computational models and heuristic methods for Grid scheduling problems , 2010, Future Gener. Comput. Syst..

[31]  Yang Xianfeng,et al.  Load Balancing of Virtual Machines in Cloud Computing Environment Using Improved Ant Colony Algorithm , 2015 .

[32]  Pierre Hansen,et al.  Variable Neighborhood Search , 2018, Handbook of Heuristics.

[33]  Nima Jafari Navimipour,et al.  Load balancing mechanisms and techniques in the cloud environments: Systematic literature review and future trends , 2016, J. Netw. Comput. Appl..

[34]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[35]  Manu Vardhan,et al.  Cost Effective Genetic Algorithm for Workflow Scheduling in Cloud Under Deadline Constraint , 2016, IEEE Access.

[36]  Hamid Arabnejad,et al.  Maximizing the completion rate of concurrent scientific applications under time and budget constraints , 2017, J. Comput. Sci..

[37]  Hadi Shahriar Shahhoseini,et al.  An efficient ACO-based algorithm for scheduling tasks onto dynamically reconfigurable hardware using TSP-likened construction graph , 2016, Applied Intelligence.

[38]  Keiichiro Yasuda,et al.  Spiral Dynamics Inspired Optimization , 2011, J. Adv. Comput. Intell. Intell. Informatics.

[39]  Lin Zhang,et al.  Greedy-Ant: Ant Colony System-Inspired Workflow Scheduling for Heterogeneous Computing , 2017, IEEE Access.

[40]  P. Shekelle,et al.  Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement , 2015, Systematic Reviews.

[41]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[42]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[43]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[44]  Joel J. P. C. Rodrigues,et al.  Metaheuristic Scheduling for Cloud: A Survey , 2014, IEEE Systems Journal.

[45]  Xiaomin Zhu,et al.  Real-Time Tasks Oriented Energy-Aware Scheduling in Virtualized Clouds , 2014, IEEE Transactions on Cloud Computing.

[46]  Rajkumar Buyya,et al.  A taxonomy and survey on scheduling algorithms for scientific workflows in IaaS cloud computing environments , 2017, Concurr. Comput. Pract. Exp..

[47]  F. Glover HEURISTICS FOR INTEGER PROGRAMMING USING SURROGATE CONSTRAINTS , 1977 .

[48]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[49]  Nicolás Ruiz-Reyes,et al.  Dynamic Voltage Frequency Scaling Simulator for Real Workflows Energy-Aware Management in Green Cloud Computing , 2017, PloS one.

[50]  Gaurav Dhiman,et al.  Spotted hyena optimizer: A novel bio-inspired based metaheuristic technique for engineering applications , 2017, Adv. Eng. Softw..

[51]  C. P. Katti,et al.  Cost‐effective deadline‐aware stochastic scheduling strategy for workflow applications on virtual machines in cloud computing , 2018, Concurr. Comput. Pract. Exp..

[52]  Jiadong Yang,et al.  A hybrid harmony search algorithm for the flexible job shop scheduling problem , 2013, Appl. Soft Comput..

[53]  L. D. Dhinesh Babu,et al.  Honey bee behavior inspired load balancing of tasks in cloud computing environments , 2013, Appl. Soft Comput..

[54]  Claudio Fabiano Motta Toledo,et al.  Genetic-based algorithms applied to a workflow scheduling algorithm with security and deadline constraints in clouds , 2017, Comput. Electr. Eng..

[55]  Reza Tavakkoli-Moghaddam,et al.  The Social Engineering Optimizer (SEO) , 2018, Eng. Appl. Artif. Intell..

[56]  Aida A. Nasr,et al.  Cost-Effective Algorithm for Workflow Scheduling in Cloud Computing Under Deadline Constraint , 2019 .

[57]  Yan-Feng Liu,et al.  A hybrid discrete artificial bee colony algorithm for permutation flowshop scheduling problem , 2013, Appl. Soft Comput..

[58]  A.A. Kishk,et al.  Invasive Weed Optimization and its Features in Electromagnetics , 2010, IEEE Transactions on Antennas and Propagation.

[59]  Sai Peck Lee,et al.  Cost optimization approaches for scientific workflow scheduling in cloud and grid computing: A review, classifications, and open issues , 2016, J. Syst. Softw..

[60]  Alireza Souri,et al.  Multiobjective virtual machine placement mechanisms using nature‐inspired metaheuristic algorithms in cloud environments: A comprehensive review , 2019, Int. J. Commun. Syst..

[61]  Xuyun Zhang,et al.  EnReal: An Energy-Aware Resource Allocation Method for Scientific Workflow Executions in Cloud Environment , 2016, IEEE Transactions on Cloud Computing.

[62]  Albert Y. Zomaya,et al.  CONCURRENCY AND COMPUTATION: PRACTICE AND EXPERIENCE Concurrency Computat.: Pract. Exper. (2012) Published online in Wiley Online Library (wileyonlinelibrary.com). DOI: 10.1002/cpe.2839 SPECIAL ISSUE PAPER Energy efficient genetic-based schedulers in comp , 2022 .

[63]  Peng Xu,et al.  An efficient load balancing algorithm for virtual machine allocation based on ant colony optimization , 2018, Int. J. Distributed Sens. Networks.

[64]  Fernando Guirado,et al.  Blacklist muti-objective genetic algorithm for energy saving in heterogeneous environments , 2016, The Journal of Supercomputing.

[65]  Fred W. Glover,et al.  The general employee scheduling problem. An integration of MS and AI , 1986, Comput. Oper. Res..

[66]  Pinar Civicioglu,et al.  Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm , 2012, Comput. Geosci..

[67]  Craig A. Tovey,et al.  On Honey Bees and Dynamic Server Allocation in Internet Hosting Centers , 2004, Adapt. Behav..

[68]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[69]  Martin Maier,et al.  Workflow Scheduling in Multi-Tenant Cloud Computing Environments , 2017, IEEE Transactions on Parallel and Distributed Systems.

[70]  Rajkumar Buyya,et al.  Deadline Based Resource Provisioningand Scheduling Algorithm for Scientific Workflows on Clouds , 2014, IEEE Transactions on Cloud Computing.

[71]  Shafii Muhammad Abdulhamid,et al.  Recent advancements in resource allocation techniques for cloud computing environment: a systematic review , 2016, Cluster Computing.

[72]  Dick H. J. Epema,et al.  Cost-Driven Scheduling of Grid Workflows Using Partial Critical Paths , 2012 .

[73]  Jin Sun,et al.  Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based HEFT , 2019, Future Gener. Comput. Syst..

[74]  Inderveer Chana,et al.  Artificial bee colony based energy‐aware resource utilization technique for cloud computing , 2015, Concurr. Comput. Pract. Exp..

[75]  Nicola Cordeschi,et al.  FUGE: A joint meta-heuristic approach to cloud job scheduling algorithm using fuzzy theory and a genetic method , 2014, Cluster Computing.

[76]  Absalom E Ezugwu,et al.  An improved ant colony optimization algorithm with fault tolerance for job scheduling in grid computing systems , 2017, PloS one.

[77]  Junaid Shuja,et al.  Energy-efficient data centers , 2012, Computing.

[78]  Bin Luo,et al.  Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds , 2018, IEEE Transactions on Services Computing.

[79]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[80]  Luca Maria Gambardella,et al.  A survey on metaheuristics for stochastic combinatorial optimization , 2009, Natural Computing.

[81]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[82]  Yongming Han,et al.  Review: Multi-objective optimization methods and application in energy saving , 2017 .

[83]  Frantisek Zboril,et al.  Genetic Algorithm using Theory of Chaos , 2015, ICCS.

[84]  Ajith Abraham,et al.  Optimal job scheduling in grid computing using efficient binary artificial bee colony optimization , 2012, Soft Computing.