Energy and resource efficient workflow scheduling in a virtualized cloud environment

High energy consumption (EC) is one of the leading and interesting issue in the cloud environment. The optimization of EC is generally related to scheduling problem. Optimum scheduling strategy is used to select the resources or tasks in such a way that system performance is not violated while minimizing EC and maximizing resource utilization (RU). This paper presents a task scheduling model for scheduling the tasks on virtual machines (VMs). The objective of the proposed model is to minimize EC, maximize RU, and minimize workflow makespan while preserving the task’s deadline and dependency constraints. An energy and resource efficient workflow scheduling algorithm (ERES) is proposed to schedule the workflow tasks to the VMs and dynamically deploy/un-deploy the VMs based on the workflow task’s requirements. An energy model is presented to compute the EC of the servers. Double threshold policy is used to perceive the server’ status i.e. overloaded/underloaded or normal. To balance the workload on the overloaded/underloaded servers, live VM migration strategy is used. To check the effectiveness of the proposed algorithm, exhaustive simulation experiments are conducted. The proposed algorithm is compared with power efficient scheduling and VM consolidation (PESVMC) algorithm on the accounts of RU, energy efficiency and task makespan. Further, the results are also verified in the real cloud environment. The results demonstrate the effectiveness of the proposed ERES algorithm.

[1]  Dzmitry Kliazovich,et al.  GreenCloud: A Packet-Level Simulator of Energy-Aware Cloud Computing Data Centers , 2010, GLOBECOM.

[2]  Luca Benini,et al.  A survey of design techniques for system-level dynamic power management , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[3]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[4]  Dzmitry Kliazovich,et al.  GreenCloud: a packet-level simulator of energy-aware cloud computing data centers , 2010, The Journal of Supercomputing.

[5]  Mahesh Chandra Govil,et al.  Task Clustering-Based Energy-Aware Workflow Scheduling in Cloud Environment , 2018, 2018 IEEE 20th International Conference on High Performance Computing and Communications; IEEE 16th International Conference on Smart City; IEEE 4th International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[6]  Deo Prakash Vidyarthi,et al.  A Cost-Effective Deadline-Constrained Dynamic Scheduling Algorithm for Scientific Workflows in a Cloud Environment , 2018, IEEE Transactions on Cloud Computing.

[7]  Laurent Lefèvre,et al.  Save Watts in Your Grid: Green Strategies for Energy-Aware Framework in Large Scale Distributed Systems , 2008, 2008 14th IEEE International Conference on Parallel and Distributed Systems.

[8]  Xiaomin Zhu,et al.  Real-Time Tasks Oriented Energy-Aware Scheduling in Virtualized Clouds , 2014, IEEE Transactions on Cloud Computing.

[9]  Dzmitry Kliazovich,et al.  Minimum Dependencies Energy-Efficient Scheduling in Data Centers , 2016, IEEE Transactions on Parallel and Distributed Systems.

[10]  Jiachen Yang,et al.  Dynamic Symmetric Key Mobile Commerce Scheme Based on Self-Verified Mechanism , 2014 .

[11]  Mei-Hui Su,et al.  Characterization of scientific workflows , 2008, 2008 Third Workshop on Workflows in Support of Large-Scale Science.

[12]  C. P. Katti,et al.  Cost effective deadline aware scheduling strategy for workflow applications on virtual machines in cloud computing , 2017, J. King Saud Univ. Comput. Inf. Sci..

[13]  S. Swamynathan,et al.  Structure aware resource estimation for effective scheduling and execution of data intensive workflows in cloud , 2018, Future Gener. Comput. Syst..

[14]  Radu Prodan,et al.  Multi-objective Workflow Scheduling: An Analysis of the Energy Efficiency and Makespan Tradeoff , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[15]  Albert Y. Zomaya,et al.  Resource-efficient workflow scheduling in clouds , 2015, Knowl. Based Syst..

[16]  Xiaomin Zhu,et al.  Uncertainty-Aware Real-Time Workflow Scheduling in the Cloud , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[17]  Pratyay Kuila,et al.  A novel workflow scheduling with multi-criteria using particle swarm optimization for heterogeneous computing systems , 2020, Cluster Computing.

[18]  Rizos Sakellariou,et al.  Energy-Aware Workflow Scheduling Using Frequency Scaling , 2014, 2014 43rd International Conference on Parallel Processing Workshops.

[19]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[20]  Ritu Garg,et al.  Reliability and energy efficient workflow scheduling in cloud environment , 2019, Cluster Computing.

[21]  Reihaneh Khorsand,et al.  Energy-aware scheduling algorithm for time-constrained workflow tasks in DVFS-enabled cloud environment , 2018, Simul. Model. Pract. Theory.

[22]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[23]  BuyyaRajkumar,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012 .

[24]  C. Kesselman,et al.  CyberShake: A Physics-Based Seismic Hazard Model for Southern California , 2011 .

[25]  Albert Y. Zomaya,et al.  Energy Conscious Scheduling for Distributed Computing Systems under Different Operating Conditions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[26]  Albert Y. Zomaya,et al.  On the Characterization of the Structural Robustness of Data Center Networks , 2013, IEEE Transactions on Cloud Computing.

[27]  Mohsen Sharifi,et al.  PASTA: a power-aware solution to scheduling of precedence-constrained tasks on heterogeneous computing resources , 2012, Computing.

[28]  Haoyu Wang,et al.  A cloud server energy consumption measurement system for heterogeneous cloud environments , 2018, Inf. Sci..

[29]  Yang Liu,et al.  An improved task scheduling algorithm for scientific workflow in cloud computing environment , 2019, Cluster Computing.

[30]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[31]  C. P. Katti,et al.  Cost‐effective deadline‐aware stochastic scheduling strategy for workflow applications on virtual machines in cloud computing , 2018, Concurr. Comput. Pract. Exp..

[32]  Haoyi Xiong,et al.  Energy-Efficient Real-Time Scheduling of DAG Tasks , 2018, ACM Trans. Embed. Comput. Syst..

[33]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[34]  Marta Mattoso,et al.  Parallelization of Scientific Workflows in the Cloud , 2014 .

[35]  S. Balamurugan,et al.  Energy-Aware Workflow Scheduling Algorithm for the Deployment of Scientific Workflows in Cloud , 2019 .

[36]  Mohit Kumar,et al.  PSO-COGENT: Cost and energy efficient scheduling in cloud environment with deadline constraint , 2018, Sustain. Comput. Informatics Syst..

[37]  Ann L. Chervenak,et al.  Characterizing and profiling scientific workflows , 2013, Future Gener. Comput. Syst..

[38]  Joshua R. Smith,et al.  LIGO: the Laser Interferometer Gravitational-Wave Observatory , 1992, Science.

[39]  Ju Ren,et al.  Online Multi-Workflow Scheduling under Uncertain Task Execution Time in IaaS Clouds , 2019, IEEE Transactions on Cloud Computing.

[40]  Bin Luo,et al.  Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds , 2018, IEEE Transactions on Services Computing.

[41]  Ritu Garg,et al.  Adaptive workflow scheduling in grid computing based on dynamic resource availability , 2015 .

[42]  Hong He,et al.  Energy-Efficient Scheduling for Tasks with Deadline in Virtualized Environments , 2014 .

[43]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[44]  Albert Y. Zomaya,et al.  Energy-aware parallel task scheduling in a cluster , 2013, Future Gener. Comput. Syst..

[45]  Mitsuhisa Sato,et al.  Emprical study on Reducing Energy of Parallel Programs using Slack Reclamation by DVFS in a Power-scalable High Performance Cluster , 2006, 2006 IEEE International Conference on Cluster Computing.

[46]  Daniel S. Katz,et al.  Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking , 2009, Int. J. Comput. Sci. Eng..

[47]  Helen D. Karatza,et al.  An energy-efficient, QoS-aware and cost-effective scheduling approach for real-time workflow applications in cloud computing systems utilizing DVFS and approximate computations , 2019, Future Gener. Comput. Syst..

[48]  Xuyun Zhang,et al.  EnReal: An Energy-Aware Resource Allocation Method for Scientific Workflow Executions in Cloud Environment , 2016, IEEE Transactions on Cloud Computing.

[49]  M. Livny,et al.  High-Throughput, Kingdom-Wide Prediction and Annotation of Bacterial Non-Coding RNAs , 2008, PloS one.

[50]  Johan Tordsson,et al.  Improving cloud infrastructure utilization through overbooking , 2013, CAC.

[51]  Ming Mao,et al.  A Performance Study on the VM Startup Time in the Cloud , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[52]  Jan Vitek,et al.  Can Android Run on Time? Extending and Measuring the Android Platform's Timeliness , 2019, ACM Trans. Embed. Comput. Syst..

[53]  Samee Ullah Khan,et al.  An Energy-Efficient Task Scheduling Algorithm in DVFS-enabled Cloud Environment , 2015, Journal of Grid Computing.

[54]  Huifang Deng,et al.  Elastic Scheduling of Scientific Workflows under Deadline Constraints in Cloud Computing Environments , 2018, Future Internet.

[55]  Radu Prodan,et al.  Multi-objective energy-efficient workflow scheduling using list-based heuristics , 2014, Future Gener. Comput. Syst..

[56]  Matei Ripeanu,et al.  Amazon S3 for science grids: a viable solution? , 2008, DADC '08.

[57]  Xiaomin Zhu,et al.  EONS: Minimizing Energy Consumption for Executing Real-Time Workflows in Virtualized Cloud Data Centers , 2016, 2016 45th International Conference on Parallel Processing Workshops (ICPPW).

[58]  Mohamed Mohsen Gammoudi,et al.  Energy Efficient Partitioning and Scheduling Approach for Scientific Workflows in the Cloud , 2016, 2016 IEEE International Conference on Services Computing (SCC).

[59]  Neha Garg,et al.  Task Deadline-Aware Energy-Efficient Scheduling Model for a Virtualized Cloud , 2018 .

[60]  Pethuru Raj Chelliah,et al.  Energy efficient workflow scheduling with virtual machine consolidation for green cloud computing , 2018, J. Intell. Fuzzy Syst..

[61]  Neha Garg,et al.  Power and Resource-Aware VM Placement in Cloud Environment , 2018, 2018 IEEE 8th International Advance Computing Conference (IACC).