Energy-efficient task scheduling and consolidation algorithm for workflow jobs in cloud

The energy consumption of underlying cloud hardware has dramatically increased. The cloud service providers need to adopt some cost-effective and energy-aware job scheduler without compromising the quality of service QoS specified in the service level agreement SLA. Based on a rigorous mathematical model, we formulate an energy efficient problem to improve the resource utilisation for high system throughput. A multiple-procedure heuristic workflow scheduling and consolidation strategy is proposed with objectives to maximise the resource utilisation and minimise the power. Several techniques have been utilised including dynamic voltage and frequency scaling DVFS with task module migration for workload balance and task consolidation for virtual machine VM overhead reduction. The simulation results illustrate that our approach consistently achieves a lower power consumption and higher resource utilisation rate within the execution time bound compared with other similar scheduling algorithms as well as our previous algorithm without the task migration based on VM threshold.

[1]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[2]  Albert Y. Zomaya,et al.  Energy efficient utilization of resources in cloud computing systems , 2010, The Journal of Supercomputing.

[3]  Antonio Puliafito,et al.  How to exploit grid infrastructures for federated cloud purposes with CLEVER , 2013, Int. J. Comput. Sci. Eng..

[4]  Yasushi Inoguchi,et al.  Performance evaluation of a Green Scheduling Algorithm for energy savings in Cloud computing , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[5]  Chase Qishi Wu,et al.  A cost-effective scheduling algorithm for scientific workflows in clouds , 2012, 2012 IEEE 31st International Performance Computing and Communications Conference (IPCCC).

[6]  Anand Sivasubramaniam,et al.  Managing server energy and operational costs in hosting centers , 2005, SIGMETRICS '05.

[7]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[8]  Ying Lu,et al.  Efficient Power Management of Heterogeneous Soft Real-Time Clusters , 2008, 2008 Real-Time Systems Symposium.

[9]  Viktor K. Prasanna,et al.  Power-aware resource allocation for independent tasks in heterogeneous real-time systems , 2002, Ninth International Conference on Parallel and Distributed Systems, 2002. Proceedings..

[10]  Ricardo Bianchini,et al.  Power and energy management for server systems , 2004, Computer.

[11]  Jordi Torres,et al.  Reducing wasted resources to help achieve green data centers , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[12]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[13]  Fei Cao,et al.  Energy-Aware Workflow Job Scheduling for Green Clouds , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[14]  Weisong Shi,et al.  Utility analysis for Internet-oriented server consolidation in VM-based data centers , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[15]  Klaus Zaerens,et al.  Gaining the profits of cloud computing in a public authority environment , 2012, Int. J. Comput. Sci. Eng..

[16]  Antonio Puliafito,et al.  Managing volunteer resources in the cloud , 2013, Int. J. Comput. Sci. Eng..

[17]  Martin Schulz,et al.  Bounding energy consumption in large-scale MPI programs , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[18]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[19]  Tai-Yi Huang,et al.  A Near-optimal Solution for the Heterogeneous Multi-processor Single-level Voltage Setup Problem , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[20]  Rajkumar Buyya,et al.  Environment-conscious scheduling of HPC applications on distributed Cloud-oriented data centers , 2011, J. Parallel Distributed Comput..

[21]  Ishfaq Ahmad,et al.  A Cooperative Game Theoretical Technique for Joint Optimization of Energy Consumption and Response Time in Computational Grids , 2009, IEEE Transactions on Parallel and Distributed Systems.

[22]  Xiaorui Wang,et al.  Server-Level Power Control , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[23]  Michael Franz,et al.  Power reduction techniques for microprocessor systems , 2005, CSUR.

[24]  Xue Liu,et al.  Dynamic Voltage Scaling in Multitier Web Servers with End-to-End Delay Control , 2007, IEEE Transactions on Computers.

[25]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[26]  Richard E. Harper,et al.  Workload-based power management for parallel computer systems , 2003, IBM J. Res. Dev..

[27]  Evgenia Smirni,et al.  Power-aware resource allocation in high-end systems via online simulation , 2005, ICS '05.

[28]  David P. Bunde Power-aware scheduling for makespan and flow , 2006, SPAA '06.

[29]  Enrique V. Carrera,et al.  Load balancing and unbalancing for power and performance in cluster-based systems , 2001 .

[30]  Rami G. Melhem,et al.  Scheduling with Dynamic Voltage/Speed Adjustment Using Slack Reclamation in Multiprocessor Real-Time Systems , 2003, IEEE Trans. Parallel Distributed Syst..

[31]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[32]  Mohamed Shalan,et al.  Online power management using DVFS for RTOS , 2009, 2009 4th International Design and Test Workshop (IDT).

[33]  Gernot Heiser,et al.  Dynamic voltage and frequency scaling: the laws of diminishing returns , 2010 .

[34]  Rajkumar Buyya,et al.  Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-enabled Clusters , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[35]  Massoud Pedram,et al.  Power and Performance Modeling in a Virtualized Server System , 2010, 2010 39th International Conference on Parallel Processing Workshops.

[36]  David Filani Dynamic Data Center Power Management Trends, Issues, and Solutions , 2008 .

[37]  Rong Ge,et al.  Performance-constrained Distributed DVS Scheduling for Scientific Applications on Power-aware Clusters , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[38]  Hamid Sarbazi-Azad,et al.  Energy-Efficient Resource Utilization in Cloud Computing , 2014 .