Energy‐aware task scheduling with time constraint for heterogeneous cloud datacenters

Energy optimization with time constraint has become a timely and significant challenge for the datacenters. In this paper, a hardware and software collaborative optimization strategy is implemented to minimize the energy cost while satisfying the time constraint of the datacenters. In the hardware aspect, a DVFS‐capable CPU/GPU/FPGA heterogeneous computing infrastructure is built. This infrastructure can adjust its hardware characteristics dynamically in terms of the software run‐time contexts so that the applications can be executed efficiently with less time and lower energy cost. In the software aspect, a deadline‐aware energy‐efficient task scheduling algorithm based on the Q‐learning approach is investigated. This algorithm can adjust its searching directions smartly in terms of the environment feedback so that it can achieve better optimization performance comparing with the traditional genetic algorithm. However, its convergence time is long due to the large amount of training work, making it inappropriate to be applied in the large‐scale datacenters. To ease this problem, we proposed another new algorithm named Rapid Local Convolution Optimization (RLCO) and combine it with the Q‐learning algorithm. By doing this, the convergence time of the Q‐learning mechanism can be decreased significantly. We conducted both the simulation and real‐world experiments to evaluate the performance of our approaches, and the results proved the proposed algorithm running on the DVFS‐capable heterogeneous hardware architecture could decrease the energy cost of the datacenter significantly even if the datacenter is in large scale.

[1]  Massoud Pedram,et al.  Task Scheduling with Dynamic Voltage and Frequency Scaling for Energy Minimization in the Mobile Cloud Computing Environment , 2015, IEEE Transactions on Services Computing.

[2]  Chao Chen,et al.  Energy-aware scheduling of virtual machines in heterogeneous cloud computing systems , 2017, Future Gener. Comput. Syst..

[3]  Nicolás Ruiz-Reyes,et al.  Dynamic Voltage Frequency Scaling Simulator for Real Workflows Energy-Aware Management in Green Cloud Computing , 2017, PloS one.

[4]  P. Ganeshkumar,et al.  Multi-objective Task Scheduling to Minimize Energy Consumption and Makespan of Cloud Computing Using NSGA-II , 2018, Journal of Network and Systems Management.

[5]  Xin Yan,et al.  Energy Optimization and Fault Tolerance to Embedded System Based on Adaptive Heterogeneous Multi-Core Hardware Architecture , 2018, 2018 IEEE International Conference on Software Quality, Reliability and Security Companion (QRS-C).

[6]  Kenli Li,et al.  Energy-Aware Data Allocation and Task Scheduling on Heterogeneous Multiprocessor Systems With Time Constraints , 2014, IEEE Transactions on Emerging Topics in Computing.

[7]  Jeffrey S. Vetter,et al.  A Survey of CPU-GPU Heterogeneous Computing Techniques , 2015, ACM Comput. Surv..

[8]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[9]  Florin Pop,et al.  Predicting provisioning and booting times in a Metal-as-a-service system , 2017, Future Gener. Comput. Syst..

[10]  Min Chen,et al.  Energy Optimization With Dynamic Task Scheduling Mobile Cloud Computing , 2017, IEEE Systems Journal.

[11]  Gang Quan,et al.  A unified approach to variable voltage scheduling for nonideal DVS processors , 2004, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[12]  Ali Ghaffari,et al.  Hybrid Task Scheduling Method for Cloud Computing by Genetic and DE Algorithms , 2017, Wirel. Pers. Commun..

[13]  Valentin Cristea,et al.  Using a novel message-exchanging optimization (MEO) model to reduce energy consumption in distributed systems , 2013, Simul. Model. Pract. Theory.

[14]  Yong Dou,et al.  Efficient parallel implementation of three‐point viterbi decoding algorithm on CPU, GPU, and FPGA , 2014, Concurr. Comput. Pract. Exp..

[15]  Wayne H. Wolf,et al.  TGFF: task graphs for free , 1998, Proceedings of the Sixth International Workshop on Hardware/Software Codesign. (CODES/CASHE'98).

[16]  B. Brock,et al.  Dynamic power management for embedded systems [SOC design] , 2003, IEEE International [Systems-on-Chip] SOC Conference, 2003. Proceedings..

[17]  Valentin Cristea,et al.  Resource-aware hybrid scheduling algorithm in heterogeneous distributed computing , 2015, Future Gener. Comput. Syst..

[18]  Florin Pop,et al.  New scheduling approach using reinforcement learning for heterogeneous distributed systems , 2017, J. Parallel Distributed Comput..

[19]  Ali N. Akansu,et al.  FPGA, GPU, and CPU implementations of Jacobi algorithm for eigenanalysis , 2016, J. Parallel Distributed Comput..

[20]  Bharadwaj Veeravalli,et al.  Design of Fast and Efficient Energy-Aware Gradient-Based Scheduling Algorithms Heterogeneous Embedded Multiprocessor Systems , 2009, IEEE Transactions on Parallel and Distributed Systems.

[21]  Bishop Brock,et al.  Dynamic Power Management for Embedded Systems , 2003 .