Reliability-aware task scheduling for energy efficiency on heterogeneous multiprocessor systems

Recent studies mainly focus on high performance or low power consumption for task scheduling on heterogeneous multiprocessor systems (HMSs). Dynamic voltage and frequency scaling (DVFS) is an important energy reduction technique, which adjusts the voltage and frequency of the processor while the task is executing. However, some studies have shown that reducing the voltage of processor increases the transient failure rate, which reduces system reliability. In this paper, we aim at addressing the scheduling problem of optimizing energy under makespan and reliability constraints on HMSs with DVFS. We first propose an improved whale optimization algorithm (WOA) deploying opposition-based learning and individual selection strategy, which can balance the exploration and exploitation ability. To maintain population diversity, we then apply a constrained rank-based method which retains some infeasible individuals in the population. Finally, we reschedule the Critical Path Nodes (CPNs) to further improve the performance of improved WOA. The main difference between our work and most previous works is that we study a new scheduling problem, and utilize an improved WOA algorithm integrating with rescheduling CPNs and a constrained rank-based method. Extensive experiments are conducted to evaluate our proposed algorithm, and the evaluation results show that our proposed algorithm is compelling in comparison with the state-of-the-art algorithms.

[1]  Jiadong Yang,et al.  A heuristic-based hybrid genetic-variable neighborhood search algorithm for task scheduling in heterogeneous multiprocessor system , 2011, Inf. Sci..

[2]  Yan Zhang,et al.  A metaheuristic method for joint task scheduling and virtual machine placement in cloud data centers , 2021, Future Gener. Comput. Syst..

[3]  Rong Ge,et al.  Performance-constrained Distributed DVS Scheduling for Scientific Applications on Power-aware Clusters , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[4]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[5]  Xiaohong Hao,et al.  Adaptive iterative learning control based on particle swarm optimization , 2018, The Journal of Supercomputing.

[6]  Keqin Li,et al.  Maximizing reliability of energy constrained parallel applications on heterogeneous distributed systems , 2017, J. Comput. Sci..

[7]  Keqin Li,et al.  Joint optimization of energy efficiency and system reliability for precedence constrained tasks in heterogeneous systems , 2016 .

[8]  Hiren D. Patel,et al.  On the Task Mapping and Scheduling for DAG-based Embedded Vision Applications on Heterogeneous Multi/Many-core Architectures , 2020, 2020 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[9]  Kenli Li,et al.  Maximizing reliability with energy conservation for parallel task scheduling in a heterogeneous cluster , 2015, Inf. Sci..

[10]  Jie Zheng,et al.  Energy efficient job scheduling with workload prediction on cloud data center , 2018, Cluster Computing.

[11]  Hadeel Alazzam,et al.  A hybrid job scheduling algorithm based on Tabu and Harmony search algorithms , 2019, The Journal of Supercomputing.

[12]  Kun Cao,et al.  Reliability and temperature constrained task scheduling for makespan minimization on heterogeneous multi-core platforms , 2017, J. Syst. Softw..

[13]  Dakai Zhu,et al.  On Maximizing Reliability of Real-Time Embedded Applications Under Hard Energy Constraint , 2010, IEEE Transactions on Industrial Informatics.

[14]  Sameh A. Salem,et al.  A smart energy and reliability aware scheduling algorithm for workflow execution in DVFS-enabled cloud environment , 2020, Future Gener. Comput. Syst..

[15]  Keqin Li,et al.  Energy efficient scheduling of parallel tasks on multiprocessor computers , 2012, The Journal of Supercomputing.

[16]  Liqian Zhou,et al.  Efficient scientific workflow scheduling for deadline-constrained parallel tasks in cloud computing environments , 2020, Inf. Sci..

[17]  Dakai Zhu,et al.  Reliability-Aware Energy Management for Periodic Real-Time Tasks , 2009, IEEE Trans. Computers.

[18]  Xuehua Zhao,et al.  Dimension decided Harris hawks optimization with Gaussian mutation: Balance analysis and diversity patterns , 2021, Knowl. Based Syst..

[19]  Parmeet Kaur,et al.  Resource provisioning and work flow scheduling in clouds using augmented Shuffled Frog Leaping Algorithm , 2017, J. Parallel Distributed Comput..

[20]  Zexi Deng,et al.  Task scheduling on heterogeneous multiprocessor systems through coherent data allocation , 2021, Concurr. Comput. Pract. Exp..

[21]  Petru Eles,et al.  Design optimization of time- and cost-constrained fault-tolerant distributed embedded systems , 2005, Design, Automation and Test in Europe.

[22]  Pascal Bouvry,et al.  Energy-Aware Scheduling on Multicore Heterogeneous Grid Computing Systems , 2013, Journal of Grid Computing.

[23]  Tetsuyuki Takahama,et al.  Efficient Constrained Optimization by the ε Constrained Rank-Based Differential Evolution , 2012, 2012 IEEE Congress on Evolutionary Computation.

[24]  Xun Jiao,et al.  Dynamic DAG Scheduling on Multiprocessor Systems: Reliability, Energy, and Makespan , 2020, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[25]  Jinchao Chen,et al.  Work-in-Progress: Non-preemptive Scheduling of Periodic Tasks with Data Dependency Upon Heterogeneous Multiprocessor Platforms , 2019, 2019 IEEE Real-Time Systems Symposium (RTSS).

[26]  Shang Mingsheng Optimal algorithm for scheduling large divisible workload on heterogeneous system , 2008 .

[27]  Wu Deng,et al.  An Improved Ant Colony Optimization Algorithm Based on Hybrid Strategies for Scheduling Problem , 2019, IEEE Access.

[28]  Chuang Liu,et al.  Energy Efficient Task Assignment with Guaranteed Probability Satisfying Timing Constraints for Embedded Systems , 2014, IEEE Transactions on Parallel and Distributed Systems.

[29]  Xiaoyong Tang,et al.  Budget‐constraint stochastic task scheduling on heterogeneous cloud systems , 2017, Concurr. Comput. Pract. Exp..

[30]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[31]  Zhile Yang,et al.  Dynamic opposite learning enhanced teaching-learning-based optimization , 2020, Knowl. Based Syst..

[32]  Sakshi Kaushal,et al.  Genetic algorithm-based cost minimization pricing model for on-demand IaaS cloud service , 2018, The Journal of Supercomputing.

[33]  Kenli Li,et al.  Bi-objective workflow scheduling of the energy consumption and reliability in heterogeneous computing systems , 2017, Inf. Sci..

[34]  Xiaoyong Tang,et al.  CPU–GPU Utilization Aware Energy-Efficient Scheduling Algorithm on Heterogeneous Computing Systems , 2020, IEEE Access.

[35]  Kenli Li,et al.  A Reliability-aware Task Scheduling Algorithm Based on Replication on Heterogeneous Computing Systems , 2017, Journal of Grid Computing.

[36]  Hamid Noori,et al.  Fairness-Aware Energy Efficient Scheduling on Heterogeneous Multi-Core Processors , 2021, IEEE Transactions on Computers.

[37]  Keqin Li,et al.  Minimizing Redundancy to Satisfy Reliability Requirement for a Parallel Application on Heterogeneous Service-Oriented Systems , 2020, IEEE Transactions on Services Computing.

[38]  Alain Girault,et al.  ERPOT: A Quad-Criteria Scheduling Heuristic to Optimize Execution Time, Reliability, Power Consumption and Temperature in Multicores , 2019, IEEE Transactions on Parallel and Distributed Systems.

[39]  Tongquan Wei,et al.  Parallelization and Optimization of NSGA-II on Sunway TaihuLight System , 2021, IEEE Transactions on Parallel and Distributed Systems.

[40]  Kenli Li,et al.  Energy-Aware Data Allocation and Task Scheduling on Heterogeneous Multiprocessor Systems With Time Constraints , 2014, IEEE Transactions on Emerging Topics in Computing.

[41]  Kenli Li,et al.  Slack allocation algorithm for energy minimization in cluster systems , 2017, Future Gener. Comput. Syst..

[42]  Kenli Li,et al.  A Hybrid Chemical Reaction Optimization Scheme for Task Scheduling on Heterogeneous Computing Systems , 2015, IEEE Transactions on Parallel and Distributed Systems.

[43]  Song Guo,et al.  Task Scheduling for Energy Consumption Constrained Parallel Applications on Heterogeneous Computing Systems , 2020, IEEE Transactions on Parallel and Distributed Systems.

[44]  Weisong Shi,et al.  Energy-Aware Scheduling of MapReduce Jobs for Big Data Applications , 2015, IEEE Transactions on Parallel and Distributed Systems.

[45]  Pranab K. Muhuri,et al.  Bayesian optimization algorithm for multi-objective scheduling of time and precedence constrained tasks in heterogeneous multiprocessor systems , 2020, Appl. Soft Comput..

[46]  Albert Y. Zomaya,et al.  Author manuscript, published in "Journal of Parallel and Distributed Computing (2011)" A Parallel Bi-objective Hybrid Metaheuristic for Energy-aware Scheduling for Cloud Computing Systems , 2011 .

[47]  Hamza Djigal,et al.  IPPTS: An Efficient Algorithm for Scientific Workflow Scheduling in Heterogeneous Computing Systems , 2021, IEEE Transactions on Parallel and Distributed Systems.

[48]  Kenli Li,et al.  An effective reliability-driven technique of allocating tasks on heterogeneous cluster systems , 2014, Cluster Computing.

[49]  Alain Girault,et al.  A Novel Bicriteria Scheduling Heuristics Providing a Guaranteed Global System Failure Rate , 2009, IEEE Transactions on Dependable and Secure Computing.

[50]  Michael Franz,et al.  Power reduction techniques for microprocessor systems , 2005, CSUR.

[51]  Xiaolang Yan,et al.  Energy-Efficient Fault-Tolerant Mapping and Scheduling on Heterogeneous Multiprocessor Real-Time Systems , 2018, IEEE Access.

[52]  Jie Wu,et al.  Minimizing Energy Consumption for Frame-Based Tasks on Heterogeneous Multiprocessor Platforms , 2015, IEEE Transactions on Parallel and Distributed Systems.

[53]  Dakai Zhu,et al.  Shared recovery for energy efficiency and reliability enhancements in real-time applications with precedence constraints , 2013, TODE.

[54]  Ahmad Khonsari,et al.  A hybrid algorithm for task scheduling on heterogeneous multiprocessor embedded systems , 2020, Appl. Soft Comput..

[55]  Emmanuel Jeannot,et al.  Optimizing performance and reliability on heterogeneous parallel systems: Approximation algorithms and heuristics , 2012, J. Parallel Distributed Comput..

[56]  Ligang He,et al.  A reformed task scheduling algorithm for heterogeneous distributed systems with energy consumption constraints , 2019, Neural Computing and Applications.

[57]  Toshihiro Hanawa,et al.  Development of training environment for deep learning with medical images on supercomputer system based on asynchronous parallel Bayesian optimization , 2020, The Journal of Supercomputing.

[58]  Yajun Ha,et al.  DVFS-Based Scrubbing Scheduling for Reliability Maximization on Parallel Tasks in SRAM-based FPGAs , 2020, 2020 57th ACM/IEEE Design Automation Conference (DAC).

[59]  Jean-Philippe Diguet,et al.  Adaptive Task Allocation and Scheduling on NoC-based Multicore Platforms with Multitasking Processors , 2020, ACM Trans. Embed. Comput. Syst..

[60]  Jaishree Mayank,et al.  Reliability Aware Energy Optimized Scheduling of Non-Preemptive Periodic Real-Time Tasks on Heterogeneous Multiprocessor System , 2020, IEEE Transactions on Parallel and Distributed Systems.

[61]  Emmanuel Jeannot,et al.  Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems , 2007, SPAA '07.

[62]  Mohammad Karim Sohrabi,et al.  Task scheduling, resource provisioning, and load balancing on scientific workflows using parallel SARSA reinforcement learning agents and genetic algorithm , 2020, The Journal of Supercomputing.

[63]  Mohamed Khalgui,et al.  Scheduling periodic and aperiodic tasks with time, energy harvesting and precedence constraints on multi-core systems , 2020, Inf. Sci..

[64]  Chi-Yeh Chen,et al.  Task Scheduling for Maximizing Performance and Reliability Considering Fault Recovery in Heterogeneous Distributed Systems , 2016, IEEE Transactions on Parallel and Distributed Systems.

[65]  Kenli Li,et al.  Energy-Efficient Stochastic Task Scheduling on Heterogeneous Computing Systems , 2014, IEEE Transactions on Parallel and Distributed Systems.

[66]  Kenli Li,et al.  Contention-Aware Reliability Efficient Scheduling on Heterogeneous Computing Systems , 2018, IEEE Transactions on Sustainable Computing.

[67]  Mohammad Bagher Ahmadi,et al.  An opposition-based algorithm for function optimization , 2015, Eng. Appl. Artif. Intell..

[68]  Rami Melhem,et al.  The effects of energy management on reliability in real-time embedded systems , 2004, ICCAD 2004.

[69]  Xin Yuan,et al.  Energy‐efficient task scheduling on heterogeneous computing systems by linear programming , 2018, Concurr. Comput. Pract. Exp..

[70]  Kalyanmoy Deb,et al.  Energy-aware whale optimization algorithm for real-time task scheduling in multiprocessor systems , 2020, Appl. Soft Comput..

[71]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[72]  Fan Wu,et al.  Interconnection Network Energy-Aware Workflow Scheduling Algorithm on Heterogeneous Systems , 2020, IEEE Transactions on Industrial Informatics.

[73]  Huimin Huang,et al.  Energy-Aware Task Scheduling on Heterogeneous Computing Systems With Time Constraint , 2020, IEEE Access.

[74]  Keqin Li,et al.  Performance Analysis of Power-Aware Task Scheduling Algorithms on Multiprocessor Computers with Dynamic Voltage and Speed , 2008, IEEE Transactions on Parallel and Distributed Systems.

[75]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[76]  Farhad Soleimanian Gharehchopogh,et al.  A comprehensive survey: Whale Optimization Algorithm and its applications , 2019, Swarm Evol. Comput..

[77]  Samee Ullah Khan,et al.  An Energy-Efficient Task Scheduling Algorithm in DVFS-enabled Cloud Environment , 2015, Journal of Grid Computing.

[78]  Eric C. Kerrigan,et al.  Energy-efficient real-time scheduling for two-type heterogeneous multiprocessors , 2016, Real-Time Systems.

[79]  Günter Rudolph,et al.  Quantum-Inspired Hyper-Heuristics for Energy-Aware Scheduling on Heterogeneous Computing Systems , 2016, IEEE Transactions on Parallel and Distributed Systems.

[80]  Helen M. Wood,et al.  Foreword to the First Issue of the Transactions on Parallel and Distributed Systems , 1990, IEEE Trans. Parallel Distributed Syst..

[81]  Julian Togelius,et al.  A Fast and Efficient Stochastic Opposition-Based Learning for Differential Evolution in Numerical Optimization , 2019, Swarm Evol. Comput..

[82]  Albert Y. Zomaya,et al.  Energy Conscious Scheduling for Distributed Computing Systems under Different Operating Conditions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[83]  Keqin Li,et al.  Energy-Efficient Scheduling Algorithms for Real-Time Parallel Applications on Heterogeneous Distributed Embedded Systems , 2017, IEEE Transactions on Parallel and Distributed Systems.

[84]  Keqin Li,et al.  Energy and time constrained task scheduling on multiprocessor computers with discrete speed levels , 2016, J. Parallel Distributed Comput..

[85]  Kenli Li,et al.  A genetic algorithm for task scheduling on heterogeneous computing systems using multiple priority queues , 2014, Inf. Sci..

[86]  Reihaneh Khorsand,et al.  PL-DVFS: combining Power-aware List-based scheduling algorithm with DVFS technique for real-time tasks in Cloud Computing , 2018, The Journal of Supercomputing.