An energy-efficient, QoS-aware and cost-effective scheduling approach for real-time workflow applications in cloud computing systems utilizing DVFS and approximate computations

Abstract Green cloud computing attracts significant attention from both academia and industry. One of the major challenges involved, is to provide a high level of Quality of Service (QoS) in a cost-effective way for the end users and in an energy-efficient manner for the cloud providers. Towards this direction, this paper presents an energy-efficient, QoS-aware and cost-effective scheduling strategy for real-time workflow applications in cloud computing systems. The proposed approach utilizes per-core Dynamic Voltage and Frequency Scaling (DVFS) on the underlying heterogeneous multi-core processors, as well as approximate computations, in order to fill in schedule gaps. At the same time, it takes into account the effects of input error on the processing time of the component tasks. Our goal is to provide timeliness and energy efficiency by trading off result precision, while keeping the result quality of the completed jobs at an acceptable standard and the monetary cost required for the execution of the jobs at a reasonable level. The proposed scheduling heuristic is compared to two other baseline policies, under the impact of various QoS requirements. The simulation experiments reveal that our approach outperforms the other examined policies, providing promising results.

[1]  Zhao Zhang,et al.  Automatic runtime frequency-scaling system for energy savings in parallel applications , 2013, The Journal of Supercomputing.

[2]  Chao Chen,et al.  Energy-aware scheduling of virtual machines in heterogeneous cloud computing systems , 2017, Future Gener. Comput. Syst..

[3]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.

[4]  César A. F. De Rose,et al.  Modeling power consumption for DVFS policies , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[5]  Thomas Ilsche,et al.  An Energy Efficiency Feature Survey of the Intel Haswell Processor , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium Workshop.

[6]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[7]  Bin Luo,et al.  Cost and Energy Aware Scheduling Algorithm for Scientific Workflows with Deadline Constraint in Clouds , 2018, IEEE Transactions on Services Computing.

[8]  Helen D. Karatza,et al.  Energy-Aware Scheduling of Real-Time Workflow Applications in Clouds Utilizing DVFS and Approximate Computations , 2018, 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud).

[9]  Hai Jin,et al.  Energy efficient task allocation and energy scheduling in green energy powered edge computing , 2019, Future Gener. Comput. Syst..

[10]  Achim Streit,et al.  Load and Thermal-Aware VM Scheduling on the Cloud , 2013, ICA3PP.

[11]  Tei-Wei Kuo,et al.  Slack reclamation for real-time task scheduling over dynamic voltage scaling multiprocessors , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[12]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[13]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[14]  Helen D. Karatza,et al.  Scheduling real‐time bag‐of‐tasks applications with approximate computations in SaaS clouds , 2020, Concurr. Comput. Pract. Exp..

[15]  Helen D. Karatza,et al.  Simulation-Based Performance Evaluation of an Energy-Aware Heuristic for the Scheduling of HPC Applications in Large-Scale Distributed Systems , 2017, ICPE Companion.

[16]  Rajkumar Buyya,et al.  Energy-Efficient Scheduling of Urgent Bag-of-Tasks Applications in Clouds through DVFS , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[17]  Helen D. Karatza,et al.  Performance evaluation of a SaaS cloud under different levels of workload computational demand variability and tardiness bounds , 2019, Simul. Model. Pract. Theory.

[18]  Rajkumar Buyya,et al.  Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-enabled Clusters , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[19]  William Jalby,et al.  Evaluation of CPU frequency transition latency , 2014, Computer Science - Research and Development.

[20]  Juan Li,et al.  An overview of energy efficiency techniques in cluster computing systems , 2013, Cluster Computing.

[21]  Helen D. Karatza,et al.  The Effect of Workload Computational Demand Variability on the Performance of a SaaS Cloud with a Multi-tier SLA , 2017, 2017 IEEE 5th International Conference on Future Internet of Things and Cloud (FiCloud).

[22]  Georgios L. Stavrinides,et al.  Scheduling Real-Time Jobs in Distributed Systems-Simulation and Performance Analysis , 2015 .

[23]  Gurindar S. Sohi,et al.  A static power model for architects , 2000, MICRO 33.

[24]  Helen D. Karatza,et al.  The Impact of Input Error on the Scheduling of Task Graphs with Imprecise Computations in Heterogeneous Distributed Real-Time Systems , 2011, ASMTA.

[25]  Inderveer Chana,et al.  Energy aware scheduling of deadline-constrained tasks in cloud computing , 2016, Cluster Computing.

[26]  Joanna Kolodziej,et al.  Evolutionary Hierarchical Multi-Criteria Metaheuristics for Scheduling in Large-Scale Grid Systems , 2012, Studies in Computational Intelligence.

[27]  Nobuyuki Yamasaki,et al.  An integration of imprecise computation model and real-time voltage and frequency scaling , 2015 .

[28]  Jorge Ejarque,et al.  Dynamic energy-aware scheduling for parallel task-based application in cloud computing , 2018, Future Gener. Comput. Syst..

[29]  Jane W.-S. Liu,et al.  Imprecise Results: Utilizing Partial Comptuations in Real-Time Systems , 1987, RTSS.

[30]  Michael Werner,et al.  Wake-up latencies for processor idle states on current x86 processors , 2014, Computer Science - Research and Development.

[31]  Mala Kalra,et al.  A Hybrid Approach for Energy-Efficient Task Scheduling in Cloud , 2018, Proceedings of 2nd International Conference on Communication, Computing and Networking.

[32]  Helen D. Karatza,et al.  The impact of workload variability on the energy efficiency of large-scale heterogeneous distributed systems , 2018, Simul. Model. Pract. Theory.

[33]  Yonggang Wen,et al.  Energy-Efficient Task Execution for Application as a General Topology in Mobile Cloud Computing , 2018, IEEE Transactions on Cloud Computing.

[34]  Helen D. Karatza,et al.  Scheduling real-time DAGs in heterogeneous clusters by combining imprecise computations and bin packing techniques for the exploitation of schedule holes , 2012, Future Gener. Comput. Syst..

[35]  Yatheendraprakash Govindaraju,et al.  A QoS and Energy Aware Load Balancing and Resource Allocation Framework for IaaS Cloud Providers , 2016, 2016 IEEE/ACM 9th International Conference on Utility and Cloud Computing (UCC).

[36]  Yookun Cho,et al.  Comparison of Tie-Breaking Policies for Real-Time Scheduling on Multiprocessor , 2004, EUC.

[37]  Giorgio C. Buttazzo,et al.  HARD REAL-TIME COMPUTING SYSTEMS Predictable Scheduling Algorithms and Applications , 2007 .

[38]  Sang Lyul Min,et al.  Energy-centric DVFS controlling method for multi-core platforms , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[39]  Helen D. Karatza,et al.  A Cost-Effective and QoS-Aware Approach to Scheduling Real-Time Workflow Applications in PaaS and SaaS Clouds , 2015, 2015 3rd International Conference on Future Internet of Things and Cloud.

[40]  Yajun Ha,et al.  Dynamic Scheduling of Imprecise-Computation Tasks on Real-Time Embedded Multiprocessors , 2013, 2013 IEEE 16th International Conference on Computational Science and Engineering.

[41]  Po-Wen Cheng,et al.  Energy-efficient task scheduling for multi-core platforms with per-core DVFS , 2015, J. Parallel Distributed Comput..

[42]  Yinong Chen,et al.  Service-Oriented Computing and Web Software Integration: From Principles to Development , 2011 .

[43]  Albert Y. Zomaya,et al.  Energy-aware parallel task scheduling in a cluster , 2013, Future Gener. Comput. Syst..

[44]  Helen D. Karatza,et al.  Scheduling Data-Intensive Workloads in Large-Scale Distributed Systems: Trends and Challenges , 2018, Modeling and Simulation in HPC and Cloud Systems.

[45]  N. B. Anuar,et al.  The rise of "big data" on cloud computing: Review and open research issues , 2015, Inf. Syst..

[46]  Joanna Koodziej,et al.  Evolutionary Hierarchical Multi-Criteria Metaheuristics for Scheduling in Large-Scale Grid Systems , 2012 .

[47]  Giorgio Buttazzo,et al.  Hard Real-Time Computing Systems: Predictable Scheduling Algorithms and Applications , 1997 .

[48]  Jin Sun,et al.  Minimizing cost and makespan for workflow scheduling in cloud using fuzzy dominance sort based HEFT , 2019, Future Gener. Comput. Syst..