Energy-Efficiency and Sustainability in New Generation Cloud Computing: A Vision and Directions for Integrated Management of Data Centre Resources and Workloads

Cloud computing has become a critical infrastructure for modern society, like electric power grids and roads. As the backbone of the modern economy, it offers subscription-based computing services anytime, anywhere, on a pay-as-you-go basis. Its use is growing exponentially with the continued development of new classes of applications driven by a huge number of emerging networked devices. However, the success of Cloud computing has created a new global energy challenge, as it comes at the cost of vast energy usage. Currently, data centres hosting Cloud services world-wide consume more energy than most countries. Globally, by 2025, they are projected to consume 20% of global electricity and emit up to 5.5% of the world's carbon emissions. In addition, a significant part of the energy consumed is transformed into heat which leads to operational problems, including a reduction in system reliability and the life expectancy of devices, and escalation in cooling requirements. Therefore, for future generations of Cloud computing to address the environmental and operational consequences of such significant energy usage, they must become energy-efficient and environmentally sustainable while continuing to deliver high-quality services. In this paper, we propose a vision for learning-centric approach for the integrated management of new generation Cloud computing environments to reduce their energy consumption and carbon footprint while delivering service quality guarantees. In this paper, we identify the dimensions and key issues of integrated resource management and our envisioned approaches to address them. We present a conceptual architecture for energy-efficient new generation Clouds and early results on the integrated management of resources and workloads that evidence its potential benefits towards energy efficiency and sustainability.

[1]  Mengchu Zhou,et al.  Energy Consumption and Performance Optimized Task Scheduling in Distributed Data Centers , 2022, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Mengchu Zhou,et al.  Energy-Efficient and QoS-Optimized Adaptive Task Scheduling and Management in Clouds , 2022, IEEE Transactions on Automation Science and Engineering.

[3]  Kotagiri Ramamohanarao,et al.  ADRL: A Hybrid Anomaly-Aware Deep Reinforcement Learning-Based Resource Scaling in Clouds , 2021, IEEE Transactions on Parallel and Distributed Systems.

[4]  Rajkumar Buyya,et al.  A Data-Driven Frequency Scaling Approach for Deadline-aware Energy Efficient Scheduling on Graphics Processing Units (GPUs) , 2020, 2020 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing (CCGRID).

[5]  D. Mankowitz,et al.  An empirical investigation of the challenges of real-world reinforcement learning , 2020, ArXiv.

[6]  Zhengcai Cao,et al.  Scheduling Real-Time Parallel Applications in Cloud to Minimize Energy Consumption , 2019, IEEE Transactions on Cloud Computing.

[7]  Helen D. Karatza,et al.  An energy-efficient, QoS-aware and cost-effective scheduling approach for real-time workflow applications in cloud computing systems utilizing DVFS and approximate computations , 2019, Future Gener. Comput. Syst..

[8]  Hang Liu,et al.  Multi-Objective Workflow Scheduling With Deep-Q-Network-Based Multi-Agent Reinforcement Learning , 2019, IEEE Access.

[9]  Eric Masanet,et al.  Data center growth in the United States: decoupling the demand for services from electricity use , 2018, Environmental Research Letters.

[10]  José Manuel Moya,et al.  Heuristics and metaheuristics for dynamic management of computing and cooling energy in cloud data centers , 2018, Softw. Pract. Exp..

[11]  Rajkumar Buyya,et al.  A Taxonomy and Future Directions for Sustainable Cloud Computing , 2017, ACM Comput. Surv..

[12]  Dejan S. Milojicic,et al.  A Manifesto for Future Generation Cloud Computing: Research Directions for the Next Decade , 2018 .

[13]  Adam Wierman,et al.  A Spot Capacity Market to Increase Power Infrastructure Utilization in Multi-tenant Data Centers , 2017, 2018 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[14]  Rajkumar Buyya,et al.  Dynamic Voltage and Frequency Scaling‐aware dynamic consolidation of virtual machines for energy efficient cloud data centers , 2017, Concurr. Comput. Pract. Exp..

[15]  Stéphane Bressan,et al.  Learn-as-You-Go with Megh: Efficient Live Migration of Virtual Machines , 2017, 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS).

[16]  Lachlan L. H. Andrew,et al.  Dynamic VM Placement Method for Minimizing Energy and Carbon Cost in Geographically Distributed Cloud Data Centers , 2017, IEEE Transactions on Sustainable Computing.

[17]  Dejan S. Milojicic,et al.  Evaluating and Improving the Performance and Scheduling of HPC Applications in Cloud , 2016, IEEE Transactions on Cloud Computing.

[18]  Alex Delis,et al.  Decentralized and Energy-Efficient Workload Management in Enterprise Clouds , 2016, IEEE Transactions on Cloud Computing.

[19]  Mohammed Rashid Chowdhury,et al.  Implementation and performance analysis of various VM placement strategies in CloudSim , 2015, Journal of Cloud Computing.

[20]  Rajkumar Buyya,et al.  The anatomy of big data computing , 2015, Softw. Pract. Exp..

[21]  Alexandru Iosup,et al.  Statistical Characterization of Business-Critical Workloads Hosted in Cloud Datacenters , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[22]  Anders S. G. Andrae,et al.  On Global Electricity Usage of Communication Technology: Trends to 2030 , 2015 .

[23]  Rajkumar Buyya,et al.  Energy-Efficient Scheduling of Urgent Bag-of-Tasks Applications in Clouds through DVFS , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[24]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[25]  Yuguang Fang,et al.  Electricity Cost Saving Strategy in Data Centers by Using Energy Storage , 2013, IEEE Transactions on Parallel and Distributed Systems.

[26]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[27]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[28]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[29]  Jeffrey S. Chase,et al.  Weatherman: Automated, Online and Predictive Thermal Mapping and Management for Data Centers , 2006, 2006 IEEE International Conference on Autonomic Computing.

[30]  Rajkumar Buyya,et al.  Service Level Agreement based Allocation of Cluster Resources: Handling Penalty to Enhance Utility , 2005, 2005 IEEE International Conference on Cluster Computing.

[31]  Alfred Kobsa,et al.  Energy-Efficient Data Centers , 2014, Lecture Notes in Computer Science.