Let's wait awhile: how temporal workload shifting can reduce carbon emissions in the cloud

Depending on energy sources and demand, the carbon intensity of the public power grid fluctuates over time. Exploiting this variability is an important factor in reducing the emissions caused by data centers. However, regional differences in the availability of low-carbon energy sources make it hard to provide general best practices for when to consume electricity. Moreover, existing research in this domain focuses mostly on carbon-aware workload migration across geo-distributed data centers, or addresses demand response purely from the perspective of power grid stability and costs. In this paper, we examine the potential impact of shifting computational workloads towards times where the energy supply is expected to be less carbon-intensive. To this end, we identify characteristics of delay-tolerant workloads and analyze the potential for temporal workload shifting in Germany, Great Britain, France, and California over the year 2020. Furthermore, we experimentally evaluate two workload shifting scenarios in a simulation to investigate the influence of time constraints, scheduling strategies, and the accuracy of carbon intensity forecasts. To accelerate research in the domain of carbon-aware computing and to support the evaluation of novel scheduling algorithms, our simulation framework and datasets are publicly available.

[1]  Rajkumar Buyya,et al.  Energy and Carbon Footprint-Aware Management of Geo-Distributed Cloud Data Centers: A Taxonomy, State of the Art, and Future Directions , 2017 .

[2]  Eric Masanet,et al.  Recalibrating global data center energy-use estimates , 2020, Science.

[3]  Robert Basmadjian,et al.  Flexibility-Based Energy and Demand Management in Data Centers: A Case Study for Cloud Computing , 2019, Energies.

[4]  Narendra Kumar Kamila Advancing Cloud Database Systems and Capacity Planning with Dynamic Applications , 2016 .

[5]  Adam Wierman,et al.  Renewable and cooling aware workload management for sustainable data centers , 2012, SIGMETRICS '12.

[6]  Andreas Polze,et al.  Evaluation of Load Prediction Techniques for Distributed Stream Processing , 2021, 2021 IEEE International Conference on Cloud Engineering (IC2E).

[7]  Mohamed Cheriet,et al.  Carbon-aware distributed cloud: multi-level grouping genetic algorithm , 2015, Cluster Computing.

[8]  Hai Jin,et al.  Carbon-Aware Load Balancing for Geo-distributed Cloud Services , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[9]  Christopher Stewart,et al.  Some Joules Are More Precious Than Others: Managing Renewable Energy in the Datacenter∗ , 2009 .

[10]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[11]  Jordi Torres,et al.  GreenSlot: Scheduling energy consumption in green datacenters , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[12]  Andy Hopper,et al.  Free Lunch: Exploiting Renewable Energy for Computing , 2011, HotOS.

[13]  J. Ortiz,et al.  Environmental and Economic Impact of Demand Response Strategies for Energy Flexible Buildings , 2018 .

[14]  Adam Wierman,et al.  Opportunities and challenges for data center demand response , 2014, International Green Computing Conference.

[15]  Thomas Ledoux,et al.  Towards energy-proportional clouds partially powered by renewable energy , 2016, Computing.

[16]  Gorm Bruun Andresen,et al.  Short-term CO2 emissions forecasting based on decomposition approaches and its impact on electricity market scheduling , 2020, Applied Energy.

[17]  Shahaboddin Shamshirband,et al.  Sustainable Cloud Data Centers: A survey of enabling techniques and technologies , 2016 .

[18]  Henrik Madsen,et al.  Short-Term Forecasting of CO2 Emission Intensity in Power Grids by Machine Learning , 2020, Applied Energy.

[19]  Pierluigi Siano,et al.  A survey of industrial applications of Demand Response , 2016 .

[20]  Yefu Wang,et al.  GreenWare: Greening Cloud-Scale Data Centers to Maximize the Use of Renewable Energy , 2011, Middleware.

[21]  Tero Karras,et al.  Training Generative Adversarial Networks with Limited Data , 2020, NeurIPS.

[22]  Walfredo Cirne,et al.  Carbon-Aware Computing for Datacenters , 2021, IEEE Transactions on Power Systems.

[23]  Girish Ghatikar,et al.  Demand Response Opportunities and Enabling Technologies for Data Centers: Findings From Field Studies , 2012 .

[24]  Barbara Pernici,et al.  CO2-Aware Adaptation Strategies for Cloud Applications , 2016, IEEE Transactions on Cloud Computing.

[25]  Max J. Krause,et al.  Quantification of energy and carbon costs for mining cryptocurrencies , 2018, Nature Sustainability.

[26]  Dirk Müller,et al.  Data Center Control Strategy for Participation in Demand Response Programs , 2018, IEEE Transactions on Industrial Informatics.

[27]  Michael C. Caramanis,et al.  The data center as a grid load stabilizer , 2014, 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC).

[28]  A. Chien,et al.  Mitigating Curtailment and Carbon Emissions through Load Migration between Data Centers , 2020 .

[29]  Chao Li,et al.  iSwitch: Coordinating and optimizing renewable energy powered server clusters , 2012, 2012 39th Annual International Symposium on Computer Architecture (ISCA).

[30]  Thu D. Nguyen,et al.  Parasol and GreenSwitch: managing datacenters powered by renewable energy , 2013, ASPLOS '13.

[31]  Marcel Antal,et al.  Energy Flexibility Prediction for Data Center Engagement in Demand Response Programs , 2020, Sustainability.

[32]  Carlo Curino,et al.  Morpheus: Towards Automated SLOs for Enterprise Clusters , 2016, OSDI.

[33]  Sonja Klingert,et al.  Mapping Data Centre Business Types with Power Management Strategies to Identify Demand Response Candidates , 2018, e-Energy.

[34]  Jordi Torres,et al.  Matching renewable energy supply and demand in green datacenters , 2015, Ad Hoc Networks.

[35]  Jordi Torres,et al.  GreenHadoop: leveraging green energy in data-processing frameworks , 2012, EuroSys '12.

[36]  Kejiang Ye,et al.  Imbalance in the cloud: An analysis on Alibaba cluster trace , 2017, 2017 IEEE International Conference on Big Data (Big Data).

[37]  Srikanth Kandula,et al.  Reoptimizing Data Parallel Computing , 2012, NSDI.

[38]  Adam Wierman,et al.  Data center demand response: avoiding the coincident peak via workload shifting and local generation , 2013, SIGMETRICS '13.

[39]  Jing Guo,et al.  Who Limits the Resource Efficiency of My Datacenter: An Analysis of Alibaba Datacenter Traces , 2019, 2019 IEEE/ACM 27th International Symposium on Quality of Service (IWQoS).

[40]  Thibault Péan,et al.  Price and carbon-based energy flexibility of residential heating and cooling loads using model predictive control , 2019, Sustainable Cities and Society.

[41]  Rolf Riesen,et al.  Accelerating incremental checkpointing for extreme-scale computing , 2013, Future Gener. Comput. Syst..

[42]  Jinqing Peng,et al.  Energy consumption of cryptocurrency mining: A study of electricity consumption in mining cryptocurrencies , 2019, Energy.

[43]  Sonja Klingert,et al.  Spinning gold from straw - evaluating the flexibility of data centres on power markets , 2020 .

[44]  Florin Pop,et al.  Exploiting data centres energy flexibility in smart cities: Business scenarios , 2019, Inf. Sci..

[45]  G. Lowry Day-ahead forecasting of grid carbon intensity in support of heating, ventilation and air-conditioning plant demand response decision-making to reduce carbon emissions , 2018 .

[46]  G. Andresen,et al.  Real-time carbon accounting method for the European electricity markets , 2018, Energy Strategy Reviews.

[47]  Gilbert Fridgen,et al.  Not All Doom and Gloom: How Energy-Intensive and Temporally Flexible Data Center Applications May Actually Promote Renewable Energy Sources , 2021, Business & Information Systems Engineering.

[48]  Lauritz Thamsen,et al.  LEAF: Simulating Large Energy-Aware Fog Computing Environments , 2021, 2021 IEEE 5th International Conference on Fog and Edge Computing (ICFEC).

[49]  Marcel Antal,et al.  Optimized flexibility management enacting Data Centres participation in Smart Demand Response programs , 2018, Future Gener. Comput. Syst..

[50]  Mor Harchol-Balter,et al.  Borg: the next generation , 2020, EuroSys.

[51]  Ricardo Bianchini,et al.  Serverless in the Wild: Characterizing and Optimizing the Serverless Workload at a Large Cloud Provider , 2020, USENIX Annual Technical Conference.

[52]  Pedro S. Moura,et al.  A review on energy efficiency and demand response with focus on small and medium data centers , 2018, Energy Efficiency.

[53]  Christof Weinhardt,et al.  Carbon efficient smart charging using forecasts of marginal emission factors , 2021 .

[54]  P. Popovski,et al.  Reducing the carbon footprint of house heating through model predictive control – A simulation study in Danish conditions , 2018, Sustainable Cities and Society.

[55]  Fabien Hermenier,et al.  An Energy Aware Application Controller for Optimizing Renewable Energy Consumption in Data Centres , 2015, 2015 IEEE/ACM 8th International Conference on Utility and Cloud Computing (UCC).

[56]  Darko Marinov,et al.  Usage, costs, and benefits of continuous integration in open-source projects , 2016, 2016 31st IEEE/ACM International Conference on Automated Software Engineering (ASE).

[57]  Yuan Yao,et al.  Data centers power reduction: A two time scale approach for delay tolerant workloads , 2012, 2012 Proceedings IEEE INFOCOM.

[58]  Tajana Rosing,et al.  Utilizing green energy prediction to schedule mixed batch and service jobs in data centers , 2011, OPSR.