Learning from Optimal: Energy Procurement Strategies for Data Centers

Environmental concerns and rising grid prices have motivated data center owners to invest in on-site renewable energy sources. However, these sources present challenges as they are unreliable and intermittent. In an effort to mitigate these issues, data centers are incorporating energy storage systems. This introduces the opportunity for electricity bill reduction, as energy storage can be used for power market arbitrage. We present two supervised learning-based algorithms, LearnBuy, that learns the amount to purchase, and LearnStore, that learns the amount to store, to solve this energy procurement problem. These algorithms utilize the idea of "learning from optimal" by using the values generated by the offline optimization as a label for training. We test our algorithms on a general case, considering buying and selling back to the grid, and a special case, considering only buying from the grid. In the general case, LearnStore achieves a 10--16% reduction compared to baseline heuristics, whereas in the special case, LearnBuy achieves a 7% reduction compared to prior art.

[1]  Daniel S. Berger Towards Lightweight and Robust Machine Learning for CDN Caching , 2018, HotNets.

[2]  Anand Sivasubramaniam,et al.  Optimal power cost management using stored energy in data centers , 2011, PERV.

[3]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[4]  Xue Liu,et al.  Comprehensive understanding of operation cost reduction using energy storage for IDCs , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[5]  A. Azzouz 2011 , 2020, City.

[6]  Hao Wang,et al.  Energy Storage Arbitrage in Real-Time Markets via Reinforcement Learning , 2017, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[7]  L H AndrewLachlan,et al.  Dynamic right-sizing for power-proportional data centers , 2013 .

[8]  Adam Wierman,et al.  Online Inventory Management with Application to Energy Procurement in Data Centers , 2019, ArXiv.

[9]  Craig Boutilier,et al.  Data center cooling using model-predictive control , 2018, NeurIPS.

[10]  Kai Ma,et al.  Exploiting thermal energy storage to reduce data center capital and operating expenses , 2014, 2014 IEEE 20th International Symposium on High Performance Computer Architecture (HPCA).

[11]  Vahid Liaghat,et al.  Online Energy Storage Management: an Algorithmic Approach , 2016, APPROX-RANDOM.

[12]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[13]  Adam Wierman,et al.  Renewable and cooling aware workload management for sustainable data centers , 2012, SIGMETRICS '12.

[14]  Minghua Chen,et al.  Hour-Ahead Offering Strategies in Electricity Market for Power Producers with Storage and Intermittent Supply , 2017, SIGMETRICS.

[15]  Yuguang Fang,et al.  Electricity Cost Saving Strategy in Data Centers by Using Energy Storage , 2013, IEEE Transactions on Parallel and Distributed Systems.

[16]  Xue Liu,et al.  Minimizing Electricity Cost: Optimization of Distributed Internet Data Centers in a Multi-Electricity-Market Environment , 2010, 2010 Proceedings IEEE INFOCOM.

[17]  Jean C. Walrand,et al.  Optimal demand response with energy storage management , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[18]  Anand Sivasubramaniam,et al.  Aggressive Datacenter Power Provisioning with Batteries , 2013, TOCS.

[19]  Laurent Massoulié,et al.  Optimal Control of End-User Energy Storage , 2012, IEEE Transactions on Smart Grid.

[20]  Allan Borodin,et al.  Online computation and competitive analysis , 1998 .

[21]  Minghua Chen,et al.  Cost Minimizing Online Algorithms for Energy Storage Management With Worst-Case Guarantee , 2015, IEEE Transactions on Smart Grid.

[22]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[23]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[24]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[25]  Lachlan L. H. Andrew,et al.  Greening Geographical Load Balancing , 2015, IEEE/ACM Transactions on Networking.

[26]  Ramesh K. Sitaraman,et al.  Using batteries to reduce the power costs of internet-scale distributed networks , 2012, SoCC '12.

[27]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.