A Spot Capacity Market to Increase Power Infrastructure Utilization in Multi-tenant Data Centers

Despite the common practice of oversubscription, power capacity is largely under-utilized in data centers. A significant factor driving this under-utilization is fluctuation of the aggregate power demand, resulting in unused “spot (power) capacity”. In this paper, we tap into spot capacity for improving power infrastructure utilization in multi-tenant data centers, an important but under-explored type of data center where multiple tenants house their own physical servers. We propose a novel market, called SpotDC, to allocate spot capacity to tenants on demand. Specifically, SpotDC extracts tenants’ racklevel spot capacity demand through an elastic demand function, based on which the operator sets the market price for spot capacity allocation. We evaluate SpotDC using both testbed experiments and simulations, demonstrating that SpotDC improves power infrastructure utilization and creates a “win-win” situation: the data center operator increases its profit (by nearly 10%), while tenants improve their performance (by 1.2–1.8x on average compared to the no spot capacity case, yet at a marginal cost).

[1]  Thomas F. Wenisch,et al.  Power management of online data-intensive services , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).

[2]  Xiaorui Wang,et al.  How much power oversubscription is safe and allowed in data centers , 2011, ICAC '11.

[3]  Christoforos E. Kozyrakis,et al.  Towards energy proportionality for large-scale latency-critical workloads , 2014, 2014 ACM/IEEE 41st International Symposium on Computer Architecture (ISCA).

[4]  Ramesh K. Sitaraman,et al.  Using batteries to reduce the power costs of internet-scale distributed networks , 2012, SoCC '12.

[5]  Qi Li,et al.  Thermal time shifting: Leveraging phase change materials to reduce cooling costs in warehouse-scale computers , 2015, 2015 ACM/IEEE 42nd Annual International Symposium on Computer Architecture (ISCA).

[6]  Joseph E. Gonzalez,et al.  GraphLab: A New Parallel Framework for Machine Learning , 2010 .

[7]  Anand Sivasubramaniam,et al.  Statistical profiling-based techniques for effective power provisioning in data centers , 2009, EuroSys '09.

[8]  Shaolei Ren,et al.  A truthful incentive mechanism for emergency demand response in colocation data centers , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[9]  Adam Wierman,et al.  A market approach for handling power emergencies in multi-tenant data center , 2016, 2016 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[10]  Bin Li,et al.  Dynamo: Facebook's Data Center-Wide Power Management System , 2016, 2016 ACM/IEEE 43rd Annual International Symposium on Computer Architecture (ISCA).

[11]  Longjun Liu,et al.  Towards sustainable in-situ server systems in the big data era , 2015, 2015 ACM/IEEE 42nd Annual International Symposium on Computer Architecture (ISCA).

[12]  Shaolei Ren,et al.  Paying to save: Reducing cost of colocation data center via rewards , 2015, 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA).

[13]  Sangtae Ha,et al.  TUBE: time-dependent pricing for mobile data , 2012, SIGCOMM '12.

[14]  Sriram Sankar,et al.  CoolProvision: underprovisioning datacenter cooling , 2015, SoCC.

[15]  Xiaorui Wang,et al.  Data Center Sprinting: Enabling Computational Sprinting at the Data Center Level , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[16]  George Kesidis,et al.  Recouping Energy Costs From Cloud Tenants: Tenant Demand Response Aware Pricing Design , 2015, e-Energy.

[17]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[18]  John N. Tsitsiklis,et al.  Parameterized Supply Function Bidding: Equilibrium and Efficiency , 2011, Oper. Res..

[19]  Deshi Ye,et al.  A Truthful FPTAS Mechanism for Emergency Demand Response in Colocation Data Centers , 2015, IEEE INFOCOM 2019 - IEEE Conference on Computer Communications.

[20]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[21]  Prashant J. Shenoy,et al.  Cost Minimization Using Renewable Cooling and Thermal Energy Storage in CDNs , 2015, 2015 IEEE International Conference on Autonomic Computing.

[22]  Benjamin C. Lee,et al.  Navigating heterogeneous processors with market mechanisms , 2013, 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA).

[23]  Thu D. Nguyen,et al.  Parasol and GreenSwitch: managing datacenters powered by renewable energy , 2013, ASPLOS '13.

[24]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[25]  Anand Sivasubramaniam,et al.  Virtualizing power distribution in datacenters , 2013, ISCA.

[26]  Nanning Zheng,et al.  HEB: Deploying and managing hybrid energy buffers for improving datacenter efficiency and economy , 2015, 2015 ACM/IEEE 42nd Annual International Symposium on Computer Architecture (ISCA).

[27]  Benjamin C. Lee,et al.  The Computational Sprinting Game , 2016, ASPLOS.

[28]  Babak Falsafi,et al.  Clearing the clouds: a study of emerging scale-out workloads on modern hardware , 2012, ASPLOS XVII.

[29]  Marios C. Papaefthymiou,et al.  Computational sprinting , 2012, IEEE International Symposium on High-Performance Comp Architecture.

[30]  Xiaodong Wang,et al.  ReBudget: Trading Off Efficiency vs. Fairness in Market-Based Multicore Resource Allocation via Runtime Budget Reassignment , 2016 .

[31]  Thomas F. Wenisch,et al.  Power routing: dynamic power provisioning in the data center , 2010, ASPLOS XV.

[32]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[33]  Lachlan L. H. Andrew,et al.  Greening Geographical Load Balancing , 2015, IEEE/ACM Transactions on Networking.

[34]  Anand Sivasubramaniam,et al.  Energy storage in datacenters: what, where, and how much? , 2012, SIGMETRICS '12.

[35]  Wei Xu,et al.  Increasing large-scale data center capacity by statistical power control , 2016, EuroSys.

[36]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[37]  Srinivasan Keshav,et al.  It's not easy being green , 2012, CCRV.

[38]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.