Pricing Intra-Datacenter Networks with Over-Committed Bandwidth Guarantee

Current IaaS clouds provide performance guarantee on CPU and memory but no quantitative network performance for VM instances. Our measurements from three production IaaS clouds show that for the VMs with same CPU and memory, or similar pricing, the difference in bandwidth performance can be as much as 16×, which reveals a severe price-performance anomaly due to a lack of pricing for bandwidth guarantee. Considering the low network utilization in cloud-scale datacenters, we address this by presenting SoftBW, a system that enables pricing bandwidth with over commitment on bandwidth guarantee. SoftBW leverages usage-based charging to guarantee price-performance consistency among tenants, and implements a fulfillment based scheduling to provide bandwidth/fairness guarantee under bandwidth over commitment. Both testbed experiments and large-scale simulation results validate SoftBW's ability of providing efficient bandwidth guarantee, and show that by using bandwidth over commitment, SoftBW increases 3.9× network utilization while incurring less than 5% guarantee failure.

[1]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[2]  Van Jacobson,et al.  Link-sharing and resource management models for packet networks , 1995, TNET.

[3]  Hai Jin,et al.  On efficient bandwidth allocation for traffic variability in datacenters , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[4]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[5]  Sandeep Chinchali,et al.  NUMFabric: Fast and Flexible Bandwidth Allocation in Datacenters , 2016, SIGCOMM.

[6]  Hai Jin,et al.  A cooperative game based allocation for sharing data center networks , 2013, 2013 Proceedings IEEE INFOCOM.

[7]  Nick McKeown,et al.  Virtualized Congestion Control , 2016, SIGCOMM.

[8]  Albert G. Greenberg,et al.  EyeQ: Practical Network Performance Isolation at the Edge , 2013, NSDI.

[9]  George Varghese,et al.  Efficient fair queueing using deficit round robin , 1995, SIGCOMM '95.

[10]  A. Rowstron,et al.  Towards predictable datacenter networks , 2011, SIGCOMM.

[11]  Ion Stoica,et al.  Efficient coflow scheduling with Varys , 2014, SIGCOMM.

[12]  Sujata Banerjee,et al.  Application-driven bandwidth guarantees in datacenters , 2014, SIGCOMM.

[13]  Gautam Kumar,et al.  FairCloud: sharing the network in cloud computing , 2011, CCRV.

[14]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[15]  Baochun Li,et al.  Pricing cloud bandwidth reservations under demand uncertainty , 2012, SIGMETRICS '12.

[16]  I. Stoica,et al.  FairCloud: sharing the network in cloud computing , 2011, CCRV.

[17]  Albert G. Greenberg,et al.  Data center TCP (DCTCP) , 2010, SIGCOMM '10.

[18]  Hai Jin,et al.  Fair Network Bandwidth Allocation in IaaS Datacenters via a Cooperative Game Approach , 2016, IEEE/ACM Transactions on Networking.

[19]  Dorgival O. Guedes,et al.  Gatekeeper: Supporting Bandwidth Guarantees for Multi-tenant Datacenter Networks , 2011, WIOV.

[20]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[21]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[22]  Justine Sherry,et al.  Silo: Predictable Message Latency in the Cloud , 2015, Comput. Commun. Rev..

[23]  Sujata Banerjee,et al.  ElasticSwitch: practical work-conserving bandwidth guarantees for cloud computing , 2013, SIGCOMM.

[24]  Bingsheng He,et al.  Distributed Systems Meet Economics: Pricing in the Cloud , 2010, HotCloud.

[25]  Helen J. Wang,et al.  SecondNet: a data center network virtualization architecture with bandwidth guarantees , 2010, CoNEXT.

[26]  Baochun Li,et al.  A study of pricing for cloud resources , 2013, PERV.

[27]  Hai Jin,et al.  Falloc: Fair network bandwidth allocation in IaaS datacenters via a bargaining game approach , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[28]  George Varghese,et al.  NetShare: Virtualizing Bandwidth within the Cloud , 2009 .

[29]  Liang Zheng,et al.  How to Bid the Cloud , 2015, Comput. Commun. Rev..

[30]  Nick McKeown,et al.  pFabric: minimal near-optimal datacenter transport , 2013, SIGCOMM.

[31]  Albert G. Greenberg,et al.  Sharing the Data Center Network , 2011, NSDI.

[32]  Jian Guo,et al.  eBA: Efficient Bandwidth Guarantee Under Traffic Variability in Datacenters , 2017, IEEE/ACM Transactions on Networking.

[33]  Di Xie,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, CCRV.

[34]  Srikanth Kandula,et al.  Dynamic Pricing and Traffic Engineering for Timely Inter-Datacenter Transfers , 2016, SIGCOMM.

[35]  Ning Ding,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, SIGCOMM.

[36]  Keqiang He,et al.  AC/DC TCP: Virtual Congestion Control Enforcement for Datacenter Networks , 2016, SIGCOMM.

[37]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.