Cost-Minimizing Bandwidth Guarantee for Inter-Datacenter Traffic

The emerging deployment of large-scale cloud applications incurs significant inter-datacenter traffic, which makes the scarce wide-area bandwidth across data centers become the performance bottleneck. To achieve the desirable network performance, bandwidth guarantee should be provided for the resulting inter-datacenter traffic. However, the existing bandwidth allocation methods mainly focus on intra-datacenter traffic, and cannot achieve the cost-minimizing bandwidth guarantee for inter-datacenter traffic. In this paper, we focus on the bandwidth guarantee problem for inter-datacenter traffic and present a novel bandwidth allocation model. Our model can ensure the bandwidth guarantee, minimize the resulting network cost, and efficiently avoid the potential traffic overload on low cost links. To solve the large-scale optimization problem in our model, we are motivated to develop a distributed algorithm by blending the advantages of alternating direction method of multipliers (ADMM) and the auxiliary variable method. Specifically, we efficiently decompose the optimization problem into many small sub-problems, which are allowed to be processed in a large-scale computing environment, where each server solves a few small sub-problems. We further present a theoretically proved globally, asymptotically stable algorithm to solve these sub-problems. Extensive evaluation results demonstrate that our bandwidth allocation method can effectively realize the bandwidth guarantee for inter-datacenter traffic with reduced network cost and outperforms the prior method PS-L. In particular, the total network cost is reduced by 59.57 percent on average.

[1]  Haiying Shen,et al.  Selective Data replication for Online Social Networks with Distributed Datacenters , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[2]  Albert G. Greenberg,et al.  Optimizing Cost and Performance in Online Service Provider Networks , 2010, NSDI.

[3]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[4]  Zhi-Li Zhang,et al.  A first look at inter-data center traffic characteristics via Yahoo! datasets , 2011, 2011 Proceedings IEEE INFOCOM.

[5]  Ning Ding,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, SIGCOMM.

[6]  Yunhao Liu,et al.  Expandable and Cost-Effective Network Structures for Data Centers Using Dual-Port Servers , 2013, IEEE Transactions on Computers.

[7]  Ming Zhang,et al.  Guaranteeing deadlines for inter-datacenter transfers , 2015, EuroSys.

[8]  Ivan Stojmenovic,et al.  Joint Optimization of Bandwidth for Provider and Delay for User in Software Defined Data Centers , 2017, IEEE Transactions on Cloud Computing.

[9]  Sujata Banerjee,et al.  ElasticSwitch: practical work-conserving bandwidth guarantees for cloud computing , 2013, SIGCOMM.

[10]  Helen J. Wang,et al.  SecondNet: a data center network virtualization architecture with bandwidth guarantees , 2010, CoNEXT.

[11]  Albert G. Greenberg,et al.  Sharing the Data Center Network , 2011, NSDI.

[12]  Albert G. Greenberg,et al.  The cost of a cloud: research problems in data center networks , 2008, CCRV.

[13]  Nick Feamster,et al.  How many tiers?: pricing in the internet transit market , 2011, SIGCOMM.

[14]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[15]  Sujata Banerjee,et al.  Application-driven bandwidth guarantees in datacenters , 2015, SIGCOMM.

[16]  J. Rexford,et al.  To Coordinate Or Not To Coordinate? Wide-Area Traffic Management for Data Centers , 2012 .

[17]  Bob Briscoe,et al.  Flow rate fairness: dismantling a religion , 2007, CCRV.

[18]  G. Motta,et al.  Cloud Computing: An Architectural and Technological Overview , 2012, 2012 International Joint Conference on Service Sciences.

[19]  Alexandru Iosup,et al.  On the Performance Variability of Production Cloud Services , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[20]  Hai Jin,et al.  A cooperative game based allocation for sharing data center networks , 2013, 2013 Proceedings IEEE INFOCOM.

[21]  Keqiu Li,et al.  iDaaS: Inter-Datacenter Network as a Service , 2018, IEEE Transactions on Parallel and Distributed Systems.

[22]  Fang Hao,et al.  Unreeling netflix: Understanding and improving multi-CDN movie delivery , 2012, 2012 Proceedings IEEE INFOCOM.

[23]  Mark Handley,et al.  TCP Extensions for Multipath Operation with Multiple Addresses , 2011 .

[24]  Bo Li,et al.  Towards performance-centric fairness in datacenter networks , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[25]  Dan Li,et al.  Towards bandwidth guarantee in multi-tenancy cloud computing networks , 2012, 2012 20th IEEE International Conference on Network Protocols (ICNP).

[26]  Baochun Li,et al.  A theory of cloud bandwidth pricing for video-on-demand providers , 2012, 2012 Proceedings IEEE INFOCOM.

[27]  Linlin You,et al.  Service level agreement (SLA) in Public Cloud environments: A Survey on the current enterprises adoption , 2015, 2015 5th International Conference on Information Science and Technology (ICIST).

[28]  Hai Jin,et al.  On efficient bandwidth allocation for traffic variability in datacenters , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[29]  Ion Stoica,et al.  FairCloud: sharing the network in cloud computing , 2011, SIGCOMM '12.

[30]  Albert G. Greenberg,et al.  EyeQ: Practical Network Performance Isolation at the Edge , 2013, NSDI.

[31]  Mark Handley,et al.  TCP Extensions for Multipath Operation with Multiple Addresses , 2020, RFC.

[32]  Rayadurgam Srikant,et al.  The Mathematics of Internet Congestion Control , 2003 .

[33]  Bo Li,et al.  Jetway: minimizing costs on inter-datacenter video traffic , 2012, ACM Multimedia.

[34]  Dorgival O. Guedes,et al.  Gatekeeper: Supporting Bandwidth Guarantees for Multi-tenant Datacenter Networks , 2011, WIOV.

[35]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[36]  Katherine Guo,et al.  Intra-cloud lightning: Building CDNs in the cloud , 2012, 2012 Proceedings IEEE INFOCOM.