Equinox: Adaptive network reservation in the Cloud

Most of today's public cloud services provide dedicated compute and memory resources but they do not provide any dedicated network resources. The shared network can be a major cause of the well known “noisy neighbor” problem, which is a growing concern in public cloud services like Amazon EC2. Network reservations, therefore, are of prime importance for the Cloud. However, a tenant's network demand would usually keep changing over time and thus, a static one-time reservation would either lead to poor performance or resource wastage (and higher cost). In this context, we present Equinox - a system that automatically reserves end-to-end bandwidth for a tenant based on the predicted demand and adapts this reservation with time. We leverage flow monitoring support in virtual switches to collect flow data that helps us predict demand at a future time. We use a combination of vswitch based rate-limiting and OpenFlow based flow rerouting to provision end-to-end bandwidth requirements. We have implemented Equinox in an OpenStack environment with OpenFlow based network control. Our experimental results, using traces based on Facebook's production data centers, show that Equinox can provide up to 47% reduction in bandwidth cost as compared to a static reservation scheme while providing the same efficiency in terms of flow completion times.

[1]  Yanpei Chen,et al.  Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads , 2012, Proc. VLDB Endow..

[2]  Vijay Mann,et al.  Living on the edge: Monitoring network flows at the edge in cloud data centers , 2013, 2013 Fifth International Conference on Communication Systems and Networks (COMSNETS).

[3]  Deep Medhi,et al.  Adaptive bandwidth provisioning envelope based on discrete temporal network measurements , 2004, IEEE INFOCOM 2004.

[4]  Baochun Li,et al.  Quality-assured cloud bandwidth auto-scaling for video-on-demand applications , 2012, 2012 Proceedings IEEE INFOCOM.

[5]  I. Stoica,et al.  FairCloud: sharing the network in cloud computing , 2011, CCRV.

[6]  Xiaowei Yang,et al.  CloudCmp: comparing public cloud providers , 2010, IMC '10.

[7]  Antony I. T. Rowstron,et al.  The price is right: towards location-independent costs in datacenters , 2011, HotNets-X.

[8]  Albert G. Greenberg,et al.  EyeQ: Practical Network Performance Isolation at the Edge , 2013, NSDI.

[9]  Albert G. Greenberg,et al.  A flexible model for resource management in virtual private networks , 1999, SIGCOMM '99.

[10]  Vijay Mann,et al.  Managing Network Reservation for Tenants in Oversubscribed Clouds , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[11]  Amin Vahdat,et al.  NicPic: Scalable and Accurate End-Host Rate Limiting , 2013, HotCloud.

[12]  Archana Ganapathi,et al.  The Case for Evaluating MapReduce Performance Using Workload Suites , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[13]  Dorgival O. Guedes,et al.  Gatekeeper: Supporting Bandwidth Guarantees for Multi-tenant Datacenter Networks , 2011, WIOV.

[14]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[15]  T. S. Eugene Ng,et al.  The Impact of Virtualization on Network Performance of Amazon EC2 Data Center , 2010, 2010 Proceedings IEEE INFOCOM.

[16]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[17]  Di Xie,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, CCRV.

[18]  Aiko Pras,et al.  Estimating Bandwidth Requirements Using Flow-Level Measurements , 2011, AIMS.

[19]  Baochun Li,et al.  Pricing cloud bandwidth reservations under demand uncertainty , 2012, SIGMETRICS '12.

[20]  Jorge-Arnulfo Quiané-Ruiz,et al.  Runtime measurements in the cloud , 2010, Proc. VLDB Endow..

[21]  K. N. Dollman,et al.  - 1 , 1743 .

[22]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[23]  David A. Maltz,et al.  Cloudward bound: planning for beneficial migration of enterprise applications to the cloud , 2010, SIGCOMM '10.

[24]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[25]  George Varghese,et al.  Netshare and stochastic netshare: predictable bandwidth allocation for data centers , 2012, CCRV.

[26]  Gautam Kumar,et al.  FairCloud: sharing the network in cloud computing , 2011, CCRV.

[27]  Deng Pan,et al.  OpenFlow based flow level bandwidth provisioning for CICQ switches , 2011, 2011 Proceedings IEEE INFOCOM.

[28]  Helen J. Wang,et al.  SecondNet: a data center network virtualization architecture with bandwidth guarantees , 2010, CoNEXT.

[29]  Albert G. Greenberg,et al.  Sharing the Data Center Network , 2011, NSDI.