UFalloc: Towards Utility Max-min Fairness of Bandwidth Allocation for Applications in Datacenter Networks

Providing fair bandwidth allocation for applications is becoming increasingly compelling in cloud datacenters, as different applications compete for the shared datacenter network resources. While existing solutions mainly provide bandwidth guarantees for virtual machines (VMs) or tenants with the aim of achieving the VM-level or tenant-level fairness of bandwidth allocation, scant attention has been paid to providing bandwidth guarantees for applications to achieve the fairness of application performance (utility). In this paper, we introduce a rigorous definition of application-level utility max-min fairness, which guides us to develop a non-linear model to investigate the relationship between the utility fairness and bandwidth allocation for applications. Based on such a model, we further arbitrate the intrinsic tradeoff between the network bandwidth utilization and utility fairness of application bandwidth allocation, using a tunable fairness relaxation factor. To improve the bandwidth utilization while maintaining the strict utility fairness of bandwidth allocation, we design UFalloc, an application-level Utility max-min Fair bandwidth allocation strategy in datacenter networks. With extensive experiments using OpenFlow in Mininet virtual network environment, we demonstrate that UFalloc can achieve high utilization of network bandwidth while maintaining the utility max-min fair share of bandwidth allocation with a certain degree of fairness relaxation, yet with an acceptable computational overhead.

[1]  Wei Zhang,et al.  Achieving Application-Level Utility Max-Min Fairness of Bandwidth Allocation in Datacenter Networks , 2015, CollaborateCom.

[2]  Hai Jin,et al.  Heterogeneity and Interference-Aware Virtual Machine Provisioning for Predictable Performance in the Cloud , 2016, IEEE Transactions on Computers.

[3]  Ishai Menache,et al.  Network-Aware Scheduling for Data-Parallel Jobs: Plan When You Can , 2015, SIGCOMM.

[4]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[5]  Lei Yu,et al.  Dynamic scaling of virtual clusters with bandwidth guarantee in cloud datacenters , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[6]  Qi Zhang,et al.  A New Disk I/O Model of Virtualized Cloud Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[7]  Sujata Banerjee,et al.  Application-driven bandwidth guarantees in datacenters , 2014, SIGCOMM.

[8]  Strong Duality for Generalized Convex Optimization Problems , 2005 .

[9]  Athanasios V. Vasilakos,et al.  Managing Performance Overhead of Virtual Machines in Cloud Computing: A Survey, State of the Art, and Future Directions , 2014, Proceedings of the IEEE.

[10]  Jean C. Walrand,et al.  Fair end-to-end window-based congestion control , 2000, TNET.

[11]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[12]  Duan Li Zero duality gap for a class of nonconvex optimization problems , 1995 .

[13]  J. B. Rosen The Gradient Projection Method for Nonlinear Programming. Part I. Linear Constraints , 1960 .

[14]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[15]  Yanhui Geng,et al.  FLOWPROPHET: Generic and Accurate Traffic Prediction for Data-Parallel Cluster Computing , 2015, 2015 IEEE 35th International Conference on Distributed Computing Systems.

[16]  Marimuthu Palaniswami,et al.  Utility max-min fair flow control for multipath communication networks , 2007 .

[17]  Houshang H. Sohrab Basic real analysis , 2003 .

[18]  Ellen W. Zegura,et al.  Utility max-min: an application-oriented bandwidth allocation scheme , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[19]  Harold W. Kuhn,et al.  Nonlinear programming: a historical view , 1982, SMAP.

[20]  Hai Jin,et al.  On efficient bandwidth allocation for traffic variability in datacenters , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[21]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[22]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[23]  Albert G. Greenberg,et al.  Sharing the Data Center Network , 2011, NSDI.

[24]  Bo Li,et al.  iAware: Making Live Migration of Virtual Machines Interference-Aware in the Cloud , 2014, IEEE Transactions on Computers.

[25]  Catherine Rosenberg,et al.  A game theoretic framework for bandwidth allocation and pricing in broadband networks , 2000, TNET.

[26]  Gautam Kumar,et al.  A Case for Performance-Centric Network Allocation , 2012, HotCloud.

[27]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[28]  Frank Kelly,et al.  Fairness and Stability of End-to-End Congestion Control , 2003, Eur. J. Control.

[29]  M. Palaniswami,et al.  Application-Oriented Flow Control: Fundamentals, Algorithms and Fairness , 2006, IEEE/ACM Transactions on Networking.

[30]  Hai Jin,et al.  Building a network highway for big data: architecture and challenges , 2014, IEEE Network.

[31]  Ying Zhang,et al.  Providing bandwidth guarantees, work conservation and low latency simultaneously in the cloud , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[32]  M. Slater Lagrange Multipliers Revisited , 2014 .

[33]  Ying Zhang,et al.  DCloud: Deadline-Aware Resource Allocation for Cloud Computing Jobs , 2016, IEEE Transactions on Parallel and Distributed Systems.

[34]  Ning Ding,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, SIGCOMM.

[35]  Scott Shenker,et al.  Fundamental Design Issues for the Future Internet (Invited Paper) , 1995, IEEE J. Sel. Areas Commun..

[36]  Hai Jin,et al.  Falloc: Fair network bandwidth allocation in IaaS datacenters via a bargaining game approach , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[37]  Bo Li,et al.  Towards performance-centric fairness in datacenter networks , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[38]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[39]  Gautam Kumar,et al.  FairCloud: sharing the network in cloud computing , 2011, CCRV.