Hierarchical Multi-resource Fair Queueing for Network Function Virtualization

As the volume of traffic flows surges, providing Quality-of-Service (QoS) guarantees to flows by fair queueing has never been more challenging in Network Function Virtualization (NFV). There has been a recent effort in both industry and academia to develop fair queueing algorithms across multiple resources in NFV. However, all existing works fail to support hierarchical scheduling, a crucial feature that also provides QoS guarantees to grouped flows on tenant boundaries. In this paper, we present two new multi-resource fair queueing algorithms that support hierarchies, collapsed Hierarchical Dominant Resource Fair Queueing (collapsed H-DRFQ) and dove-tailing H-DRFQ, both of which provide hierarchical share guarantees. Through formal analysis, we find that the dove-tailing H-DRFQ outper-forms collapsed H-DRFQ by providing a smaller delay bound. However, according to the simulation results, both algorithms have their pros and cons. Dove-tailing H-DRFQ benefits to the flows with more complex hierarchies, while collapsed H-DRFQ is better for the flows with simpler attribution structures. Meanwhile, our simulation shows that both H-DRFQ algorithms can achieve near-perfect fairness.

[1]  Hui Zhang,et al.  Hierarchical packet fair queueing algorithms , 1996, SIGCOMM 1996.

[2]  Vyas Sekar,et al.  The middlebox manifesto: enabling innovation in middlebox deployment , 2011, HotNets-X.

[3]  George Varghese,et al.  Efficient fair queueing using deficit round-robin , 1996, TNET.

[4]  Shunsuke Homma,et al.  Service Function Chaining Use Cases In Data Centers , 2017 .

[5]  Baochun Li,et al.  Multi-Resource Round Robin: A low complexity packet scheduler with Dominant Resource Fairness , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[6]  Baochun Li,et al.  Multi-resource generalized processor sharing for packet processing , 2013, 2013 IEEE/ACM 21st International Symposium on Quality of Service (IWQoS).

[7]  Mark Handley,et al.  Is it still possible to extend TCP? , 2011, IMC '11.

[8]  Zhenhua Liu,et al.  HUG: Multi-Resource Fairness for Correlated and Elastic Demands , 2016, NSDI.

[9]  Vyas Sekar,et al.  Making middleboxes someone else's problem: network processing as a cloud service , 2012, SIGCOMM '12.

[10]  Prashant J. Shenoy,et al.  Hierarchical Scheduling for Symmetric Multiprocessors , 2008, IEEE Transactions on Parallel and Distributed Systems.

[11]  Joan Serrat,et al.  Management and orchestration challenges in network functions virtualization , 2016, IEEE Communications Magazine.

[12]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[13]  Ion Stoica,et al.  A hierarchical fair service curve algorithm for link-sharing, real-time, and priority services , 2000, TNET.

[14]  Harrick M. Vin,et al.  A hierarchial CPU scheduler for multimedia operating systems , 1996, OSDI '96.

[15]  Paul Quinn,et al.  Service Function Chaining Problem Statement , 2013 .

[16]  K. K. Ramakrishnan,et al.  Microboxes: high performance NFV with customizable, asynchronous TCP stacks and dynamic subscriptions , 2018, SIGCOMM.

[17]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[18]  Bo Li,et al.  Cluster fair queueing: Speeding up data-parallel jobs with delay guarantees , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[19]  Harrick M. Vin,et al.  A hierarchial CPU scheduler for multimedia operating systems , 1996, OSDI '96.

[20]  Harrick M. Vin,et al.  Start-time fair queueing: a scheduling algorithm for integrated services packet switching networks , 1996, SIGCOMM 1996.

[21]  Scott Shenker,et al.  Analysis and simulation of a fair queueing algorithm , 1989, SIGCOMM 1989.

[22]  Baochun Li,et al.  Low complexity multi-resource fair queueing with bounded delay , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[23]  Abhay Parekh,et al.  A generalized processor sharing approach to flow control in integrated services networks: the single-node case , 1993, TNET.

[24]  Xin Li,et al.  Low-complexity multi-resource packet scheduling for network function virtualization , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[25]  Vyas Sekar,et al.  Multi-resource fair queueing for packet processing , 2012, CCRV.