TINA: A Fair Inter-datacenter Transmission Mechanism with Deadline Guarantee

Geographically distributed cloud is a promising technique to achieve high performance for service providers. For inter-datacenter transfers, deadline guarantee and fairness are the two most important requirements. On the one hand, to ensure more transfers finish before their deadlines, preemptive scheduling policies are widely used, leading to the transfer starvation problem and is hence unfair. On the other hand, to ensure fairness, inter-datacenter bandwidth is fairly shared among transfers with per-flow bandwidth allocation, which leads to deadline missing problem. A mechanism that achieves these two seemingly conflicting objectives simultaneously is still missing. In this paper, we propose TINA to schedule network transfers fairly while providing deadline guarantees. TINA allows each transfer to compete freely with each other for bandwidth. More specifically, each transfer is assigned a probability to indicate whether to transmit or not. We formulate the competition among the transfers as an El Farol game while keeping the traffic load under a threshold to avoid congestion. We then prove that the Nash Equilibrium is the optimal strategy and propose a light-weight algorithm to derive it. Finally, both simulations and testbed experiments results show that TINA achieves superior performance than state-of-art methods in terms of fairness and deadline guarantee rate.

[1]  Srikanth Kandula,et al.  Calendaring for wide area networks , 2015, SIGCOMM 2015.

[2]  Xiaojiang Du,et al.  Online Deadline-Aware Bulk Transfer Over Inter-Datacenter WANs , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[3]  Xiaobo Zhou,et al.  TrafficShaper: Shaping Inter-Datacenter Traffic to Reduce the Transmission Cost , 2018, IEEE/ACM Transactions on Networking.

[4]  Rajarathnam Chandramouli,et al.  Reciprocity, fairness and learning in medium access control games , 2014, Comput. Commun..

[5]  Srikanth Kandula,et al.  Achieving high utilization with software-driven WAN , 2013, SIGCOMM.

[6]  Xiaoyuan Yang,et al.  Inter-datacenter bulk transfers with netstitcher , 2011 .

[7]  Donald F. Towsley,et al.  MON: Mission-optimized overlay networks , 2017, INFOCOM.

[8]  Amin Vahdat,et al.  Carousel: Scalable Traffic Shaping at End Hosts , 2017, SIGCOMM.

[9]  Gautam Kumar,et al.  FairCloud: sharing the network in cloud computing , 2011, CCRV.

[10]  D. Whitehead,et al.  The El Farol Bar Problem Revisited: Reinforcement Learning in a Potential Game , 2008 .

[11]  Kai Chen,et al.  Scheduling Mix-flows in Commodity Datacenters with Karuna , 2016, SIGCOMM.

[12]  Srikanth Kandula,et al.  QuickCast: Fast and Efficient Inter-Datacenter Transfers Using Forwarding Tree Cohorts , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[13]  Cauligi S. Raghavendra,et al.  DCRoute: Speeding up Inter-Datacenter Traffic Allocation while Guaranteeing Deadlines , 2016, HiPC.

[14]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[15]  Xi Fang,et al.  A Game-Theoretic Approach to Stable Routing in Max-Min Fair Networks , 2013, IEEE/ACM Transactions on Networking.

[16]  M. Rabin Published by: American , 2022 .

[17]  Farnam Jahanian,et al.  Internet inter-domain traffic , 2010, SIGCOMM '10.

[18]  Haim Kaplan,et al.  Upward Max Min Fairness , 2012, INFOCOM.

[19]  Amin Vahdat,et al.  BwE: Flexible, Hierarchical Bandwidth Allocation for WAN Distributed Computing , 2015, Comput. Commun. Rev..

[20]  Jian Guo,et al.  Pricing Intra-Datacenter Networks with Over-Committed Bandwidth Guarantee , 2017, USENIX ATC.

[21]  W. Arthur Inductive Reasoning and Bounded Rationality , 1994 .

[22]  Zhenhua Liu,et al.  HUG: Multi-Resource Fairness for Correlated and Elastic Demands , 2016, NSDI.