Fast and Efficient Bulk Multicasting over Dedicated Inter-Datacenter Networks

Several organizations have built multiple datacenters connected via dedicated wide area networks over which large inter-datacenter transfers take place. This includes tremendous volumes of bulk multicast traffic generated as a result of data and content replication. Although one can perform these transfers using a single multicast forwarding tree, that can lead to poor performance as the slowest receiver on each tree dictates the completion time for all receivers. Using multiple trees per transfer each connected to a subset of receivers alleviates this concern. The choice of multicast trees also determines the total bandwidth usage. To further improve the performance, bandwidth over dedicated inter-datacenter networks can be carved for different multicast trees over specific time periods to avoid congestion and minimize the average receiver completion times. In this paper, we break this problem into the three sub-problems of partitioning, tree selection, and rate allocation. We present an algorithm called QuickCast which is computationally fast and allows us to significantly speed up multiple receivers per bulk multicast transfer with control over extra bandwidth consumption. We evaluate QuickCast against a variety of synthetic and real traffic patterns as well as real WAN topologies. Compared to performing bulk multicast transfers as separate unicast transfers, QuickCast achieves up to $3.64\times$ reduction in mean completion times while at the same time using $0.71\times$ the bandwidth. Also, QuickCast allows the top $50\%$ of receivers to complete between $3\times$ to $35\times$ faster on average compared with when a single forwarding multicast tree is used for data delivery.

[1]  Vijay Mann,et al.  Avalanche: Data center Multicast using software defined networking , 2014, 2014 Sixth International Conference on Communication Systems and Networks (COMSNETS).

[2]  Ashutosh Sabharwal,et al.  An Axiomatic Theory of Fairness in Network Resource Allocation , 2009, 2010 Proceedings IEEE INFOCOM.

[3]  Rob Sherwood,et al.  Slurpie: a cooperative bulk data transfer protocol , 2004, IEEE INFOCOM 2004.

[4]  Baochun Li,et al.  Deadline-Aware Scheduling and Routing for Inter-Datacenter Multicast Transfers , 2018, 2018 IEEE International Conference on Cloud Engineering (IC2E).

[5]  Bharat K. Bhargava,et al.  PROMISE: peer-to-peer media streaming using CollectCast , 2003, MULTIMEDIA '03.

[6]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[7]  Christos Gkantsidis,et al.  Comprehensive view of a live network coding P2P system , 2006, IMC '06.

[8]  Jon Crowcroft,et al.  TCP-XM: unicast-enabled reliable multicast , 2005, Proceedings. 14th International Conference on Computer Communications and Networks, 2005. ICCCN 2005..

[9]  Srikanth Kandula,et al.  Calendaring for wide area networks , 2015, SIGCOMM 2015.

[10]  Cauligi S. Raghavendra,et al.  DDCCast: Meeting Point to Multipoint Transfer Deadlines Across Datacenters using ALAP Scheduling Policy , 2017, ArXiv.

[11]  Miguel Castro,et al.  SplitStream: high-bandwidth multicast in cooperative environments , 2003, SOSP '03.

[12]  Srikanth Kandula,et al.  QuickCast: Fast and Efficient Inter-Datacenter Transfers Using Forwarding Tree Cohorts , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[13]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM '02.

[14]  David Meyer,et al.  IANA Guidelines for IPv4 Multicast Address Assignments , 2001, RFC.

[15]  Johan A. Pouwelse,et al.  The Bittorrent P2P File-Sharing System: Measurements and Analysis , 2005, IPTPS.

[16]  Srikanth Kandula,et al.  DCCast: Efficient Point to Multipoint Transfers Across Datacenters , 2017, HotCloud.

[17]  Ramana Rao Kompella,et al.  Hierarchy-aware distributed overlays in data centers using DC2 , 2012, 2012 Fourth International Conference on Communication Systems and Networks (COMSNETS 2012).

[18]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[19]  Ilias Giechaskiel,et al.  Delay Tolerant Bulk Data Transfers on the Internet , 2014 .

[20]  Ke Xu,et al.  BDS: a centralized near-optimal overlay network for inter-datacenter data replication , 2018, EuroSys.

[21]  Hanji Shen,et al.  An OpenFlow-Based Dynamic Path Adjustment Algorithm for Multicast Spanning Trees , 2013, 2013 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications.

[22]  Mark Handley,et al.  NACK-Oriented Reliable Multicast (NORM) Transport Protocol , 2009, RFC.

[23]  Chen Chen,et al.  Datacast: A Scalable and Efficient Reliable Group Data Delivery Service for Data Centers , 2012, IEEE Journal on Selected Areas in Communications.

[24]  Dan Li,et al.  RDCM: Reliable data center multicast , 2011, 2011 Proceedings IEEE INFOCOM.

[25]  Hong-Fang Yu,et al.  Deadline-Guaranteed Point-to-Multipoint Bulk Transfers in Inter-Datacenter Networks , 2018, 2018 IEEE International Conference on Communications (ICC).

[26]  Ming Zhang,et al.  Guaranteeing deadlines for inter-datacenter transfers , 2015, EuroSys.

[27]  Alex X. Liu,et al.  Multiple bulk data transfers scheduling among datacenters , 2014, Comput. Networks.

[28]  Murali S. Kodialam,et al.  Online multicast routing with bandwidth guarantees: a new approach using multicast network flow , 2003, TNET.

[29]  Masato Tsuru,et al.  One-to-Many File Transfers Using Multipath-Multicast with Coding at Source , 2016, 2016 IEEE 18th International Conference on High Performance Computing and Communications; IEEE 14th International Conference on Smart City; IEEE 2nd International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[30]  Dimitri Watel,et al.  A practical greedy approximation for the directed Steiner tree problem , 2014, J. Comb. Optim..

[31]  Enhong Chen,et al.  One more queue is enough: Minimizing flow completion time with explicit priority notification , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[32]  Masato Tsuru,et al.  Delivering a File by Multipath-Multicast on OpenFlow Networks , 2013, 2013 5th International Conference on Intelligent Networking and Collaborative Systems.

[33]  Srikanth Kandula,et al.  Achieving high utilization with software-driven WAN , 2013, SIGCOMM.

[34]  Peng Xu,et al.  Efficient algorithms for scheduling multiple bulk data transfers in inter‐datacenter networks , 2014, Int. J. Commun. Syst..

[35]  Stephen J. Garland,et al.  Active reliable multicast , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[36]  Michael Luby,et al.  A digital fountain approach to reliable distribution of bulk data , 1998, SIGCOMM '98.

[37]  Amin Vahdat,et al.  Scalability in adaptive multi-metric overlays , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[38]  David R. Cheriton,et al.  TCP-SMO: extending TCP to support medium-scale multicast applications , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[39]  Li Chen,et al.  PIAS: Practical Information-Agnostic Flow Scheduling for Data Center Networks , 2014, HotNets.

[40]  Luigi Rizzo,et al.  pgmcc: a TCP-friendly single-rate multicast congestion control scheme , 2000, SIGCOMM.

[41]  Ashutosh Sabharwal,et al.  An Axiomatic Theory of Fairness , 2009, ArXiv.

[42]  Fang Wang,et al.  MCTCP: Congestion-aware and robust multicast TCP in Software-Defined networks , 2016, 2016 IEEE/ACM 24th International Symposium on Quality of Service (IWQoS).

[43]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[44]  De-Nian Yang,et al.  Multicast traffic engineering for software-defined networks , 2015, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[45]  Michael Sirivianos,et al.  Inter-datacenter bulk transfers with netstitcher , 2011, SIGCOMM.

[46]  IJsbrand Wijnands,et al.  Multicast Using Bit Index Explicit Replication (BIER) , 2017, RFC.

[47]  César A. C. Teixeira,et al.  CastFlow: Clean-slate multicast approach using in-advance path processing in programmable networks , 2012, 2012 IEEE Symposium on Computers and Communications (ISCC).

[48]  Nick McKeown,et al.  pFabric: minimal near-optimal datacenter transport , 2013, SIGCOMM.

[49]  De-Nian Yang,et al.  Reliable multicast routing for software-defined networks , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[50]  Wei Xu,et al.  Optimizing Bulk Transfers with Software-Defined Optical WAN , 2016, SIGCOMM.

[51]  Robert Karl,et al.  Holistic configuration management at Facebook , 2015, SOSP.