Dual-structure Data Center Multicast Using Software Defined Networking

Data center applications use multicast as an effective method to reduce bandwidth cost. However, traditional multicast protocols designed for IP networks are usually bottlenecked by the limited state capacity on switches. In this paper, we propose a scalable multicast solution on fat tree networks based on the observation that data center multicast traffic has strong heterogeneity. We propose to remove the multicast management logic from switches and use the SDN controller to manage multicast groups. The proposed Dual-structure Multicast (DuSM) determines elephant and mice groups according to their traffic amounts and treats them separately. For each elephant group, the controller installs multicast state to maintain multiple shared trees and the group traffic will be balanced evenly among the trees to avoid congestion. For mice groups, the controller applies state-free mutlicast that trades bandwidth capacity for state capacity, such as multicast-to-unicast translation. Our experiments using real multicast traffic data show that the number of groups DuSM supports can be 300% of that of IP multicast. DuSM also achieves traffic balance among links.

[1]  Dino Farinacci,et al.  Generic Routing Encapsulation (GRE) , 2000, RFC.

[2]  Ellen W. Zegura,et al.  Core selection methods for multicast routing , 1995, Proceedings of Fourth International Conference on Computer Communications and Networks - IC3N'95.

[3]  William Allen Simpson,et al.  IP in IP Tunneling , 1995, RFC.

[4]  Jörg Widmer,et al.  Extending equation-based congestion control to multicast applications , 2001, SIGCOMM '01.

[5]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[6]  Pekka Nikander,et al.  LIPSIN: line speed publish/subscribe inter-networking , 2009, SIGCOMM '09.

[7]  Bill Fenner IANA Considerations for IPv4 Internet Group Management Protocol (IGMP) , 2002, RFC.

[8]  Srinivasan Seshan,et al.  A case for end system multicast , 2002, IEEE J. Sel. Areas Commun..

[9]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[10]  ZHANGLi-xia,et al.  A reliable multicast framework for light-weight sessions and application level framing , 1995 .

[11]  Charles Clos,et al.  A study of non-blocking switching networks , 1953 .

[12]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[13]  Mostafa Ammar,et al.  Security issues and solutions in multicast content distribution: a survey , 2003 .

[14]  Bobby Bhattacharjee,et al.  Scalable application layer multicast , 2002, SIGCOMM '02.

[15]  David Thaler,et al.  Protocol Independent Multicast-Sparse Mode (PIM-SM): Protocol Specification , 1997, RFC.

[16]  Dan Li,et al.  ESM: Efficient and Scalable Data Center Multicast Routing , 2012, IEEE/ACM Transactions on Networking.

[17]  Yoav Tock,et al.  Dr. multicast: Rx for data center communication scalability , 2010, EuroSys '10.

[18]  Chen Chen,et al.  Datacast: A Scalable and Efficient Reliable Group Data Delivery Service for Data Centers , 2012, IEEE Journal on Selected Areas in Communications.

[19]  Shinji Kobayashi,et al.  DomainFlow: practical flow management method using multiple flow tables in commodity switches , 2013, CoNEXT.

[20]  Minlan Yu,et al.  Software Defined Traffic Measurement with OpenSketch , 2013, NSDI.

[21]  Liming Wei,et al.  Protocol Independent Multicast Equal-Cost Multipath (ECMP) Redirect , 2012, RFC.

[22]  Xiaozhou Li,et al.  Scaling IP multicast on datacenter topologies , 2013, CoNEXT.