Accelerating cast traffic delivery in data centers leveraging physical layer optics and SDN

The rising popularity of cloud computing and big data applications has led to massive volumes of rack-to-rack traffic featuring diverse communication patterns denoted as *-cast that combines unicast, multicast, incast and all-to-all cast. Effective support of these traffic patterns in data center networks is still an open problem. We propose a hybrid (optical and electrical) approach that leverages physical layer optics to accelerate traffic delivery for each pattern. Our design consists of an application-driven control plane compatible with software defined networking (SDN) to dynamically configure the optics. We present the network architecture and control plane design and results on the multicast case.

[1]  Sambit Sahu,et al.  Rethinking the physical layer of data center networks of the next decade: using optics to enable efficient *-cast connectivity , 2013, CCRV.

[2]  Amin Vahdat,et al.  Helios: a hybrid electrical/optical switch architecture for modular data centers , 2010, SIGCOMM '10.

[3]  Anees Shaikh,et al.  Programming your network at run-time for big data applications , 2012, HotSDN '12.

[4]  Erich Schikuta,et al.  Parallel Database Join Operations in Heterogeneous Grids , 2007, Eighth International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT 2007).

[5]  Gustavo Alonso,et al.  Database replication techniques: a three parameter classification , 2000, Proceedings 19th IEEE Symposium on Reliable Distributed Systems SRDS-2000.

[6]  Chuanxiong Guo,et al.  Datacast: A Scalable and Efficient Group Data Delivery Service for Data Centers , 2011 .

[7]  Konstantina Papagiannaki,et al.  c-Through: part-time optics in data centers , 2010, SIGCOMM '10.

[8]  Esther M. Arkin,et al.  On Local Search for Weighted k-Set Packing , 1997, Math. Oper. Res..

[9]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[10]  Amin Vahdat,et al.  Switching the optical divide: fundamental challenges for hybrid electrical/optical datacenter networks , 2011, SoCC.

[11]  Ion Stoica,et al.  Coflow: a networking abstraction for cluster applications , 2012, HotNets-XI.

[12]  Michael I. Jordan,et al.  Managing data transfers in computer clusters with orchestra , 2011, SIGCOMM.

[13]  Amin Vahdat,et al.  Integrating microsecond circuit switching into the data center , 2013, SIGCOMM.

[14]  Dawn Xiaodong Song,et al.  Design and Evaluation of a Real-Time URL Spam Filtering Service , 2011, 2011 IEEE Symposium on Security and Privacy.