Your Data Center Is a Router: The Case for Reconfigurable Optical Circuit Switched Paths

The rising tide of data-intensive, massive scale cluster computing is creating new challenges for traditional, hierarchical data center networks. In response to this challenge, the research community has begun exploring novel interconnect topologies to provide high bisection bandwidth—examples include Fat trees [2, 12, 8], DCell [9], and BCube [10], among a rapidly growing set of alternatives, many adapted from earlier solutions from the telecom and supercomputing areas. We argue that these solutions may provide too much— full bisection bandwidth on packet timescales—at too high a cost—literally tons of wiring and thousands of switches. In this work, we suggest that research should take a look back not only at historical topologies, but also historical technologies. More specifically, we suggest that a hybrid packet-switched/circuit-switched network can provide the functions and ease-of-use of today’s allpacket networks, while providing high bandwidth for a large class of applications at lower cost and lower network complexity. Taking advantage of this network requires, however, a philosophical change to the design of data center networks. We propose to augment the electrical switch architecture with an optical circuit-switched network. Implementing this approach requires a network re-design to provide substantial pre-optical queueing at the nodes, treating the entire data center as one large virtually output-queued router. We explain this argument briefly, and expand upon our proposed solution in the sections that follow.

[1]  E. Schenfeld,et al.  A reconfigurable interconnect fabric with optical circuit switch and software optimizer for stream computing systems , 2009, 2009 Conference on Optical Fiber Communication - incudes post deadline papers.

[2]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[3]  Ming Zhang,et al.  Understanding data center traffic characteristics , 2010, CCRV.

[4]  M. Glick,et al.  Dynamically reconfigurable optical links for high-bandwidth data center networks , 2009, 2009 Conference on Optical Fiber Communication - incudes post deadline papers.

[5]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[6]  Rami G. Melhem,et al.  On the Feasibility of Optical Circuit Switching for High Performance Computing Systems , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[7]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[8]  Leonid Oliker,et al.  Reconfigurable hybrid interconnection for static and dynamic scientific applications , 2007, CF '07.

[9]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[10]  J. Edmonds Paths, Trees, and Flowers , 1965, Canadian Journal of Mathematics.

[11]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[12]  William J. Cook,et al.  Computing Minimum-Weight Perfect Matchings , 1999, INFORMS J. Comput..