Scheduling techniques for hybrid circuit/packet networks

A range of new datacenter switch designs combine wireless or optical circuit technologies with electrical packet switching to deliver higher performance at lower cost than traditional packet-switched networks. These "hybrid" networks schedule large traffic demands via a high-rate circuits and remaining traffic with a lower-rate, traditional packet-switches. Achieving high utilization requires an efficient scheduling algorithm that can compute proper circuit configurations and balance traffic across the switches. Recent proposals, however, provide no such algorithm and rely on an omniscient oracle to compute optimal switch configurations. Finding the right balance of circuit and packet switch use is difficult: circuits must be reconfigured to serve different demands, incurring non-trivial switching delay, while the packet switch is bandwidth constrained. Adapting existing crossbar scheduling algorithms proves challenging with these constraints. In this paper, we formalize the hybrid switching problem, explore the design space of scheduling algorithms, and provide insight on using such algorithms in practice. We propose a heuristic-based algorithm, Solstice that provides a 2.9× increase in circuit utilization over traditional scheduling algorithms, while being within 14% of optimal, at scale.

[1]  Richard Sinkhorn,et al.  Concerning nonnegative matrices and doubly stochastic matrices , 1967 .

[2]  T. Inukai,et al.  An Efficient SS/TDMA Time Slot Assignment Algorithm , 1979, IEEE Trans. Commun..

[3]  Chak-Kuen Wong,et al.  Minimizing the Number of Switchings in an SS/TDMA System , 1985, IEEE Trans. Commun..

[4]  Peter T. Cummings,et al.  Flowshop sequencing with non-permutation schedules , 1991 .

[5]  Nick McKeown,et al.  The iSLIP scheduling algorithm for input-queued switches , 1999, TNET.

[6]  Jeffrey B. Remmel,et al.  Rook Theory for Perfect Matchings , 2001, Adv. Appl. Math..

[7]  William J. Dally,et al.  Guaranteed scheduling for switches with configuration overhead , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[8]  Paolo Giaccone,et al.  Randomized scheduling algorithms for high-aggregate bandwidth switches , 2003, IEEE J. Sel. Areas Commun..

[9]  Mounir Hamdi,et al.  On scheduling optical packet switches with reconfiguration delay , 2003, IEEE J. Sel. Areas Commun..

[10]  Bin Wu,et al.  NXG05-6: Minimum Delay Scheduling in Scalable Hybrid Electronic/Optical Packet Switches , 2006, IEEE Globecom 2006.

[11]  Kwan Lawrence Yeung,et al.  NXG06-4: Improving Scheduling Efficiency for High-Speed Routers with Optical Switch Fabrics , 2006, IEEE Globecom 2006.

[12]  Madeleine Glick,et al.  Your Data Center Is a Router: The Case for Reconfigurable Optical Circuit Switched Paths , 2009, HotNets.

[13]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[14]  Paramvir Bahl,et al.  Flyways To De-Congest Data Center Networks , 2009, HotNets.

[15]  Konstantina Papagiannaki,et al.  c-Through: part-time optics in data centers , 2010, SIGCOMM '10.

[16]  Amin Vahdat,et al.  Helios: a hybrid electrical/optical switch architecture for modular data centers , 2010, SIGCOMM '10.

[17]  Ashish Goel,et al.  Perfect matchings in o(n log n) time in regular bipartite graphs , 2009, STOC '10.

[18]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[19]  Albert G. Greenberg,et al.  Data center TCP (DCTCP) , 2010, SIGCOMM '10.

[20]  Paramvir Bahl,et al.  Augmenting data center networks with multi-gigabit wireless links , 2011, SIGCOMM.

[21]  Amin Vahdat,et al.  Hunting mice with microsecond circuit switches , 2012, HotNets-XI.

[22]  Ben Y. Zhao,et al.  Mirror mirror on the ceiling: flexible wireless links for data centers , 2012, CCRV.

[23]  Quan-Ke Pan,et al.  A comprehensive review and evaluation of permutation flowshop heuristics to minimize flowtime , 2013, Comput. Oper. Res..

[24]  Geoffrey M. Voelker,et al.  Bullet trains: a study of NIC burst behavior at microsecond timescales , 2013, CoNEXT.

[25]  Amin Vahdat,et al.  Integrating microsecond circuit switching into the data center , 2013, SIGCOMM.

[26]  Xiaohong Jiang,et al.  Cost and delay tradeoff in three-stage switch architecture for data center networks , 2013, 2013 IEEE 14th International Conference on High Performance Switching and Routing (HPSR).

[27]  Ashish Goel,et al.  Perfect Matchings in O(nlog n) Time in Regular Bipartite Graphs , 2013, SIAM J. Comput..

[28]  He Liu,et al.  Circuit Switching Under the Radar with REACToR , 2014, NSDI.

[29]  Ankit Singla,et al.  OSA: An Optical Switching Architecture for Data Center Networks With Unprecedented Flexibility , 2012, IEEE/ACM Transactions on Networking.

[30]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..