Optical load-balancing tradeoffs in wavelength-routing cloud data centers

Wavelength routing based on arrayed waveguide grating (AWG) devices has been proposed as a disruptive technology for capacity, footprint, and flexibility requirements of cloud data centers. The limited buffering capacity of AWG-based routers, however, affects network throughput and makes them highly susceptible to data center traffic imbalance. A load-balancing stage, capable of evenly distributing the incoming traffic in both space and time, can improve network robustness and remedy congestion penalties. Robustness and scalability due to load balancing come at the cost of physical-layer complexities in terms of added cost, power consumption, and impairments. In this paper, we conduct a novel scalable analysis to study load-balancing tradeoffs between network-layer gains and physical-layer penalties in a multistage routing scenario. Our cross-layer simulations examine the requirements of a wavelength-routing load balancer based on AWG and tunable wavelength converters (TWCs) in order to achieve performance interesting for a data center. Our results point to the critical contribution of Q-factor degradation to load-balancer performance and encourage efforts in the design of novel router architectures, aiming to consolidate routing with scheduling-based load balancing.

[1]  Hong Liu,et al.  Fiber optic communication technologies: What's needed for datacenter network operations , 2010, IEEE Communications Magazine.

[2]  Qimin Yang,et al.  Performances of the Data Vortex switch architecture under nonuniform and bursty traffic , 2002 .

[3]  Kang Xi,et al.  Bufferless optical Clos switches for data centers , 2011, 2011 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference.

[4]  Ivan Andonovic,et al.  Packet loss and delay performance of feedback and feed-forward arrayed-waveguide gratings-based optical packet switches with WDM inputs-outputs , 2001 .

[5]  Nick McKeown,et al.  Optical Packet Buffers for Backbone Internet Routers , 2010, IEEE/ACM Transactions on Networking.

[6]  Ming Zhang,et al.  Understanding data center traffic characteristics , 2010, CCRV.

[7]  Eiji Oki,et al.  Concurrent round-robin-based dispatching schemes for Clos-network switches , 2002, TNET.

[8]  R. Gaudino,et al.  Can Simple Optical Switching Fabrics Scale to Terabit per Second Switch Capacities? , 2009, IEEE/OSA Journal of Optical Communications and Networking.

[9]  Hiroshi Hasegawa,et al.  Low loss and cost-effective hierarchical optical path cross-connect switch architecture based on WSS/WBSS , 2009, 2009 International Conference on Photonics in Switching.

[10]  Hiroshi Hasegawa,et al.  A large-scale wavelength routing optical switch for data center networks , 2013, IEEE Communications Magazine.

[11]  Rui Zhang,et al.  Routers with a single stage of buffering , 2002, SIGCOMM '02.

[12]  Hong Liu,et al.  What devices do data centers need? , 2014, OFC 2014.

[13]  S. J. B. Yoo,et al.  LIONS: An AWGR-Based Low-Latency Optical Switch for High-Performance Computing and Data Centers , 2013, IEEE Journal of Selected Topics in Quantum Electronics.

[14]  M. O'Sullivan,et al.  Performance of Dual-Polarization QPSK for Optical Transport Systems , 2009, Journal of Lightwave Technology.

[15]  Mark J. Karol,et al.  Queueing in high-performance packet switching , 1988, IEEE J. Sel. Areas Commun..

[16]  Hong Liu,et al.  Scaling Optical Interconnects in Datacenter Networks Opportunities and Challenges for WDM , 2010, 2010 18th IEEE Symposium on High Performance Interconnects.

[17]  K. A. Williams,et al.  8×8 space and wavelength selective cross-connect for simultaneous dynamic multi-wavelength routing , 2013, 2013 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference (OFC/NFOEC).

[18]  Ioannis Tomkos,et al.  Optical interconnection networks in data centers: recent trends and future challenges , 2013, IEEE Communications Magazine.

[19]  Hyundai Park,et al.  Integrated Photonics for Low-Power Packet Networking , 2011, IEEE Journal of Selected Topics in Quantum Electronics.

[20]  M. Zukerman,et al.  Bandwidth and Buffer Tradeoffs in Optical Packet Switching , 2006, Journal of Lightwave Technology.

[21]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[22]  F. Pommereau,et al.  Quantum-dash mode-locked lasers for tunable wavelength conversion on a 100 GHz frequency grid , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[23]  Sophie LaRochelle,et al.  High efficiency wavelength conversion of 40 Gbit/s OOK and DPSK with good stability , 2013, 2013 18th OptoElectronics and Communications Conference held jointly with 2013 International Conference on Photonics in Switching (OECC/PS).

[24]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[25]  Roberto Proietti,et al.  AWGR-based all-to-all optical interconnects using limited number of wavelengths , 2013, 2013 Optical Interconnects Conference.

[26]  L. Coldren,et al.  An 8$\,\times\,$ 8 InP Monolithic Tunable Optical Router (MOTOR) Packet Forwarding Chip , 2010, Journal of Lightwave Technology.

[27]  Nick McKeown,et al.  Scaling internet routers using optics , 2003, SIGCOMM '03.

[28]  A. Leon-Garcia,et al.  Analysis of large-scale multi-stage all-optical packet switching routers , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[29]  A. Bononi,et al.  Large power swings in doped-fiber amplifiers with highly variable data , 1999, IEEE Photonics Technology Letters.

[30]  Sophie LaRochelle,et al.  The practical limit to impairment-aware scheduling in all-optical routers , 2013, 2013 IEEE Photonics Conference.

[31]  T. Shibata,et al.  $N \times N$ Cyclic-Frequency Router With Improved Performance Based on Arrayed-Waveguide Grating , 2009, Journal of Lightwave Technology.

[32]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[33]  Ivan Andonovic,et al.  Buffering in optical packet switches , 1998 .

[34]  Leslie A. Rusch,et al.  Load balancing in wavelength-routing cloud data centers , 2013, 2013 IEEE 14th International Conference on High Performance Switching and Routing (HPSR).

[35]  Chris Cole,et al.  Beyond 100G client optics , 2012, IEEE Communications Magazine.

[36]  Cheng-Shang Chang,et al.  Load balanced Birkhoff-von Neumann switches, part I: one-stage buffering , 2002, Computer Communications.

[37]  Cheng-Shang Chang,et al.  Load balanced Birkhoff-von Neumann switches, part II: multi-stage buffering , 2002, Comput. Commun..

[38]  A. Leon-Garcia,et al.  Cross-Layer Performance Analysis of Recirculation Buffers for Optical Data Centers , 2013, Journal of Lightwave Technology.

[39]  David T. Neilson,et al.  Load-balanced optical packet router based on 40 Gb/s wavelength converters and time buffers , 2005 .

[40]  Wenjia Zhang,et al.  Next-Generation Optically-Interconnected High-Performance Data Centers , 2012, Journal of Lightwave Technology.

[41]  Larry A. Coldren,et al.  An 8 8 InP Monolithic Tunable Optical Router ( MOTOR ) Packet Forwarding Chip , 2010 .

[42]  L. L. Buhl,et al.  A Load-Balanced Optical Packet Router Interconnected With a 10-GbEthernet Electronic Router , 2011, IEEE Photonics Technology Letters.

[43]  J. Kleban,et al.  The Modified MSM Clos Switching Fabric with Efficient Packet Dispatching Scheme , 2007, 2007 Workshop on High Performance Switching and Routing.