Topology Configuration in Hybrid EPS/OCS Interconnects

We consider a hybrid Electronic Packet Switched (EPS) and Optical Circuit Switched (OCS) interconnection network (IN) for future HPC and DC systems. Given the point-to-point communication graph of an application, we present a heuristic algorithm that partitions logical parallel tasks to compute resources and configures the (re-configurable) optical part of the hybrid IN to efficiently serve point-to-point communication. We measure the performance of a hybrid IN employing the proposed algorithm using real workloads, as well as extrapolated traffic, and compare it against application mapping on conventional fixed, electronic-only INs based on toroidal topologies.

[1]  Amin Vahdat,et al.  Helios: a hybrid electrical/optical switch architecture for modular data centers , 2010, SIGCOMM '10.

[2]  Samuel Williams,et al.  The Landscape of Parallel Computing Research: A View from Berkeley , 2006 .

[3]  Jiazheng Zhou,et al.  Hierarchical Mapping for HPC Applications , 2011, IPDPS Workshops.

[4]  Konstantina Papagiannaki,et al.  c-Through: part-time optics in data centers , 2010, SIGCOMM 2010.

[5]  Shahid H. Bokhari,et al.  On the Mapping Problem , 1981, IEEE Transactions on Computers.

[6]  Ann Q. Gates,et al.  TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS , 2005 .

[7]  Laxmikant V. Kalé,et al.  Automated mapping of regular communication graphs on mesh interconnects , 2010, 2010 International Conference on High Performance Computing.

[8]  M. Eleftheriou,et al.  Blue Matter: Approaching the Limits of Concurrency for Classical Molecular Dynamics , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[9]  Rami G. Melhem,et al.  On the Feasibility of Optical Circuit Switching for High Performance Computing Systems , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[10]  Philip Heidelberger,et al.  Optimizing task layout on the Blue Gene/L supercomputer , 2005, IBM J. Res. Dev..

[11]  Vincenzo Liberatore.  Circular Arrangements , 2002, ICALP.

[12]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[13]  Karl S. Hemmert,et al.  Challenges for High-Performance Networking for Exascale Computing , 2010, 2010 Proceedings of 19th International Conference on Computer Communications and Networks.

[14]  Toshiyuki Shimizu,et al.  Tofu: A 6D Mesh/Torus Interconnect for Exascale Computers , 2009, Computer.

[15]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[16]  Laxmikant V. Kalé,et al.  Heuristic-Based Techniques for Mapping Irregular Communication Graphs to Mesh Topologies , 2011, 2011 IEEE International Conference on High Performance Computing and Communications.

[17]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Robin Milner,et al.  On Observing Nondeterminism and Concurrency , 1980, ICALP.

[19]  E. Schenfeld,et al.  A reconfigurable interconnect fabric with optical circuit switch and software optimizer for stream computing systems , 2009, 2009 Conference on Optical Fiber Communication - incudes post deadline papers.

[20]  Leonid Oliker,et al.  Communication Requirements and Interconnect Optimization for High-End Scientific Applications , 2007, IEEE Transactions on Parallel and Distributed Systems.