Implementation and Optimization of MPICH2 Multicast on Optical Fiber Network

Due to its high performance, optical fiber is more and more popular in the field of high performance computing. In this field, Message-Passing Interface (MPI) has been the most popular standard for parallel applications. MPICH2 is the most famous implementation of MPI. Optical fiber is a circuit-switched network, which needs to reserve an independent path before communication. Although the huge bandwidth of optical network can make up for this drawback, its influences on collective communication with high path building cost. In this paper, we present our experience in implementing MPICH2 over optical fiber with an agent supporting the control plane in optical fiber network; meanwhile wepsilave optimized the broadcast communication according to characteristics of the Optical network.

[1]  Wu-chun Feng,et al.  An Analysis of 10-Gigabit Ethernet Protocol Stacks in Multicore Environments , 2007, 15th Annual IEEE Symposium on High-Performance Interconnects (HOTI 2007).

[2]  D. Panda,et al.  Efficient Barrier and Allreduce on IBA clusters using hardware multicast and adaptive algorithms , 2004 .

[3]  Jack Dongarra,et al.  MPI: The Complete Reference , 1996 .

[4]  Andrzej Jajszczyk,et al.  Control Plane for Optical Networks: The ASON Approach , 2004 .

[5]  Dhabaleswar K. Panda,et al.  High Performance RDMA-Based MPI Implementation over InfiniBand , 2003, ICS '03.

[6]  Michael J. Brim,et al.  Efficient MPI Broadcast Communication and File Distribution for Local-Area Clusters , 2022 .

[7]  A. Jajszczyk.  The ASON approach to the control plane for optical networks , 2004, Proceedings of 2004 6th International Conference on Transparent Optical Networks (IEEE Cat. No.04EX804).

[8]  ZHANGLi-xia,et al.  A reliable multicast framework for light-weight sessions and application level framing , 1995 .

[9]  Christian Dipl.-Inf. Siebert,et al.  Efficient Broadcast for Multicast-Capable Interconnection Networks , 2006 .

[10]  Minglu Li,et al.  Design and Implementation of MPICH2 over Optical Fiber , 2007, Future Generation Communication and Networking (FGCN 2007).

[11]  Amith R. Mamidala,et al.  Efficient Barrier and Allreduce on Infiniband clusters using multicast and adaptive algorithms , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[12]  Seisho Yasukawa,et al.  Signaling Requirements for Point-to-Multipoint Traffic-Engineered MPLS Label Switched Paths (LSPs) , 2006, RFC.

[13]  William Gropp,et al.  Mpi---the complete reference: volume 1 , 1998 .

[14]  Sun Wei-qiang.  Implementation of RSVP-TE based multicast signaling protocol in ASON , 2007 .