A Survey of Messaging Software Issues and Systems for Myrinet-Based

Several messaging software architectures (MSAs) have been proposed that entirely remove the operating system from the critical communication path, providing direct user-level access to the network interface and avoiding excessive data copying. In this paper we discuss the most important design issues and tradeoffs related to the functionality and performance of MSAs: the communication model, DMA versus programmed I/O transfers, data copying and protection, message pipelining, message arrival notification, and reliability. In order to illustrate how these issues and tradeoffs are tackled in modern systems, we survey a large number of recently proposed MSAs for the Myrinet interconnection network, including AM, FM, U-Net, VMMC, BIP, PM, and Trapeze.

[1]  Bernard Tourancheau,et al.  BIP: A New Protocol Designed for High Performance Networking on Myrinet , 1998, IPPS/SPDP Workshops.

[2]  Jeffrey S. Chase,et al.  Cut-through delivery in Trapeze: An exercise in low-latency messaging , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[3]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[4]  Hiroshi Tezuka.  PM : A High-Performance Communication Library for Multi-user Parallel Environments , 1996 .

[5]  Cezary Dubnicki,et al.  VMMC-2 : Efficient Support for Reliable, Connection-Oriented Communication , 1997 .

[6]  David E. Culler,et al.  Virtual network transport protocols for Myrinet , 1998, IEEE Micro.

[7]  Charles L. Seitz,et al.  Myrinet: A Gigabit-per-Second Local Area Network , 1995, IEEE Micro.

[8]  A. Chien,et al.  High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[9]  Thorsten von Eicken,et al.  U-Net: a user-level network interface for parallel and distributed computing , 1995, SOSP.

[10]  Seth Copen Goldstein,et al.  Active messages: a mechanism for integrating communication and computation , 1998, ISCA '98.

[11]  Hiroshi Tezuka,et al.  Pin-down cache: a virtual memory management technique for zero-copy communication , 1998, Proceedings of the First Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing.

[12]  Scott Pakin,et al.  Efficient layering for high speed communication: Fast Messages 2.x , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[13]  Kai Li,et al.  Design and implementation of virtual memory-mapped communication on Myrinet , 1997, Proceedings 11th International Parallel Processing Symposium.

[14]  David E. Culler,et al.  U-Net/SLE: A Java-based user-customizable virtual network interface , 1999, Sci. Program..