On the Design and Semantics of User-Space Communication Subsystems

The problem with Gbit/s networks is to get the hardware performance into the applications. The most promising technique is a zero-copy protocol combined with a user-space communication subsystem that (a) gives the application direct access to the network interface and (b) avoids all buuer-ing/copying. In this paper we examine the design space of user-space communication subsystems, especially how send and receive operations work and which communication semantics they imply. Furthermore , we propose a technique called page-exchange which avoids copy operations, is well deened, and has communication semantics equivalent to those of standard programming interfaces such as UNIX sockets, PVM, or MPI.

[1]  Henri E. Bal,et al.  User-Level Network Interface Protocols , 1998, Computer.

[2]  Seth Copen Goldstein,et al.  Active Messages: A Mechanism for Integrated Communication and Computation , 1992, [1992] Proceedings the 19th Annual International Symposium on Computer Architecture.

[3]  VMMC-2 : E cient Support forReliable , Connection-Oriented , 1997 .

[4]  Anoop Gupta,et al.  Comparative evaluation of latency reducing and tolerating techniques , 1991, ISCA '91.

[5]  James V. Lawton,et al.  Building a High-performance Message-passing System for MEMORY CHANNEL Clusters , 1996, Digit. Tech. J..

[6]  Henri E. Bal,et al.  LFC: A Communication Substrate for Myrinet , 1998 .

[7]  Thomas M. Warschko,et al.  Design and Evaluation of ParaStation 2 , 1998, Wide Area Networks and High Performance Computing.

[8]  Hiroshi Tezuka,et al.  Pin-down cache: a virtual memory management technique for zero-copy communication , 1998, Proceedings of the First Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing.

[9]  Angelos Bilas,et al.  User-Space Communication: A Quantitative Study , 1998, Proceedings of the IEEE/ACM SC98 Conference.

[10]  Charles L. Seitz,et al.  Myrinet: A Gigabit-per-Second Local Area Network , 1995, IEEE Micro.

[11]  David E. Culler,et al.  Virtual network transport protocols for Myrinet , 1998, IEEE Micro.

[12]  Scott Pakin,et al.  High Performance Messaging on Workstations: Illinois Fast Messages (FM) for Myrinet , 1995, Proceedings of the IEEE/ACM SC95 Conference.

[13]  Kai Li,et al.  Design and implementation of virtual memory-mapped communication on Myrinet , 1997, Proceedings 11th International Parallel Processing Symposium.

[14]  Bernard Tourancheau,et al.  Protocol design for high performance networking: a Myrinet experience , 1997 .