Channel Interface: A Primitive Model for Memory Efficient Communication

Though the size of the system is getting larger towards exa-scale computation, the amount of available memory on computing nodes is expected to remain the same or to decrease. Therefore, memory efficiency is becoming an important issue for achieving scalability. This paper pointed out the problem of memory-inefficiency in the de-facto standard parallel programming model, Message Passing Interface (MPI). To solve this problem, the channel interface was introduced in the paper. This interface enables the programmers to appropriately allocate and de-allocate channels so that the program consumes just-enough amount of memory for communication. In addition to that, by limiting the message transfer supported by a channel as simple as possible, the memory consumption and the overhead for handling messages with this interface can be minimal. This paper showed a sample implementation of this interface. Then, the memory efficiency of the implementation is examined by the models of the memory consumption and the performance.

[1]  Tomohiro Inoue,et al.  The Tofu Interconnect , 2011, 2011 IEEE 19th Annual Symposium on High Performance Interconnects.

[2]  Leonie Kohl,et al.  Parallel Programming In C With Mpi And Open Mp , 2016 .

[3]  D. Panda,et al.  Reducing Connection Memory Requirements of MPI for InfiniBand Clusters: A Message Coalescing Approach , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[4]  Dhabaleswar K. Panda,et al.  Adaptive connection management for scalable MPI over InfiniBand , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[5]  Patrick Carribault,et al.  MPC-MPI: An MPI Implementation Reducing the Overall Memory Consumption , 2009, PVM/MPI.

[6]  Jesper Larsson Träff,et al.  MPI on a Million Processors , 2009, PVM/MPI.

[7]  Kazushige Saga,et al.  The Design of Advanced Communication to Reduce Memory Usage for Exa-scale Systems , 2016, VECPAR.