An Overlap Study for Cluster Computing

Distributed memory systems (DMS) (clusters) are one of the tools being used by researchers to solve a wide spectrum of computational intensive problems in a fraction of the time of a sequential approach. The nature of a DMS does not enforce intense data sharing among computational nodes, this will occur if the problem under analysis happens to be data dependent in nature. The latency associated with dynamic data sharing in a DMS is well known to increase the total execution time. One of the possible techniques that can be used to reduce the negative effects associated with this latency is overlapping. In this paper we show why a characterization of the overlapping capabilities of a cluster is important to justify results.

[1]  Torsten Hoefler,et al.  Implementation and performance analysis of non-blocking collective operations for MPI , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[2]  Torsten Hoefler,et al.  Non-Blocking Collective Operations for MPI-2 , 2006 .

[3]  Bettina Schnor,et al.  Design issues in the implementation of MPI2 one sided communication in ethernet based networks , 2007, Parallel and Distributed Computing and Networks.

[4]  D. Martin Swany,et al.  Transformations to Parallel Codes for Communication-Computation Overlap , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[5]  Katherine A. Yelick,et al.  Optimizing bandwidth limited problems using one-sided communication and overlap , 2005, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[6]  Robert B. Ross,et al.  Using MPI-2: Advanced Features of the Message Passing Interface , 2003, CLUSTER.

[7]  J. White,et al.  An Analysis of Popular Mpi Implementations , .

[8]  Brian W. Barrett,et al.  Analysis of Implementation Options for MPI-2 One-Sided , 2007, PVM/MPI.

[9]  Stephen Booth,et al.  Exchanging multiple messages via MPI , .

[10]  Eduardo A. Colmenares-Diaz Overlapping communication and computation with MPI-2 for Floyd's algorithm , 2008 .

[11]  Manish Parashar,et al.  Understanding the Behavior and Performance of Non-blocking Communications in MPI , 2004, Euro-Par.

[12]  Dhabaleswar K. Panda,et al.  Designing Non-blocking Personalized Collectives with Near Perfect Overlap for RDMA-Enabled Clusters , 2015, ISC.