SCTP, XTP and TCP as Transport Protocols for High Performance Computing on Multi-cluster Grid Environments

Multi-cores and multi-processors loosely coupled architectures are interesting commodity off-the-shelf architectures with which to build multi-cluster configurations as grid environments. However, such grid environments face challenges that must be circumvented. Examples include the heterogeneity of computational resources (e.g. operating systems, processors), of different programming paradigms and of network protocols. Transport protocols are especially important, because they can directly impact the execution of distributed engineering and scientific applications. In this paper, we present an empirical study of the SCTP, XTP and TCP as transport protocols with which to support applications in multi-cluster configurations. The environment includes several networks of workstations (NOWs) interconnected via a wide area network. Our experiments consider throughput and latency parameters against number of flows; the results show performance differences from the three transport protocols over a real distributed production configurations.

[1]  José A. B. Fortes.  HCW panel: programming heterogeneous systems - Less pain! Better performance! , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[2]  Alan Wagner,et al.  SCTP versus TCP for MPI , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[3]  W. Timothy Strayer,et al.  XTP as a Transport Protocol for Distributed Parallel Processing , 1994, USENIX High-Speed Networking Symposium.

[4]  Jinhui Qin,et al.  Dynamic Resource Matching for Multi-clusters Based on an Ontology-Fuzzy Approach , 2009, HPCS.

[5]  Hossein Pourreza,et al.  On the Programming Impact of Multi-Core, Multi-Processor Nodes in MPI Clusters , 2007 .

[6]  Laurence T. Yang,et al.  Embedded and Ubiquitous Computing - EUC 2005, International Conference EUC 2005, Nagasaki, Japan, December 6-9, 2005, Proceedings , 2005, EUC.

[7]  Sandhya Dwarkadas,et al.  Compatible phase co-scheduling on a CMP of multi-threaded processors , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[8]  Alfred C. Weaver,et al.  Experience with the Xpress transfer protocol , 1990, [1990] Proceedings. 15th Conference on Local Computer Networks.

[9]  Mario A. R. Dantas,et al.  Performance Evaluation of XTP and TCP Transport Protocols for Reliable Multicast Communications , 2001, HPCN Europe.

[10]  Marc Cohn.  A lightweight transfer protocol for the US Navy SAFENET local area network standard , 1988, Proceedings [1988] 13th Conference on Local Computer Networks.

[11]  Miklos Kozlovszky,et al.  Analysis of SCTP and TCP based communication in high-speed clusters , 2006 .

[12]  Janardhan R. Iyengar,et al.  SCTP: A Proposed Standard for Robust Internet Data Transport , 2003, Computer.

[13]  Roberto Zarrelli,et al.  Enabling PVM to exploit the SCTP protocol , 2006, J. Parallel Distributed Comput..

[14]  Zarka Cvetanovic,et al.  The Effects of Problem Partitioning, Allocation, and Granularity on the Performance of Multiple-Processor Systems , 1987, IEEE Transactions on Computers.

[15]  Hai Jin,et al.  Lightweight Real-Time Network Communication Protocol for Commodity Cluster Systems , 2005, EUC.

[16]  Mario A. R. Dantas,et al.  An Experimental Study on How to Build Efficient Multi-core Clusters for High Performance Computing , 2008, 2008 11th IEEE International Conference on Computational Science and Engineering.

[17]  Jon Crowcroft,et al.  Flow aggregation for enhanced TCP over wide-area wireless , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[18]  Qiaobing Xie,et al.  Stream control transmission protocol (SCTP): a reference guide , 2001 .

[19]  Lixia Zhang,et al.  Stream Control Transmission Protocol , 2000, RFC.

[20]  Mario A. R. Dantas,et al.  A Study of Adaptive Co-scheduling Approach for an Opportunistic Software Environment to Execute in Multi-core and Multi-Processor Configurations , 2008, 2008 11th IEEE International Conference on Computational Science and Engineering.

[21]  Janardhan R. Iyengar,et al.  Using CMT in SCTP-Based MPI to Exploit Multiple Interfaces in Cluster Nodes , 2007, PVM/MPI.

[22]  Peter C. J. Graham,et al.  On the Programming Impact ofMulti-Core,Multi-Processor Nodes inMPI Clusters , 2007, 21st International Symposium on High Performance Computing Systems and Applications (HPCS'07).

[23]  Elvis Pfützenreuter.  Aplicabilidade e desempenho do protocolo de transporte SCTP , 2004 .

[24]  Mohammed Atiquzzaman,et al.  SCTP: state of the art in research, products, and technical challenges , 2004, IEEE Communications Magazine.

[25]  Antonio F. Díaz,et al.  The lightweight protocol CLIC: performance of an MPI implementation on CLIC , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.