The globus extensible input/output system (XIO): a protocol independent IO system for the grid

In distributed heterogeneous grid environments the protocols used to exchange bits are crucial. As researchers work hard to discover the best new protocol for the grid, application developers struggle with ways to use these new protocols. A stable, consistent, and intuitive framework is needed to aid in the implementation and use of these protocols. While the application must not be burdened with the protocol details some of it may need to be exposed to take advantage of potential optimizations. In this paper we examine how the Globus XIO API provides this framework. We explore the performance implications of using this abstraction layer and the benefits gained in application as well as protocol development.

[1]  D. Watson,et al.  The architecture of the High Performance Storage System (HPSS) , 1995 .

[2]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[3]  Sally Floyd,et al.  HighSpeed TCP for Large Congestion Windows , 2003, RFC.

[4]  Larry L. Peterson,et al.  The x-Kernel: An Architecture for Implementing Network Protocols , 1991, IEEE Trans. Software Eng..

[5]  Van Jacobson,et al.  Congestion avoidance and control , 1988, SIGCOMM '88.

[6]  Mark Handley,et al.  Congestion control for high bandwidth-delay product networks , 2002, SIGCOMM '02.

[7]  Robert L. Grossman,et al.  Simple Available Bandwidth Utilization Library for High-Speed Wide Area Networks , 2005, The Journal of Supercomputing.

[8]  Sally Floyd,et al.  The NewReno Modification to TCP's Fast Recovery Algorithm , 2004, RFC.

[9]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[10]  Ian T. Foster,et al.  Data management and transfer in high-performance computational grid environments , 2002, Parallel Comput..

[11]  Tom Kelly,et al.  Scalable TCP: improving performance in highspeed wide area networks , 2003, CCRV.

[12]  W.Alcock,et al.  Globus Toolkit Support for Distributed Data—Intensive Science , 2001 .

[13]  Vern Paxson,et al.  TCP Congestion Control , 1999, RFC.

[14]  Yunhong Gu,et al.  UDT: An Application Level Transport Protocol for Grid Computing , 2003 .

[15]  Sally Floyd,et al.  The NewReno Modification to TCP's Fast Recovery Algorithm , 2004, RFC.

[16]  W. Timothy Strayer,et al.  XTP as a Transport Protocol for Distributed Parallel Processing , 1994, USENIX High-Speed Networking Symposium.

[17]  Bogdan M. Wilamowski,et al.  The Transmission Control Protocol , 2005, The Industrial Information Technology Handbook.

[18]  Lixia Zhang,et al.  NETBLT: A bulk data transfer protocol , 1985, RFC.

[19]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.1 , 1997, RFC.

[20]  Mark Handley,et al.  Congestion control for high bandwidth-delay product networks , 2002, SIGCOMM.

[21]  W. Allcock,et al.  GridFTP protocol specification , 2002 .

[22]  Jason Leigh,et al.  Reliable Blast UDP : predictable high performance bulk data transfer , 2002, Proceedings. IEEE International Conference on Cluster Computing.

[23]  Cheng Jin,et al.  FAST TCP: Motivation, Architecture, Algorithms, Performance , 2006, IEEE/ACM Transactions on Networking.

[24]  T CorporateAt.  UNIX system V: streams programmer's guide , 1987 .

[25]  R. A. Coyne,et al.  The high performance storage system , 1993, Supercomputing '93.

[26]  S. Hadjiefthymiades,et al.  Hypertext Transfer Protocol (HTTP) , 1996 .

[27]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[28]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[29]  Ian T. Foster,et al.  Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing , 2001, 2001 Eighteenth IEEE Symposium on Mass Storage Systems and Technologies.

[30]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[31]  Steven Tuecke,et al.  GridFTP: Protocol Extensions to FTP for the Grid , 2001 .