Toward seamless grid data access: design and implementation of GridFTP on .NET

To date, only Linux/UNIX-based hosts have been participants in the Grid vision for seamless data access, because the necessary Grid data access protocols have not been implemented on Windows. As part of our larger effort at the University of Virginia to make the Windows platform a first-class participant in all aspects of grids, this paper describes our experiences and lessons learned while implementing GridFTP on the Microsoft .NET Framework. Our implementation not only supports major extensions of GridFTP v1, it also uniquely implements some features of GridFTP v2 and introduces a new transfer mode specifically designed for transfer of large collection of small files. Our measured performance is comparable to GT4 GridFTP on both single and parallel streams transfer and more efficient than GT4 GridFTP on directory tree transfer. We also identify issues specific to the .NET Framework/Windows platform with regard to security and we identify limitations of current GridFTP protocol. To our knowledge, the work described in this paper is the first comprehensive and evaluated implementation of GridFTP on .NET.

[1]  Marty Humphrey,et al.  The University of Virginia Campus Grid: Integrating Grid Technologies with the Campus Information Infrastructure , 2005, EGC.

[2]  Steven Tuecke,et al.  GridFTP: Protocol Extensions to FTP for the Grid , 2001 .

[3]  Marty Humphrey,et al.  Architectural Foundations of WSRF.NET , 2005, Int. J. Web Serv. Res..

[4]  Marty Humphrey,et al.  Exploiting WSRF and WSRF.NET for remote job execution in grid environments , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[5]  Brian Tierney,et al.  File and Object Replication in Data Grids , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[6]  Jun Feng,et al.  Eliminating replica selection - using multiple replicas to accelerate data transfer on grids , 2004, Proceedings. Tenth International Conference on Parallel and Distributed Systems, 2004. ICPADS 2004..

[7]  Dean H. Lorenz,et al.  DYNAMO - DirectorY, Net Archiver and MOver , 2002, GRID.

[8]  Marty Humphrey,et al.  Mobile OGSI.NET: grid computing on mobile devices , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[9]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[10]  Steven Tuecke,et al.  An online credential repository for the Grid: MyProxy , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[11]  Sang-Min Park,et al.  Toward GT3 and OGSI.NET Interoperability: GRAM Support on OGSI.NET , 2005, International Conference on Computational Science.

[12]  Jim Basney,et al.  CredEx: user-centric credential management for grid and Web services , 2005, IEEE International Conference on Web Services (ICWS'05).

[13]  William E. Allcock,et al.  The Globus Striped GridFTP Framework and Server , 2005, ACM/IEEE SC 2005 Conference (SC'05).