Efficient Resource Management Scheme of TCP Buffer Tuned Parallel Stream to Optimize System Performance

GridFTP is a high-performance, secure and reliable parallel data transfer protocol, used for transferring widely distributed data. Currently it allows users to configure the number of parallel streams and socket buffer size. However, the tuning procedure for its optimal combinations is a time consuming task. The socket handlers and buffers are important system resources and must therefore be carefully managed. In this paper, an efficient resource management scheme which predicts optimal combinations based on a simple regression equation is proposed. In addition, the equation is verified by comparing measured and predicted values and we apply the equation to an actual experiment on the KOREN. The result demonstrates that the equation predicts excellently with only 8% error boundary. This approach eliminates the time wasted tuning procedure. These results can be utilized directly and widely for the fast decision in typical applications such as GridFTP.

[1]  Wu-chun Feng,et al.  Dynamic right-sizing in TCP : a simulation study / , 2001 .

[2]  Wu-chun Feng,et al.  Dynamic right-sizing: a simulation study , 2001, Proceedings Tenth International Conference on Computer Communications and Networks (Cat. No.01EX495).

[3]  Jason Lee,et al.  Enabling network-aware applications , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[4]  Ian T. Foster,et al.  The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets , 2000, J. Netw. Comput. Appl..

[5]  Van Jacobson,et al.  TCP Extensions for High Performance , 1992, RFC.

[6]  Matthew Mathis,et al.  The macroscopic behavior of the TCP congestion avoidance algorithm , 1997, CCRV.

[7]  Brian Tierney,et al.  TCP Tuning Guide for Distributed Application on Wide Area Networks , 2001, login Usenix Mag..

[8]  Robert L. Grossman,et al.  PSockets: The Case for Application-level Network Striping for Data Intensive Applications using High Speed Wide Area Networks , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[9]  Wu-chun Feng,et al.  A comparison of TCP automatic tuning techniques for distributed computing , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[10]  Mark Carson,et al.  NIST Net: a Linux-based network emulation tool , 2003, CCRV.

[11]  Wu-chun Feng,et al.  Dynamic right-sizing in FTP (drsFTP): Enhancing Grid performance in user-space , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[12]  Matthew Mathis,et al.  Automatic TCP buffer tuning , 1998, SIGCOMM '98.