Implementation of a Cyber Transformer for Parallel Download in Co-Allocation Data Grid Environments

In data grid, co-allocation architecture was developed to enable parallel transferring of files from multiple replicas stored in the different servers. Several dynamic file transfer strategies based on co-allocation model have been proposed and used to exploit the different transfer rates among various client-server links and to address dynamic rate fluctuations by dividing files into multiple blocks of equal sizes. These schemes, which used for concurrently downloading a file from multiple replicas stored in multiple servers, overcome the obstacle of transfer performance due to idle waiting time of faster servers in co-allocation based file transfers and therefore, provide reduced file transfer time. In this paper, a tool with user friendly interface, called cyber transformer, is implemented and used to manage file replications and download files on data grid environments in parallel. This tool integrates eight methods including the previous and our proposed algorithms. Experimental results show that cyber transformer can obtain high-performance file transfer speed and reduce the time cost of parallel download.

[1]  Ian T. Foster,et al.  Replica selection in the Globus Data Grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[2]  Ching-Hsien Hsu,et al.  A Recursively-Adjusting Co-allocation scheme with a Cyber-Transformer in Data Grids , 2009, Future generations computer systems.

[3]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[4]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[5]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[6]  Ching-Hsien Hsu,et al.  Redundant Parallel File Transfer with Anticipative Recursively-Adjusting Scheme in Data Grids , 2007, ICA3PP.

[7]  Chao-Tung Yang,et al.  Improvements on dynamic adjustment mechanism in co-allocation data grid environments , 2007, The Journal of Supercomputing.

[8]  Jennifer M. Schopf,et al.  Using Regression Techniques to Predict Large Data Transfers , 2003, Int. J. High Perform. Comput. Appl..

[9]  Ian T. Foster,et al.  Resource co-allocation in computational grids , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[10]  Yoshiaki Katayama,et al.  Dynamic Co-allocation Scheme for Parallel Data Transfer in Grid Environment , 2005, 2005 First International Conference on Semantics, Knowledge and Grid.

[11]  Peter Z. Kunszt,et al.  Giggle: A Framework for Constructing Scalable Replica Location Services , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[12]  Yoshiaki Katayama,et al.  A Framework for an Integrated Co-allocator for Data Grid in Multi-Sender Environment , 2007, IEICE Trans. Commun..

[13]  Sudharshan S. Vazhkudai Enabling the co-allocation of grid data transfers , 2003, Proceedings. First Latin American Web Congress.

[14]  Rajkumar Buyya,et al.  A taxonomy of Data Grids for distributed data sharing, management, and processing , 2005, CSUR.

[15]  Jennifer M. Schopf,et al.  A performance study of monitoring and information services for distributed systems , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[16]  Ian T. Foster,et al.  Predicting the performance of wide area data transfers , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[17]  Ian T. Foster,et al.  Data management and transfer in high-performance computational grid environments , 2002, Parallel Comput..

[18]  Javier Jaén Martínez,et al.  Data Management in an International Data Grid Project , 2000, GRID.

[19]  Jennifer M. Schopf,et al.  Predicting sporadic grid data transfers , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[20]  Brian Tierney,et al.  File and Object Replication in Data Grids , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[21]  Ching-Hsien Hsu,et al.  Performance Analysis of Applying Replica Selection Technology for Data Grid Environments , 2005, PaCT.

[22]  Ian T. Foster,et al.  Improving parallel data transfer times using predicted variances in shared networks , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[23]  Chien-Min Wang,et al.  Efficient multi-source data transfer in data grids , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[24]  Ian T. Foster,et al.  The data grid: Towards an architecture for the distributed management and analysis of large scientific datasets , 2000, J. Netw. Comput. Appl..