Towards Scalable Grid Replica Optimization Framework

Data grids are becoming a popular infrastructure for distributed, data intensive scientific application. Data access optimization is one of the key features of such systems, as the transfer and access to the huge amounts of data are often the bottleneck of the data intensive tasks. Concept of replication, creation of multiple copies of a data source across multiple grid nodes, was adopted by grid community to increase data availability. In this paper, we present the ongoing work on the grid replica optimization framework that addresses both short-term and long-term replica optimization problems. We describe high level architecture of the optimization framework and discuss the promising results achieved by prototype implementation of several system components

[1]  Ke Wang,et al.  Building Association-Rule Based Sequential Classifiers for Web-Document Prediction , 2004, Data Mining and Knowledge Discovery.

[2]  Carl Kesselman,et al.  Performance and scalability of a replica location service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[3]  Jacek Kitowski,et al.  Access cost estimation for unified grid storage systems , 2003, Proceedings. First Latin American Web Congress.

[4]  Kurt Stockinger,et al.  Simulation of Dynamic Grid Replication Strategies in OptorSim , 2002, GRID.

[5]  Floriano Zini,et al.  Evaluating scheduling and replica optimisation strategies in OptorSim , 2003, Proceedings. First Latin American Web Congress.

[6]  Boleslaw K. Szymanski,et al.  Simulation of dynamic data replication strategies in Data Grids , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[7]  Peter Z. Kunszt,et al.  Giggle: A Framework for Constructing Scalable Replica Location Services , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[8]  Kavitha Ranganathan,et al.  Identifying Dynamic Replication Strategies for a High-Performance Data Grid , 2001, GRID.

[9]  Rob Sherwood,et al.  Slurpie: a cooperative bulk data transfer protocol , 2004, IEEE INFOCOM 2004.

[11]  Kurt Stockinger,et al.  PRELIMINARY EVALUATION OF REVENUE PREDICTION FUNCTIONS FOR ECONOMICALLY-EFFECTIVE FILE REPLICATION , 2002 .