Experiences on Grid Resource Selection Considering Resource Proximity

Grids are by nature highly dynamic and heterogeneous environments, and this is specially the case for the performance of the interconnection links between grid resources. Therefore, grid resource selection should take into account the proximity of the computational resources to the needed data in order to reduce the cost of file staging. This fact is specially relevant in the case of adaptive job execution, since job migration requires the transfer of large restart files between the compute hosts. In this paper, we discuss the extension of the GridWay framework to also consider dynamic resource proximity to select grid resources, and to decide if job migration is feasible and worthwhile. The benefits of the new resource selector will be demonstrated for the adaptive execution of a computational fluid dynamics (CFD) code.

[1]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[2]  Steven Tuecke,et al.  Protocols and services for distributed data-intensive science , 2002 .

[3]  Rubén S. Montero,et al.  Robust multigrid algorithms for the Navier-Strokes equations , 2001 .

[4]  Eduardo Huedo,et al.  A framework for adaptive execution in grids , 2004, Softw. Pract. Exp..

[5]  Sathish S. Vadhiyar,et al.  A performance oriented migration framework for the grid , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[6]  Ian T. Foster,et al.  Replica selection in the Globus Data Grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[7]  W.Alcock,et al.  Globus Toolkit Support for Distributed Data—Intensive Science , 2001 .

[8]  Chuang Liu,et al.  Design and evaluation of a resource selection framework for Grid applications , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[9]  Ian T. Foster,et al.  Predicting the performance of wide area data transfers , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[10]  E. Deelman,et al.  Data replication strategies in grid environments , 2002, Fifth International Conference on Algorithms and Architectures for Parallel Processing, 2002. Proceedings..

[11]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..