GridBench: A tool for the interactive performance exploration of Grid infrastructures

As Grids rapidly expand in size and complexity, the task of benchmarking and testing, interactive or unattended, quickly becomes unmanageable. In this article we describe the difficulties of testing/benchmarking resources in large Grid infrastructures and we present the software architecture implementation of GridBench, an extensible tool for testing, benchmarking and ranking of Grid resources. We give an overview of GridBench services and tools, which support the easy definition, invocation and management of tests and benchmarking experiments. We also show how the tool can be used in the analysis of benchmarking results and how the measurements can be used to complement the information provided by Grid Information Services and used as a basis for resource selection and user-driven resource ranking. In order to illustrate the usage of the tool, we describe scenarios for using the GridBench framework to perform test/benchmark experiments and analyze the results.

[1]  Werner Nutt,et al.  R-GMA: An Information Integration System for Grid Monitoring , 2003, OTM.

[2]  O. Ponce,et al.  Training of Neural Networks: Interactive Possibilities in a Distributed Framework , 2002, PVM/MPI.

[3]  Marios D. Dikaiakos,et al.  Grid benchmarking: vision, challenges, and current status , 2007, Concurr. Comput. Pract. Exp..

[4]  Maciej Stroinski,et al.  The Migrating Desktop as a GUI Framework for the "Applications on Demand" Concept , 2004, International Conference on Computational Science.

[5]  Henri Casanova,et al.  Benchmark probes for grid assessment , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[6]  Marios D. Dikaiakos,et al.  Experience with the International Testbed in the CrossGrid Project , 2005, EGC.

[7]  Rajesh Raman,et al.  Matchmaking: distributed resource management for high throughput computing , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[8]  Javier D. Bruguera,et al.  Parallelization of the STEM-II Air Quality Model , 2001, HPCN Europe.

[9]  Richard Wolski,et al.  The network weather service: a distributed resource performance forecasting service for metacomputing , 1999, Future Gener. Comput. Syst..

[10]  Rajesh Raman,et al.  Matchmaking: An extensible framework for distributed resource management , 1999, Cluster Computing.

[11]  Marian Bubak,et al.  An interactive Grid for non-invasive vascular reconstruction , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..

[12]  Ian T. Foster,et al.  DiPerF: an automated distributed performance testing framework , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[13]  Ian T. Foster,et al.  Grid information services for distributed resource sharing , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[14]  Marios D. Dikaiakos,et al.  Grid Resource Ranking Using Low-Level Performance Measurements , 2007, Euro-Par.

[15]  Marios D. Dikaiakos.  Grid benchmarking: vision, challenges, and current status: Research Articles , 2007 .

[16]  Zdenek Salvet,et al.  The DataGrid Workload Management System: Challenges and Results , 2004, Journal of Grid Computing.

[17]  T. Mexia,et al.  Author ' s personal copy , 2009 .

[18]  Marian Bubak,et al.  An interactive grid environment for non-invasive vascular reconstruction , 2004 .

[19]  Jorge Luis Rodriguez,et al.  The Open Science Grid , 2005 .

[20]  Marios D. Dikaiakos,et al.  Heterogeneous Grid Computing: Issues and Early Benchmarks , 2005, International Conference on Computational Science.

[21]  Peter H. Beckman,et al.  The Inca Test Harness and Reporting Framework , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[22]  Marios D. Dikaiakos,et al.  Characterization of Computational Grid Resources Using Low-Level Benchmarks , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[23]  Chuang Liu,et al.  Design and evaluation of a resource selection framework for Grid applications , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.