VegaBench: A Benchmark Tool for Grid System Software

This paper presents VegaBench, a benchmark tool, and its methodology of evaluation for service oriented grid system software. The aim of the VegaBench is to bring forth a set of benchmarks for both end users and the system software developers to measure grid system software. In order to do this in an organized and flexible way, we provide some interaction-intensive test cases as well as a framework which can manage the execution of test cases and support customizing test cases by users. Additionally, we present the quality-of-service (QoS) based metrics. This paper also describes some experiments on different grid system software with VegaBench. The result comparison and analysis are also provided which demonstrate the effectiveness of VegaBench

[1]  Javier García,et al.  TPC-W E-Commerce Benchmark Evaluation , 2003, Computer.

[2]  Daniel A. Menascé,et al.  TPC-W: A Benchmark for E-Commerce , 2002, IEEE Internet Comput..

[3]  Henri Casanova,et al.  Benchmark probes for grid assessment , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[4]  Marios D. Dikaiakos,et al.  Grid benchmarking: vision, challenges, and current status , 2007, Concurr. Comput. Pract. Exp..

[5]  Marios D. Dikaiakos,et al.  GridBench: a tool for benchmarking grids , 2003, Proceedings. First Latin American Web Congress.

[6]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[7]  Nigel Thomas.  Editorial: Grid Performability , 2005, Comput. J..

[8]  A. Stephen McGough,et al.  Performance Evaluation of the GridSAM Job Submission and Monitoring System , 2005 .

[9]  Zhiwei Xu,et al.  System Software for China National Grid , 2005, NPC.

[10]  Michael A. Frumkin,et al.  NAS Grid Benchmarks: A Tool for Grid Space Exploration , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[11]  Henri Casanova,et al.  Benchmarks for grid computing: a review of ongoing efforts and future directions , 2003, PERV.

[12]  Ying Liu,et al.  Understanding Grid resource information management through a synthetic database benchmark/workload , 2004, IEEE International Symposium on Cluster Computing and the Grid, 2004. CCGrid 2004..