Performance models for hierarchical grid architectures

Main characteristics of large-scale, geographically distributed grid systems are resource heterogeneity and network latency. In this paper, we use queuing network models to analyze data-parallel grid applications and we show the effects of resource heterogeneity, communications delays, network bandwidths and synchronization overheads on the application-level performance. The proposed models rely on the statistical pattern of computation, communication, and I/O operations in the parallel applications, as well as on measurable infrastructure characteristics. We finally show how the high variability in the execution and communication times must be considered when modeling applications on geographically distributed grid infrastructures

[1]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[2]  Xian-He Sun,et al.  Performance Modeling and Prediction of Nondedicated Network Computing , 2002, IEEE Trans. Computers.

[3]  Emmanuel Jeannot,et al.  On the distribution of sequential jobs in random brokering for heterogeneous computational grids , 2006, IEEE Transactions on Parallel and Distributed Systems.

[4]  Claudio Gennaro,et al.  Integrated Performance Models for SPMD Applications and MIMD Architectures , 2002, IEEE Trans. Parallel Distributed Syst..

[5]  Paolo Cremonesi.  Optimal Resource Allocation in Grid Environments , 2006 .

[6]  P. J. Schweitzer.  EXACT SOLUTION OF THE MVA EQUATIONS , 1988 .

[7]  Yves Robert,et al.  Scheduling tasks sharing files on heterogeneous master-slave platforms , 2004, 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing, 2004. Proceedings..

[8]  Elizabeth Varki.  Mean value technique for closed fork-join networks , 1999, SIGMETRICS '99.

[9]  Rajkumar Buyya,et al.  A taxonomy and survey of grid resource management systems for distributed computing , 2002, Softw. Pract. Exp..

[10]  Ming Wu,et al.  Grid Harvest Service: a system for long-term, application-level task scheduling , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[11]  Herbert A. David,et al.  Order Statistics, Third Edition , 2003, Wiley Series in Probability and Statistics.

[12]  Yves Robert,et al.  Scheduling Tasks Sharing Files on Heterogeneous Master-Slave Platforms , 2004, PDP.

[13]  Johan Tordsson,et al.  A Grid Resource Broker Supporting Advance Reservations and Benchmark-Based Resource Selection , 2004, PARA.

[14]  Jon B. Weissman,et al.  Adaptive resource selection for grid-enabled network services , 2003, Second IEEE International Symposium on Network Computing and Applications, 2003. NCA 2003..

[15]  Randy H. Katz,et al.  Input/output behavior of supercomputing applications , 1991, Proceedings of the 1991 ACM/IEEE Conference on Supercomputing (Supercomputing '91).

[16]  H. N. Nagaraja,et al.  Order Statistics, Third Edition , 2005, Wiley Series in Probability and Statistics.

[17]  Giuseppe Serazzi,et al.  End-to-End Performance of Web Services , 2002, Performance.

[18]  Nazareno Andrade,et al.  Accurate autonomous accounting in peer-to-peer Grids , 2005, MGC '05.

[19]  Domenico Talia,et al.  Grid Programming Models: Current Tools, Issues and Directions , 2003 .

[20]  P. J. Schweitzer.  A Nonlinear Vector Finite Difference Scheme (P. J. Schweitzer) , 1981 .

[21]  Yaohang Li,et al.  Improving performance via computational replication on a large-scale computational grid , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[22]  Katsuyuki Yamazaki,et al.  A Hierarchy of Network Performance Characteristics for Grid Applications and Services , 2004 .

[23]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[24]  Katsuyuki Yamazaki,et al.  Influence of Network Characteristics on Application Performance in a Grid Environment , 2005, Telecommun. Syst..

[25]  Jean-Loup Baer,et al.  A performance evaluation of cluster architectures , 1997, SIGMETRICS '97.

[26]  Stephen A. Jarvis,et al.  An investigation into the application of different performance prediction techniques to e-Commerce applications , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[27]  G. C. Polyzos,et al.  A static analysis of I/O characteristics of scientific applications in a production workload , 1993, Supercomputing '93.

[28]  Simonetta Balsamo,et al.  Bound Performance Models of Heterogeneous Parallel Processing Systems , 1998, IEEE Trans. Parallel Distributed Syst..

[29]  CremonesiPaolo.  Parallel, distributed and network-based processing , 2006 .

[30]  Liang Peng,et al.  Performance evaluation in computational grid environments , 2004, Proceedings. Seventh International Conference on High Performance Computing and Grid in Asia Pacific Region, 2004..