Improving grid performance by dynamically deploying applications

Grid applications are normally deployed on computing nodes beforehand, which may cause the undesirable situation that some of these nodes (with hot applications deployed) are always busy whereas the others are consistently idle. Therefore, the overall performance (e.g. throughput and load balancing) of such a Grid system would be seriously degraded. In this paper, we present the idea of Hierarchical and Dynamic Deployment of Application (HDDA) in Grid to improve the system performance. With HDDA, an application can be dynamically deployed and undeployed when necessary. In order to reduce the overhead caused by HDDA, the Average Latency Ratio Minimum (ALR‐MIN) replacement strategy is also proposed. It deploys applications to nodes with minimum ALR of Node (NALR), and evicts applications with minimum increment of ALR. The results of the experiment we conducted on ChinaGrid show that HDDA can achieve 10 and 24% less average complete time (ACT) than the schemes of non‐HDDA and Static Deployment of Application (SDA), respectively. Additionally, throughput and load balancing of HDDA are also better than the other two schemas. Results of the simulation performed on a simulator particularly developed for this research show that our ALR‐MIN replacement strategy results in 17% less relative delay‐time of jobs than the well‐known Least Recently Used (LRU)‐based strategies in a typical setting. Copyright © 2010 John Wiley & Sons, Ltd.

[1]  Nimrod Megiddo,et al.  Outperforming LRU with an adaptive replacement cache algorithm , 2004, Computer.

[2]  Yan Ma,et al.  Dynamic Visualization Service Deployment in Grid Scientific Workflow , 2008, 2008 Seventh International Conference on Grid and Cooperative Computing.

[3]  Ming-Syan Chen,et al.  On designing a shortest-path-based cache replacement in a transcoding proxy , 2008, Multimedia Systems.

[4]  Michel Dubois,et al.  Cache replacement algorithms with nonuniform miss costs , 2006, IEEE Transactions on Computers.

[5]  Leonard Kleinrock,et al.  Proportional Replication in Peer-to-Peer Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[6]  Yiming Hu,et al.  Exploiting client caches to build large Web caches , 2007, The Journal of Supercomputing.

[7]  Sandy Irani,et al.  Cost-Aware WWW Proxy Caching Algorithms , 1997, USENIX Symposium on Internet Technologies and Systems.

[8]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[9]  Pu Liu,et al.  Uniform Dynamic Deployment of Web and Grid Services , 2007, IEEE International Conference on Web Services (ICWS 2007).

[10]  Marc Abrams,et al.  Proxy Caching That Estimates Page Load Delays , 1997, Comput. Networks.

[11]  Jin-Soo Kim,et al.  DynaGrid: A dynamic service deployment and resource migration framework for WSRF-compliant applications , 2007, Parallel Comput..

[12]  M. Batty,et al.  Power law distributions in real and virtual worlds , 2000 .

[13]  Edward A. Fox,et al.  Caching Proxies: Limitations and Potentials , 1995, WWW.

[14]  Edith Cohen,et al.  Replication strategies in unstructured peer-to-peer networks , 2002, SIGCOMM.

[15]  D. Diwakar,et al.  CINWEGS - An Integrated Web and Grid Services Framework for Collaborative Solutions , 2008, 2008 4th International Conference on Next Generation Web Services Practices.

[16]  Paul Watson,et al.  Dynamically deploying Web services on a grid using Dynasoar , 2006, Ninth IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing (ISORC'06).

[17]  David J. DeWitt,et al.  Data driven workflow planning in cluster management systems , 2007, HPDC '07.

[18]  Thomas Fahringer,et al.  GLARE: A Grid Activity Registration, Deployment and Provisioning Framework , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[19]  Hai Jin,et al.  HAND: Highly Available Dynamic Deployment Infrastructure for Globus Toolkit 4 , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[20]  Chunming Hu,et al.  Introduction to ChinaGrid Support Platform , 2005, ISPA Workshops.