A multi-layer resource reconfiguration framework for grid computing

Grid is a non-dedicated and dynamic computing environment. Consequently, different programs have to compete with each other for the same resources, and resource availability varies over time. That causes the performance of user programs to degrade and to become unpredictable. For resolving this problem, we propose a multi-layer resource reconfiguration framework for grid computing. As named, this framework adopts different resource reconfiguration mechanisms for different workloads of resources. We have implemented this framework on a grid-enabled DSM system called Teamster-G. Our experimental result shows that our proposed framework allows Teamster-G not only to fully utilize abundant CPU cycles but also to minimize resource contention between the jobs of resource consumers and those of resource providers. As a result, the job throughput of Teamster-G is effectively increased.

[1]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[2]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[3]  John Shalf,et al.  The Cactus Worm: Experiments with Dynamic Resource Discovery and Allocation in a Grid Environment , 2001, Int. J. High Perform. Comput. Appl..

[4]  Gabriel Antoniu,et al.  Making a DSM consistency protocol hierarchy-aware: an efficient synchronization scheme , 2003, CCGrid 2003. 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2003. Proceedings..

[5]  Laxmikant V. Kalé,et al.  Adaptive MPI , 2003, LCPC.

[6]  Ian T. Foster,et al.  MPICH-G2: A Grid-enabled implementation of the Message Passing Interface , 2002, J. Parallel Distributed Comput..

[7]  Jyh-Biau Chang,et al.  Teamster-G: a grid-enabled software DSM system , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[8]  Jeffrey K. Hollingsworth,et al.  Mechanisms and policies for supporting fine-grained cycle stealing , 1999, ICS '99.

[9]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[10]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[11]  Walfredo Cirne,et al.  Non-Dedicated Distributed Environment: A Solution for Safe and Continuous Exploitation of Idle Cycles , 2005, Scalable Comput. Pract. Exp..

[12]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[13]  Jyh-Biau Chang,et al.  Enabling software DSM system for grid computing , 2005, 8th International Symposium on Parallel Architectures,Algorithms and Networks (ISPAN'05).

[14]  Cho-Li Wang,et al.  LOTS: a software DSM supporting large object space , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[15]  Andrea C. Arpaci-Dusseau,et al.  The interaction of parallel and sequential workloads on a network of workstations , 1995, SIGMETRICS '95/PERFORMANCE '95.

[16]  Sathish S. Vadhiyar,et al.  Self adaptivity in Grid computing , 2005, Concurr. Pract. Exp..

[17]  M. Nakazawa,et al.  Dyn-MPI: Supporting MPI on Non Dedicated Clusters , 2003, ACM/IEEE SC 2003 Conference (SC'03).

[18]  Eduardo Huedo,et al.  The GridWay Framework for Adaptive Scheduling and Execution on Grids , 2001, Scalable Comput. Pract. Exp..

[19]  Brian A. Coghlan,et al.  SMG : SHARED MEMORY FOR GRIDS , 2022 .

[20]  Jyh-Biau Chang,et al.  Teamster: a transparent distributed shared memory for cluster symmetric multiprocessors , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[21]  Ian T. Foster,et al.  The Globus project: a status report , 1998, Proceedings Seventh Heterogeneous Computing Workshop (HCW'98).

[22]  Boleslaw K. Szymanski,et al.  An Architecture for Reconfigurable Iterative MPI Applications in Dynamic Environments , 2005, PPAM.

[23]  Eduardo Huedo,et al.  A framework for adaptive execution in grids , 2004, Softw. Pract. Exp..

[24]  John Ryan,et al.  Distributed Shared Memory in a Grid Environment , 2005, PARCO.

[25]  Jyh-Biau Chang,et al.  A Transparent Distributed Shared Memory for Clustered Symmetric Multiprocessors , 2006, The Journal of Supercomputing.

[26]  Jingwen Wang,et al.  Utopia: A load sharing facility for large, heterogeneous distributed computer systems , 1993, Softw. Pract. Exp..