Application partitioning and hierarchical management in grid environments

Several works on grid computing have been proposed in the last years. However, most of them, including available software, can not deal properly with some issues related to control of applications that spread a very large number of tasks across the grid network. This work presents a step toward solving the problem of controlling such applications. We propose and discuss an architectural model called GRAND (Grid Robust ApplicatioN Deployment) based on partitioning and hierarchical submission and control of such applications. The main contribution of our model is to be able to control the execution of a huge number of distributed tasks while preserving data locality and reducing the load of the submit machines. We propose a taxonomy to classify application models to run in grid environments and partitioning methods. We also present our application description language GRID-ADL.

[1]  David Page,et al.  Toward Automatic Management of Embarrassingly Parallel Applications , 2003, Euro-Par.

[2]  Iosif Legrand,et al.  The MONARC toolset for simulating large network-distributed processing systems , 2000, 2000 Winter Simulation Conference Proceedings (Cat. No.00CH37165).

[3]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[4]  Eli Gafni,et al.  Concurrency in heavily loaded neighborhood-constrained systems , 1989, ICDCS.

[5]  Nicholas R. Jennings,et al.  The Evolution of the Grid , 2003 .

[6]  Yong Zhao,et al.  Chimera: a virtual data system for representing, querying, and automating data derivation , 2002, Proceedings 14th International Conference on Scientific and Statistical Database Management.

[7]  Maria Clicia Stelling de Castro,et al.  Applying scheduling by edge reversal to constraint partitioning , 2003, Proceedings. 15th Symposium on Computer Architecture and High Performance Computing.

[8]  Miron Livny,et al.  Condor and the Grid , 2003 .

[9]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[10]  Ian T. Foster,et al.  Grid Services for Distributed System Integration , 2002, Computer.

[11]  Jorge L. V. Barbosa,et al.  A framework for exploiting adaptation in high heterogeneous distributed processing , 2002, 14th Symposium on Computer Architecture and High Performance Computing, 2002. Proceedings..

[12]  Inês Dutra,et al.  Application partitioning and hierarchical application management in grid environments , 2004 .

[13]  Francisco Vilar Brasileiro,et al.  Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids , 2003, Euro-Par.

[14]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[15]  F. R. Geyer,et al.  Hierarchical Resource Management and Application Control in Grid Environments , 2003 .

[16]  Vincent Breton,et al.  Evaluation of Unique Sequences on the European Data Grid , 2003, APBC.