Connecting client objectives with resource capabilities: an essential component for grid service managent infrastructures

In large-scale, distributed systs such as Grids, an agreent between a client and a service provider specifies service level objectives both as expressions of client requirents and as provider assurances. Ideally, these objectives are expressed in a high-level, service- or application-specific manner rather than requiring clients to detail the necessary resources. Resource providers on the other hand, expect low-level, resource specific performance criteria that are uniform across applications and can easily be interpreted and provisioned. This paper presents a framework for Grid service managent that addresses this gap between high-level specification of client performance objectives and existing resource managent infrastructures It identifies three levels of abstraction for resource requirents that a service provider needs to manage, namely: detailed specification of raw resources, virtualization of heterogeneous resources as abstract resources, and performance objectives at an application level. The paper also identifies three key functions for managing service level agreents, namely: <i>translation</i> of resource requirents across abstraction layers, <i>arbitration</i> in allocating resources to client requests, and <i>aggregation and allocation</i> of resources from multiple lower level resource managers. One or more of these key functions may be present at each abstraction layer of a service level manager. Thus, the composition of these functions across resource abstraction layers enables modeling of a wide array of managent scenarios. We present a framework that supports these functions: it uses the service metadata and/or service performance models to map client requirents to resource capabilities, it uses business value associated with objectives in allocation decisions to arbitrate between competing requests, and it allocates resources based on previously negotiated agreents.

[1]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[2]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[3]  John Shalf,et al.  Numerical Relativity in a Distributed Environment , 1999, PPSC.

[4]  Sathish S. Vadhiyar,et al.  Numerical Libraries and the Grid , 2001, Int. J. High Perform. Comput. Appl..

[5]  Donna N. Dillenberger,et al.  Adaptive Algorithms for Managing a Distributed Data Processing Workload , 1997, IBM Syst. J..

[6]  Gagan Agrawal,et al.  Runtime and Compiler Support for Programming in AdaptiveParallel Environments , 1997 .

[7]  Joel H. Saltz,et al.  Run-Time and Compiler Support for Programming in Adaptive Parallel Environments , 1997 .

[8]  Asit Dan,et al.  Web services on demand: WSLA-driven automated management , 2004, IBM Syst. J..

[9]  G. Allen,et al.  Supporting Efficient Execution in Heterogeneous Distributed Computing Environments with Cactus and Globus , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[10]  Joel H. Saltz,et al.  Runtime Support for Programming in Adaptive Parallel Environments , 1995, LCR.

[11]  Chuang Liu,et al.  Design and evaluation of a resource selection framework for Grid applications , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[12]  Michael Stonebraker,et al.  Contract-Based Load Management in Federated Distributed Systems , 2004, NSDI.

[13]  Asit Dan,et al.  Web services agreement specification (ws-agreement) , 2004 .

[14]  David E. Irwin,et al.  Balancing risk and reward in a market-based task service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[15]  Rajesh Raman,et al.  Matchmaking: distributed resource management for high throughput computing , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[16]  Ian T. Foster,et al.  DiPerF: an automated distributed performance testing framework , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[17]  Marco Vanneschi,et al.  The programming model of ASSIST, an environment for parallel and distributed portable applications , 2002, Parallel Comput..

[18]  John Shalf,et al.  Solving Einstein's Equations on Supercomputers , 1999, Computer.

[19]  Asit Dan,et al.  eModel: addressing the need for a flexible modeling framework in autonomic computing , 2002, Proceedings. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems.

[20]  Daniel M. Dias,et al.  Service-Level Agreements and Commercial Grids , 2003, IEEE Internet Comput..

[21]  Asit Dan,et al.  Cremona: an architecture and library for creation and monitoring of WS-agreents , 2004, ICSOC '04.

[22]  Ian T. Foster,et al.  Cactus Application: Performance Predictions in Grid Environments , 2001, Euro-Par.

[23]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[24]  Asit Dan,et al.  A Service Level Agreement Language for Dynamic Electronic Services , 2003, Electron. Commer. Res..

[25]  V. Rich Personal communication , 1989, Nature.

[26]  Sathish S. Vadhiyar,et al.  Numerical Libraries And The Grid: The GrADS Experiments With ScaLAPACK , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[27]  Mike P. Papazoglou,et al.  Introduction: Service-oriented computing , 2003, CACM.

[28]  Warren Smith,et al.  A Resource Management Architecture for Metacomputing Systems , 1998, JSSPP.

[29]  Francine Berman,et al.  The GrADS Project: Software Support for High-Level Grid Application Development , 2001, Int. J. High Perform. Comput. Appl..

[30]  Jack J. Dongarra,et al.  A set of level 3 basic linear algebra subprograms , 1990, TOMS.

[31]  Klara Nahrstedt,et al.  A distributed resource management architecture that supports advance reservations and co-allocation , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).