First Workshop on Execution Environments for Distributed Computing

Dynamic resource provisioning has become a good solution in these days where for several economic reasons (power, heat, space, etc..) applications are executed together on the same machine. This paper is an extension of a previous proof-of concept [Nou et al., 2007c] where we presented a dynamic resource scheduling solution for applications that serve very different types of jobs (ie. transactional workloads, grid workloads), now we have added the ability to make a priority based resource scheduling in order to achieve SLA requirements in such shared environments. The validation of this feature has been proof with two of the most representative servers for this types of workloads, Tomcat application server and Globus grid middleware. In the paper we demonstrate that we are able to assign different priorities and schedule giving more resources to the more priority server in overloaded environments.

[1]  Christophe Diot,et al.  The CoMo white paper , 2004 .

[2]  John Shalf,et al.  SAGA: A Simple API for Grid Applications. High-level application programming on the Grid , 2006 .

[3]  Darrell D. E. Long,et al.  Design and Implementation of a Predictive File Prefetching Algorithm , 2001, USENIX Annual Technical Conference, General Track.

[4]  Jarek Nabrzyski,et al.  GridLab--a grid application toolkit and testbed , 2002, Future Gener. Comput. Syst..

[5]  Ian T. Foster,et al.  Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, Journal of Computer Science and Technology.

[6]  George Varghese,et al.  Bitmap algorithms for counting active flows on high speed links , 2003, IMC '03.

[7]  Edward A. Lee,et al.  CONCURRENCY AND COMPUTATION : PRACTICE AND EXPERIENCE Concurrency Computat , 2006 .

[8]  Michael Stonebraker,et al.  Monitoring Streams - A New Class of Data Management Applications , 2002, VLDB.

[9]  João Luís Sobral,et al.  A Run-Time System for Dynamic Grain Packing , 1999, Euro-Par.

[10]  Alejandro Duran,et al.  A Proposal for Task Parallelism in OpenMP , 2007, IWOMP.

[11]  Javier Jaén Martínez,et al.  Models for replica synchronisation and consistency in a data grid , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[12]  Peter Z. Kunszt,et al.  Giggle: A Framework for Constructing Scalable Replica Location Services , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[13]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[14]  Carl Kesselman,et al.  Performance and scalability of a replica location service , 2004, Proceedings. 13th IEEE International Symposium on High performance Distributed Computing, 2004..

[15]  David E. Culler,et al.  SEDA: an architecture for well-conditioned, scalable internet services , 2001, SOSP.

[16]  R. Cranley,et al.  Multivariate Analysis—Methods and Applications , 1985 .

[17]  Ming Tang,et al.  Dynamic replication algorithms for the multi-tier Data Grid , 2005, Future Gener. Comput. Syst..

[18]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[19]  Frederick Reiss,et al.  Declarative Network Monitoring with an Underprovisioned Query Processor , 2006, 22nd International Conference on Data Engineering (ICDE'06).

[20]  Min Cai,et al.  A Peer-to-Peer Replica Location Service Based on a Distributed Hash Table , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[21]  Toni Cortes,et al.  Increasing Parallelism for Workflows in the Grid , 2007, Euro-Par.

[22]  John Shalf,et al.  Enabling Applications on the Grid: A Gridlab Overview , 2003, Int. J. High Perform. Comput. Appl..

[23]  Frederick Reiss,et al.  TelegraphCQ: Continuous Dataflow Processing for an Uncertain World , 2003, CIDR.

[24]  Fabrizio Silvestri,et al.  A Grid Information Service Based on Peer-to-Peer , 2005, Euro-Par.

[25]  Michael Stonebraker,et al.  Load Shedding in a Data Stream Manager , 2003, VLDB.

[26]  Jesús Labarta,et al.  Programming Grid Applications with GRID Superscalar , 2003, Journal of Grid Computing.

[27]  Rajkumar Buyya,et al.  A taxonomy of Data Grids for distributed data sharing, management, and processing , 2005, CSUR.

[28]  Robert H. Halstead,et al.  Lazy task creation: a technique for increasing the granularity of parallel programs , 1990, LISP and Functional Programming.

[29]  Suntae Hwang.  Control of parallel task granularity by throttling decomposition , 1997, Proceedings 1997 International Conference on Parallel and Distributed Systems.

[30]  Rob van Nieuwpoort,et al.  The Grid Application Toolkit: Toward Generic and Easy Application Programming Interfaces for the Grid , 2005, Proceedings of the IEEE.

[31]  David Moore,et al.  A robust system for accurate real-time summaries of internet traffic , 2005, SIGMETRICS '05.

[32]  Erwin Laure,et al.  Advanced Replica Management with Reptor , 2003, PPAM.

[33]  D. Moore,et al.  Building a better NetFlow , 2004, SIGCOMM '04.

[34]  Thomas M. Kroeger,et al.  Predicting file system actions from prior events , 1996 .

[35]  Luca Trevisan,et al.  Counting Distinct Elements in a Data Stream , 2002, RANDOM.

[36]  W. Chen,et al.  Distributed File Streamer: A Framework for Distributed Application Data Coupling , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.