A framework for providing hard delay guarantees and user fairness in Grid computing

We present and theoretically and experimentally analyze a Quality of Service (QoS) framework for Grids that provides (i) deterministic delay bounds to Guaranteed Service (GS) users and (ii) fair sharing of resources to Best Effort (BE) users. The framework adopts concepts from Data Networks and applies them in the Grid environment. We initially describe the proposed framework assuming that task computational workloads are known (or can be estimated), and then provide extensions for the more realistic case where we have no a-priori knowledge of the task workloads. Task migration across multiple resources is also examined in this context. We also look at a specific implementation of the proposed QoS scheme, where we distinguish computational resources, based on the type of users (GS or BE) they serve and the priority they give to each type. We validate experimentally the proposed QoS framework for Grids, verifying that it satisfies the delay guarantees promised to GS users and provides fairness among BE users, while simultaneously improving performance in terms of deadlines missed and resource utilization. In our simulations, data from a real Grid Network are used.

[1]  George N. Rouskas,et al.  On the Design of Online Scheduling Algorithms for Advance Reservations and QoS in Grids , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[2]  Rajkumar Buyya,et al.  GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing , 2002, Concurr. Comput. Pract. Exp..

[3]  Scott Shenker,et al.  Analysis and simulation of a fair queueing algorithm , 1989, SIGCOMM 1989.

[4]  Abhay Parekh,et al.  A generalized processor sharing approach to flow control in integrated services networks-the single node case , 1992, [Proceedings] IEEE INFOCOM '92: The Conference on Computer Communications.

[5]  Warren Smith,et al.  Scheduling with advanced reservations , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[6]  Shikharesh Majumdar,et al.  A Framework to Achieve Guaranteed QoS for Applications and High System Performance in Multi-Institutional Grid Computing , 2006, 2006 International Conference on Parallel Processing (ICPP'06).

[7]  Sanjay Jha,et al.  G-QoSM: Grid Service Discovery Using QoS Properties , 2002, Comput. Artif. Intell..

[8]  Reza Nejabati,et al.  Phosphorus grid-enabled GMPLS control plane (GMPLS): architectures, services, and interfaces , 2008, IEEE Communications Magazine.

[9]  David Abramson,et al.  Scheduling parameter sweep applications on global Grids: a deadline and budget constrained cost–time optimization algorithm , 2005, Softw. Pract. Exp..

[10]  Analysis and Simulation of a Fair Queuing Algorithm , 2008 .

[11]  MurshedManzur,et al.  Scheduling parameter sweep applications on global Grids , 2005 .

[12]  Rajkumar Buyya,et al.  A Negotiation Mechanism for Advance Resource Reservations Using the Alternate Offers Protocol , 2008, 2008 16th Interntional Workshop on Quality of Service.

[13]  Adam Wierzbicki,et al.  Fair Game-Theoretic Resource Management in Dedicated Grids , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[14]  Klara Nahrstedt,et al.  CPU service classes for multimedia applications , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[15]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[16]  Sumit Naiksatam,et al.  Elastic reservations for efficient bandwidth utilization in LambdaGrids , 2007, Future Gener. Comput. Syst..

[17]  R Buyya Dynamic scheduling of parallel jobs with QoS demands in multiclusters and grids , 2004 .

[18]  Dimosthenis Kyriazis,et al.  An innovative workflow mapping mechanism for Grids in the frame of Quality of Service , 2008, Future Gener. Comput. Syst..

[19]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[20]  Bob Briscoe,et al.  Flow rate fairness: dismantling a religion , 2007, CCRV.

[21]  Chuliang Weng,et al.  Heuristic scheduling for bag-of-tasks applications in combination with QoS in the computational grid , 2005, Future Gener. Comput. Syst..

[22]  Rajkumar Buyya,et al.  A taxonomy and survey of grid resource management systems for distributed computing , 2002, Softw. Pract. Exp..

[23]  Nsf Ncr,et al.  A Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The Single Node Case* , 1991 .

[24]  Lior Amar,et al.  An On-line Algorithm for Fair-Share Node Allocations in a Cluster , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[25]  Emmanouel A. Varvarigos,et al.  Profiling Computation Jobs in Grid Systems , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[26]  Scott Shenker,et al.  Integrated Services in the Internet Architecture : an Overview Status of this Memo , 1994 .

[27]  Klara Nahrstedt,et al.  A distributed resource management architecture that supports advance reservations and co-allocation , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).

[28]  Harish Sethu,et al.  On achieving fairness in the joint allocation of processing and bandwidth resources: principles and algorithms , 2005, IEEE/ACM Transactions on Networking.

[29]  David L. Black,et al.  An Architecture for Differentiated Service , 1998 .

[30]  Gregor von Laszewski,et al.  QoS guided Min-Min heuristic for grid task scheduling , 2003, Journal of Computer Science and Technology.

[31]  Emmanouel A. Varvarigos,et al.  Fair Scheduling Algorithms in Grids , 2007, IEEE Transactions on Parallel and Distributed Systems.

[32]  Rajkumar Buyya,et al.  SLA-Based Advance Reservations with Flexible and Adaptive Time QoS Parameters , 2007, ICSOC.

[33]  Leon Gommans,et al.  On advance reservation of heterogeneous network paths , 2005, Future Gener. Comput. Syst..

[34]  Abhay Parekh,et al.  A generalized processor sharing approach to flow control in integrated services networks: the single-node case , 1993, TNET.

[35]  Chris Develder,et al.  Multi-cost job routing and scheduling in Grid networks , 2009, Future Gener. Comput. Syst..