On the design of efficient resource allocation mechanisms for grids

In this thesis we consider the problem of providing QoS guarantees to Grid users through advance reservation. Advance reservation mechanisms provide the ability to allocate resources to users based on agreed-upon QoS requirements and increase the predictability of a Grid system, yet incorporating such mechanisms into current Grid environments has proven to be a challenging task due to the resulting resource fragmentation. In view of these observations we have devised efficient scheduling algorithms that support advance reservations. We can organize this thesis in two parts. We first use concepts from computational geometry and efficient data structures to present a framework for tackling the resource fragmentation, and for formulating a suite of scheduling strategies. We also develop efficient implementations of the scheduling algorithms that scale to large Grids. We conduct a comprehensive performance evaluation study using simulation, and we present numerical results to demonstrate that our algorithms perform well across several metrics that reflect both user- and system-specific goals. Advance reservations has also been proposed as one mechanisms to provide Grid resource managers with the ability to co-allocate resources. Co-allocation of resources is one problem that has gained increasing attention due to the emergence of complex applications that require orchestration of resources never envisioned before. In practice, a co-allocation request can be handled manually as a set of individual advance reservations requests. However, such a solution can be computationally expensive and inappropriate for time-sensitive applications. Furthermore, the trend towards more dynamic solutions has emphasized the need for more automatic solutions. As a second contribution, in this thesis we design and develop a co-allocation algorithm that is efficient in co-allocating resources while respecting the atomicity of the co-allocation request and improving user and system performance. This is achieved by quantizing the temporal space and using efficient 2-dimensional balanced search trees. We perform a comparative analysis of our algorithm by means of simulations driven by workloads from real systems and show that our algorithm scales to Grid systems with large number of resources and heavy workloads.

[1]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[2]  Klara Nahrstedt,et al.  A distributed resource management architecture that supports advance reservations and co-allocation , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).

[3]  David A. Thompson,et al.  STATE OF THE ART AND FUTURE TRENDS , 1981 .

[4]  Warren Smith,et al.  Scheduling with advanced reservations , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[5]  Bu-Sung Lee,et al.  Resource Co-allocation for Parallel Tasks in Computational Grids , 2003, CLADE.

[6]  Borja Sotomayor,et al.  Enabling Cost-Effective Resource Leases with Virtual Machines , 2007 .

[7]  Yufeng Xin,et al.  PCE Based Grid Networking , 2007, 2007 12th IEEE Symposium on Computers and Communications.

[8]  Robert L. Henderson,et al.  Job Scheduling Under the Portable Batch System , 1995, JSSPP.

[9]  George N. Rouskas,et al.  On the Design of Online Scheduling Algorithms for Advance Reservations and QoS in Grids , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[10]  Rajkumar Buyya,et al.  The Gridbus toolkit for service oriented grid and utility computing: an overview and status report , 2004, 1st IEEE International Workshop on Grid Economics and Business Models, 2004. GECON 2004..

[11]  Albert Mo Kim Cheng,et al.  Multisite co-allocation algorithms for computational grid , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[12]  Johan Tordsson,et al.  A Grid Resource Broker Supporting Advance Reservations and Benchmark-Based Resource Selection , 2004, PARA.

[13]  Jörg Schneider,et al.  Heuristic Scheduling of Grid Workflows Supporting Co-Allocation and Advance Reservation , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[14]  José M. Alonso,et al.  Towards On-Demand Ubiquitous Metascheduling on Computational Grids , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[15]  M. Siddiqui,et al.  Grid Capacity Planning with Negotiation-based Advance Reservation for Optimized QoS , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[16]  Warren Smith,et al.  A Resource Management Architecture for Metacomputing Systems , 1998, JSSPP.

[17]  Uwe Schwiegelshohn,et al.  Parallel Job Scheduling - A Status Report , 2004, JSSPP.

[18]  Daniel S. Katz,et al.  A comparison of two methods for building astronomical image mosaics on a grid , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[19]  Carl Kesselman,et al.  Real-time analysis, visualization, and steering of microtomography experiments at photon sources , 2000 .

[20]  Shikharesh Majumdar,et al.  Impact of laxity on scheduling with advance reservations in grids , 2005, 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[21]  Marc Spraragen,et al.  Simplifying construction of complex workflows for non-expert users of the Southern California Earthquake Center Community Modeling Environment , 2005, SGMD.

[22]  Richard M. Karp,et al.  On the Price of Heterogeneity in Parallel Systems , 2006, SPAA '06.

[23]  Mark J. Clement,et al.  Core Algorithms of the Maui Scheduler , 2001, JSSPP.

[24]  Daniel M. Dias,et al.  Service-Level Agreements and Commercial Grids , 2003, IEEE Internet Comput..

[25]  John F. Karpovich,et al.  The Legion Resource Management System , 1999, JSSPP.

[26]  C. Kesselman,et al.  Performance Impact of Resource Provisioning on Workflows , 2005 .

[27]  Ian T. Foster,et al.  Resource co-allocation in computational grids , 1999, Proceedings. The Eighth International Symposium on High Performance Distributed Computing (Cat. No.99TH8469).

[28]  Abhijit Bose,et al.  MARS: a metascheduler for distributed resources in campus grids , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[29]  Sara J. Graves,et al.  LINKED ENVIRONMENTS FOR ATMOSPHERIC DISCOVERY (LEAD): A CYBERINFRASTRUCTURE FOR MESOSCALE METEOROLOGY RESEARCH AND EDUCATION , 2004 .

[30]  David Abramson,et al.  The Grid Economy , 2005, Proceedings of the IEEE.

[31]  Howard Jay Siegel,et al.  Techniques for mapping tasks to machines in heterogeneous computing systems , 2000, J. Syst. Archit..

[32]  Rizos Sakellariou,et al.  Advance Reservation Policies for Workflows , 2006, JSSPP.

[33]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[34]  Carl Kesselman,et al.  A provisioning model and its comparison with best-effort for performance-cost optimization in grids , 2007, HPDC '07.

[35]  Jin-Soo Kim,et al.  A dynamic grid services deployment mechanism for on-demand resource provisioning , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[36]  Zhou Lei,et al.  The portable batch scheduler and the maui scheduler on linux clusters , 2000 .

[37]  Tak Wah Lam,et al.  Non-migratory online deadline scheduling on multiprocessors , 2004, SODA '04.

[38]  R. V. van Nieuwpoort,et al.  The Grid 2: Blueprint for a New Computing Infrastructure , 2003 .

[39]  Muthucumaru Maheswaran,et al.  SCHEDULING ADVANCE RESERVATIONS WITH PRIORITIES IN GRID COMPUTING SYSTEMS , 2001 .

[40]  Radu Prodan,et al.  Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[41]  Francine Berman,et al.  A study of deadline scheduling for client-server systems on the Computational Grid , 2001, Proceedings 10th IEEE International Symposium on High Performance Distributed Computing.

[42]  Rajkumar Buyya,et al.  A taxonomy and survey of grid resource management systems for distributed computing , 2002, Softw. Pract. Exp..

[43]  Anca I. D. Bucur,et al.  Scheduling Policies for Processor Coallocation in Multicluster Systems , 2007, IEEE Transactions on Parallel and Distributed Systems.

[44]  Carl Kesselman,et al.  GriPhyN and LIGO, building a virtual data Grid for gravitational wave scientists , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[45]  T. Röblitz,et al.  Elastic Grid Reservations with User-Defined Optimization Policies , 2004 .

[46]  Eddy Caron,et al.  Deadline scheduling with priority for client-server systems on the grid , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[47]  Denis Trystram,et al.  Analysis of Scheduling Algorithms with Reservations , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[48]  Dang Minh Quan,et al.  On Architecture for SLA-Aware Workflows in Grid Environments , 2005, AINA.

[49]  Vipin Kumar,et al.  Information power grid: The new frontier in parallel computing? , 1999, IEEE Concurr..

[50]  Viktor K. Prasanna,et al.  Run-time adaptation for grid environments , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[51]  Ian Foster,et al.  A quality of service architecture that combines resource reservation and application adaptation , 2000, 2000 Eighth International Workshop on Quality of Service. IWQoS 2000 (Cat. No.00EX400).

[52]  Dean Kuo,et al.  Advance reservation and co-allocation protocol for grid computing , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[53]  Chunming Qiao,et al.  Efficient burst scheduling algorithms in optical burst-switched networks using geometric techniques , 2004, IEEE Journal on Selected Areas in Communications.

[54]  Uwe Schwiegelshohn,et al.  Theory and Practice in Parallel Job Scheduling , 1997, JSSPP.

[55]  Thomas Röblitz,et al.  Resource reservations with fuzzy requests , 2006, Concurr. Comput. Pract. Exp..

[56]  Adrian Farrel,et al.  A Path Computation Element (PCE)-Based Architecture , 2006, RFC.

[57]  Rajkumar Buyya,et al.  Grid Simulation Infrastructure Supporting Advance Reservation , 2004 .

[58]  Ali Afzal,et al.  Making the Grid Predictable through Reservations and Performance Modelling , 2005, Comput. J..

[59]  Uwe Schwiegelshohn,et al.  On Advantages of Grid Computing for Parallel Job Scheduling , 2002, 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'02).

[60]  Sathish S. Vadhiyar,et al.  A metascheduler for the Grid , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[61]  Viktor K. Prasanna,et al.  A framework for mapping with resource co-allocation in heterogeneous computing systems , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[62]  Kaizar Amin,et al.  Analysis and Provision of QoS for Distributed Grid Applications , 2004, Journal of Grid Computing.