High occupancy resource allocation for grid and cloud systems, a study with DRIVE

Economic models have long been advocated as a means of efficient resource allocation, however they are often criticized due to a lack of performance and high overheads. The widespread adoption of utility computing models as seen in commercial Cloud providers has re-motivated the need for economic allocation mechanisms. The aim of this work is to address some of the performance limitations of existing economic allocation models, by reducing the failure/reallocation rate, increasing occupancy and thereby increasing the obtainable utilization of the system. This paper is a study of high performance resource utilization strategies that can be employed in Grid and Cloud systems. In particular we have implemented and quantified the results for strategies including overbooking, advanced reservation, justin-time bidding and using substitute providers for service delivery. These strategies are analyzed in a meta-scheduling context using synthetic workloads derived from a production Grid trace to quantify the performance benefits obtained.

[1]  Barry C. Smith,et al.  Yield Management at American Airlines , 1992 .

[2]  M. Siddiqui,et al.  Grid Capacity Planning with Negotiation-based Advance Reservation for Optimized QoS , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[3]  Rajkumar Buyya,et al.  SLA-Based Advance Reservations with Flexible and Adaptive Time QoS Parameters , 2007, ICSOC.

[4]  Mark J. Clement,et al.  Aggressive telecommunications overbooking ratios , 2004, IEEE International Conference on Performance, Computing, and Communications, 2004.

[5]  André Brinkmann,et al.  The Gain of Overbooking , 2009, JSSPP.

[6]  Donald F. Ferguson,et al.  The WS-Resource Framework , 2004 .

[7]  Kris Bubendorfer,et al.  Fine Grained Resource Reservation in Open Grid Economies , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[8]  Ali Afzal,et al.  Making the Grid Predictable through Reservations and Performance Modelling , 2005, Comput. J..

[9]  Dirk Neumann,et al.  SORMA - Building an Open Grid Market for Grid Resource Allocation , 2007, GECON.

[10]  Chaochang Chiu,et al.  The Optimal Airline Overbooking Strategy Under Uncertainties , 2004, KES.

[11]  Michael P. Wellman.  A Market-Oriented Programming Environment and its Application to Distributed Multicommodity Flow Problems , 1993, J. Artif. Intell. Res..

[12]  Tad Hogg,et al.  Spawn: A Distributed Computational Economy , 1992, IEEE Trans. Software Eng..

[13]  Klara Nahrstedt,et al.  A distributed resource management architecture that supports advance reservations and co-allocation , 1999, 1999 Seventh International Workshop on Quality of Service. IWQoS'99. (Cat. No.98EX354).

[14]  Thomas Meinl,et al.  Advance Reservation of Grid Resources via Real Options , 2008, 2008 10th IEEE Conference on E-Commerce Technology and the Fifth IEEE Conference on Enterprise Computing, E-Commerce and E-Services.

[15]  Ian T. Foster.  Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, NPC.

[16]  Ali Hortaçsu,et al.  Economic Insights from Internet Auctions , 2004 .

[17]  Jennifer M. Schopf,et al.  PBS Pro: Grid computing and scheduling attributes , 2004 .

[18]  K. Chard,et al.  Using Secure Auctions to Build a Distributed Metascheduler for the Grid , 2009 .

[19]  Alexandru Iosup,et al.  The Grid Workloads Archive , 2008, Future Gener. Comput. Syst..

[20]  Rajkumar Buyya,et al.  Managing Cancellations and No-Shows of Reservations with Overbooking to Increase Resource Revenue , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[21]  George N. Rouskas,et al.  Efficient resource management using advance reservations for heterogeneous Grids , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[22]  A. Roth,et al.  Last-Minute Bidding and the Rules for Ending Second-Price Auctions: Evidence from eBay and Amazon Auctions on the Internet , 2002 .

[23]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[24]  Richard Fikes,et al.  Enterprise a Market-Like Task Scheduler for Distributed Computing Environments , 2011 .

[25]  Janakiram Subramanian,et al.  Airline Yield Management with Overbooking, Cancellations, and No-Shows , 1999, Transp. Sci..

[26]  Yoshinori Suzuki,et al.  An empirical analysis of the optimal overbooking policies for US major airlines , 2002 .

[27]  Kyle Chard,et al.  A Distributed Economic Meta-scheduler for the Grid , 2008, 2008 Eighth IEEE International Symposium on Cluster Computing and the Grid (CCGRID).

[28]  Ivan E. Sutherland,et al.  A futures market in computer time , 1968, Commun. ACM.