A cost-based multi-unit resource auction for service-oriented grid computing

The application of Grid technology is at the transition from engineering and natural science-related industrial sectors to other industries that have a high demand for computing resources. However, the diffusion of Grid technology within industrial sectors which are not naturally engineering and natural science-related is often hindered by a lack of incentives to share the computational resources. A promising way to overcome these barriers is the introduction of economically inspired mechanisms for the use of Grid-based resources. Our work introduces a iterated cost-based multi-unit resource auction (CMRA) and compares a traditional cost-based accounting approach with dedicated servers as well as a pooling approach with regard to service quality and total costs. The cost-calculus used in our model is based on costs for the delayed processing of jobs and costs for the cancellation of these jobs if the job cannot be provided at a certain time span in the worst case. The simulation results indicate that pooling of IT resources by Grid technology can produce a reduction of 20.3% in cost within this model compared to dedicated servers in the computing centers. However, with the CMRA-based allocation of computing resources, a further 1.4% of cost reduction can be achieved while the achieved quality-of-service (QoS) can be significantly increased. Finally we think that there must be a further cost reduction potential for Grid solutions beyond these savings that can be achieved by using economically inspired allocation methods that are combined with advanced refining and learning methods.

[1]  Michael Schwind,et al.  Dynamic Pricing of Information Products Based on Reinforcement Learning: A Yield-Management Approach , 2002, KI.

[2]  Giorgos Cheliotis,et al.  Architecture requirements for commercializing Grid resources , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[3]  Michael Schwind,et al.  Using Shadow Prices for Resource Allocation in a Combinatorial Grid with Proxy-Bidding Agents , 2016, ICEIS.

[4]  Rajkumar Buyya,et al.  Compute Power Market: towards a market-oriented grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[5]  Michael Schwind,et al.  Dynamic Resource Prices in a Combinatorial Grid System , 2006, The 8th IEEE International Conference on E-Commerce Technology and The 3rd IEEE International Conference on Enterprise Computing, E-Commerce, and E-Services (CEC/EEE'06).

[6]  Christoph H. Loch,et al.  A Punctuated-Equilibrium Model of Technology Diffusion , 1999 .

[7]  M. Schwind Dynamic Pricing and Automated Resource Allocation for Complex Information Services: Reinforcement Learning and Combinatorial Auctions (Lecture Notes in Economics and Mathematical Systems) , 2007 .

[8]  N. Nisan,et al.  Globally distributed computation over the Internet-the POPCORN project , 1998, Proceedings. 18th International Conference on Distributed Computing Systems (Cat. No.98CB36183).

[9]  Tad Hogg,et al.  Spawn: A Distributed Computational Economy , 1992, IEEE Trans. Software Eng..

[10]  Mark Keil,et al.  Understanding software project risk: a cluster analysis , 2004, Inf. Manag..

[11]  Thomas Fahringer,et al.  Grid allocation and reservation - Grid capacity planning with negotiation-based advance reservation for optimized QoS , 2006, SC.

[12]  David Abramson,et al.  Economic models for management of resources in peer-to-peer and grid computing , 2001, SPIE ITCom.

[13]  Richard Wolski,et al.  G-commerce: market formulations controlling resource allocation on the computational grid , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[14]  David Abramson,et al.  A case for economy grid architecture for service oriented grid computing , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[15]  M. Siddiqui,et al.  Grid Capacity Planning with Negotiation-based Advance Reservation for Optimized QoS , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[16]  Rajkumar Buyya,et al.  GridBank: a Grid Accounting Services Architecture (GASA) for distributed systems sharing and integration , 2002, Proceedings International Parallel and Distributed Processing Symposium.