Risk Aware Resource Allocation for Clouds

Cloud computing offers on-demand access to large-scale computing resources in a pay-as-you go manner. Market-based resource allocation mechanisms are gaining popularity among commercial cloud providers to deal with dynamically fluctuating resource demands. For example, the recently introduced Amazon EC2 spot instances allow users to bid for computing resources and thus control the cost vs. reliability trade-offs of their workloads. Although this promises significant cost reduction, it comes at an additional risk of price fluctuation. This will get worse as cloud computing gradually moves towards a free market system. We propose a novel approach that utilizes financial option theory to simultaneously mitigate risk and minimize cost for cloud users. We formulate the cloud user optimization problem and mathematically characterize the cost of using European style options for clouds. We also propose a novel on-line policy using American options that outperforms base-line spot policies in terms of price variance reduction against high risk factors. We present trace-driven simulation experiments to support our results.

[1]  E. Fama EFFICIENT CAPITAL MARKETS: A REVIEW OF THEORY AND EMPIRICAL WORK* , 1970 .

[2]  F. Black,et al.  The Pricing of Options and Corporate Liabilities , 1973, Journal of Political Economy.

[3]  S. Ross,et al.  Option pricing: A simplified approach☆ , 1979 .

[4]  P. Boyle Option Valuation Using a Three Jump Process , 1986 .

[5]  Miron Livny,et al.  Condor-a hunter of idle workstations , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[6]  J. Hull Options, Futures, and Other Derivatives , 1989 .

[7]  Frank Kelly,et al.  Rate control for communication networks: shadow prices, proportional fairness and stability , 1998, J. Oper. Res. Soc..

[8]  Amin Vahdat,et al.  SHARP: an architecture for secure resource peering , 2003, SOSP '03.

[9]  David E. Culler,et al.  A blueprint for introducing disruptive technology into the Internet , 2003, CCRV.

[10]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[11]  Chaki Ng,et al.  Mirage: a microeconomic resource allocation system for sensornet testbeds , 2005, The Second IEEE Workshop on Embedded Networked Sensors, 2005. EmNetS-II..

[12]  Daniel Grosu,et al.  Auctioning resources in Grids: model and protocols: Research Articles , 2006 .

[13]  David Allenotor,et al.  A novel application of option pricing to distributed resources management , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[14]  Verena Kantere,et al.  An Economic Model for Self-Tuned Cloud Caching , 2009, 2009 IEEE 25th International Conference on Data Engineering.

[15]  Rajkumar Buyya,et al.  Market-Oriented Cloud Computing: Vision, Hype, and Reality of Delivering Computing as the 5th Utility , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[16]  Rajkumar Buyya,et al.  Cloudbus Toolkit for Market-Oriented Cloud Computing , 2009, CloudCom.

[17]  Andrew V. Goldberg,et al.  Quincy: fair scheduling for distributed computing clusters , 2009, SOSP '09.

[18]  Asser N. Tantawi,et al.  See Spot Run: Using Spot Instances for MapReduce Workflows , 2010, HotCloud.

[19]  Daniel Grosu,et al.  Combinatorial Auction-Based Allocation of Virtual Machine Instances in Clouds , 2010, CloudCom.

[20]  Thomas A. Henzinger,et al.  FlexPRICE: Flexible Provisioning of Resources in a Cloud Environment , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[21]  Artur Andrzejak,et al.  Reducing Costs of Spot Instances via Checkpointing in the Amazon Elastic Compute Cloud , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[22]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[23]  Artur Andrzejak,et al.  Decision Model for Cloud Computing under SLA Constraints , 2010, 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[24]  Arkady Kanevsky,et al.  Enabling a marketplace of clouds: VMware's vCloud director , 2010, OPSR.

[25]  Shie Mannor,et al.  Resource Allocation with Supply Adjustment in Distributed Computing Systems , 2010, 2010 IEEE 30th International Conference on Distributed Computing Systems.

[26]  Asuman E. Ozdaglar,et al.  Socially optimal pricing of cloud computing resources , 2011, VALUETOOLS.

[27]  Raouf Boutaba,et al.  Dynamic Resource Allocation for Spot Markets in Clouds , 2011, Hot-ICE.

[28]  Alex Delis,et al.  Flexible use of cloud resources through profit maximization and price discrimination , 2011, 2011 IEEE 27th International Conference on Data Engineering.

[29]  Costas Courcoubetis,et al.  Economic Issues in Shared Infrastructures , 2009, IEEE/ACM Transactions on Networking.