Fine-Grained, Adaptive Resource Sharing for Real Pay-Per-Use Pricing in Clouds

Cloud computing is characterized by its essentially pay-per-use pricing with elasticity. Typically, the granularity of usage for such pricing is at virtual machine (VM) level in IaaS clouds, e.g., a multiple of machine hours. The elasticity and cost effectiveness in these clouds are primarily achieved through the exploitation of resource virtualization and sharing. However, a majority of applications running on VMs in clouds struggle to fully utilize resources allocated to them. Since co-location granularity is strictly restricted to VM level and resources allocated to VMs are space-shared, the unused resources are apt to be wasted while users are still charged for such wastage. In this paper, we address the problem of fine-grained and adaptive resource sharing for real pay-per-use pricing. To this end, we devise a resource management mechanism as a cost efficiency solution for both users and providers of clouds. The mechanism consists of a container-based resource allocator and a real-usage based pricing scheme. We demonstrate the efficacy of this mechanism via experiments, in Amazon EC2, using two typical workloads in clouds, web services and database services, and a compute-intensive high energy physics application. Our results show that the mechanism can achieve near-optimal cost efficiency.

[1]  Hai Jin,et al.  Towards Optimized Fine-Grained Pricing of IaaS Cloud Platform , 2015, IEEE Transactions on Cloud Computing.

[2]  Abhishek Verma,et al.  Large-scale cluster management at Google with Borg , 2015, EuroSys.

[3]  Luke M. Leslie,et al.  Local Resource Shaper for MapReduce , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[4]  Carlo Curino,et al.  Reservation-based Scheduling: If You're Late Don't Blame Us! , 2014, SoCC.

[5]  Albert Y. Zomaya,et al.  Pareto-Optimal Cloud Bursting , 2014, IEEE Transactions on Parallel and Distributed Systems.

[6]  Zongpeng Li,et al.  Dynamic resource provisioning in cloud computing: A randomized auction approach , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[7]  Y. Oh,et al.  Hadronic description for Omega baryon photoproduction , 2014, 1401.3804.

[8]  Albert Y. Zomaya,et al.  Non-intrusive Slot Layering in Hadoop , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[9]  Albert Y. Zomaya,et al.  Workload Characteristic Oriented Scheduler for MapReduce , 2012, 2012 IEEE 18th International Conference on Parallel and Distributed Systems.

[10]  Rajkumar Buyya,et al.  Reliable Provisioning of Spot Instances for Compute-intensive Applications , 2011, 2012 IEEE 26th International Conference on Advanced Information Networking and Applications.

[11]  Jordi Torres,et al.  Resource-Aware Adaptive Scheduling for MapReduce Clusters , 2011, Middleware.

[12]  Uwe Schwiegelshohn,et al.  A system-centric metric for the evaluation of online job schedules , 2011, J. Sched..

[13]  Marty Humphrey,et al.  Auto-scaling to minimize cost and meet application deadlines in cloud workflows , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[14]  Xiaohui Gu,et al.  CloudScale: elastic resource scaling for multi-tenant cloud systems , 2011, SoCC.

[15]  Hai Jin,et al.  Towards Pay-As-You-Consume Cloud Computing , 2011, 2011 IEEE International Conference on Services Computing.

[16]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[17]  Randy H. Katz,et al.  Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center , 2011, NSDI.

[18]  C. Kesselman,et al.  CyberShake: A Physics-Based Seismic Hazard Model for Southern California , 2011 .

[19]  Dick H. J. Epema,et al.  A Realistic Integrated Model of Parallel System Workloads , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[20]  Daniel S. Katz,et al.  Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking , 2009, Int. J. Comput. Sci. Eng..

[21]  U. Schwiegelshohn MISTA 2009 An Owner-centric Metric for the Evaluation of Online Job Schedules , 2009 .

[22]  Alexandru Iosup,et al.  The Characteristics and Performance of Groups of Jobs in Grids , 2007, Euro-Par.

[23]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[24]  Allen B. Downey,et al.  A parallel workload model and its implications for processor allocation , 1996, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).