HARV: Harnessing hybrid virtualization to improve instance (re)usage in public cloud

In the public cloud market, there has been a constant battle over the billing options of the cloud instances between their providers and their users. The users generally have to pay for the entire billing cycle even on fractional usage. Ideally, the residual life-cycles should be resalable by the users, which demands efficient resource consolidation and multiplexing; otherwise, the revenue and use cases are confined by the transient nature of the instances. This paper presents HARV, a novel cloud service that facilitates the management and trade of cloud instances through a third-party platform to run buyers' tasks. The platform relies on hybrid virtualization, an infrastructure layout integrating both the hypervisor-based virtualization and lightweight containerization. It further incorporates a truthful online auction mechanism for instance trading and resource allocation. Our design achieves efficient resource consolidation with no need for provider-level support, and we have deployed a prototype of HARV on the Amazon EC2 public cloud. Our evaluations on both micro-benchmarks and real-life workloads reveal that applications experience negligible performance overhead when hosted on HARV. Trace-driven simulations further show that HARV can achieve substantial cost savings.

[1]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[2]  Azer Bestavros,et al.  Toward an Open Cloud Marketplace: Vision and First Steps , 2014, IEEE Internet Computing.

[3]  Wu Chou,et al.  A REST Service Framework for Fine-Grained Resource Management in Container-Based Cloud , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[4]  Baochun Li,et al.  Dynamic Cloud Resource Reservation via Cloud Brokerage , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[5]  Yang Song,et al.  Optimal bidding in spot instance market , 2012, 2012 Proceedings IEEE INFOCOM.

[6]  Liang Zheng,et al.  How to Bid the Cloud , 2015, Comput. Commun. Rev..

[7]  Nikhil R. Devanur,et al.  Primal Dual Gives Almost Optimal Energy Efficient Online Algorithms , 2014, SODA.

[8]  Wentong Cai,et al.  Dynamic Bin Packing for On-Demand Cloud Resource Allocation , 2016, IEEE Transactions on Parallel and Distributed Systems.

[9]  Ian A. Kash,et al.  Pricing the Cloud , 2016, IEEE Internet Computing.

[10]  Asser N. Tantawi,et al.  See Spot Run: Using Spot Instances for MapReduce Workflows , 2010, HotCloud.

[11]  Djamal Zeghlache,et al.  Minimum Cost Maximum Flow Algorithm for Dynamic Resource Allocation in Clouds , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[12]  Rajkumar Buyya,et al.  Revenue Maximization Using Adaptive Resource Provisioning in Cloud Computing Environments , 2012, 2012 ACM/IEEE 13th International Conference on Grid Computing.

[13]  Ryszard Kowalczyk,et al.  Towards Efficient and Truthful Market Mechanisms for Double-Sided Cloud Markets , 2017, IEEE Transactions on Services Computing.

[14]  Zongpeng Li,et al.  Online Auctions in IaaS Clouds: Welfare and Profit Maximization With Server Costs , 2015, IEEE/ACM Transactions on Networking.

[15]  Feng Wang,et al.  Measurement and utilization of customer-provided resources for cloud computing , 2012, 2012 Proceedings IEEE INFOCOM.

[16]  Nasir Ghani,et al.  Optimizing Cloud-Service Performance: Efficient Resource Provisioning via Optimal Workload Allocation , 2017, IEEE Transactions on Parallel and Distributed Systems.

[17]  Zongpeng Li,et al.  Dynamic resource provisioning in cloud computing: A randomized auction approach , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[18]  Prateek Sharma,et al.  SpotCheck: designing a derivative IaaS cloud on the spot market , 2015, EuroSys.

[19]  Muli Ben-Yehuda,et al.  The Turtles Project: Design and Implementation of Nested Virtualization , 2010, OSDI.

[20]  T. V. Lakshman,et al.  Online Allocation of Virtual Machines in a Distributed Cloud , 2017, IEEE/ACM Transactions on Networking.

[21]  Haiying Shen,et al.  Consolidating complementary VMs with spatial/temporal-awareness in cloud datacenters , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[22]  Eui-nam Huh,et al.  Refundable Service through Cloud Brokerage , 2013, 2013 IEEE Sixth International Conference on Cloud Computing.

[23]  Muli Ben-Yehuda,et al.  The rise of RaaS: the resource-as-a-service cloud , 2014, CACM.

[24]  Zhi Liu,et al.  Embark: Securely Outsourcing Middleboxes to the Cloud , 2016, NSDI.

[25]  Hakim Weatherspoon,et al.  The Xen-Blanket: virtualize once, run everywhere , 2012, EuroSys '12.

[26]  Bingsheng He,et al.  F2C: Enabling Fair and Fine-Grained Resource Sharing in Multi-Tenant IaaS Clouds , 2016, IEEE Transactions on Parallel and Distributed Systems.

[27]  Hai Jin,et al.  Towards Optimized Fine-Grained Pricing of IaaS Cloud Platform , 2015, IEEE Transactions on Cloud Computing.

[28]  Siani Pearson,et al.  Privacy, Security and Trust Issues Arising from Cloud Computing , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[29]  Shuchi Chawla,et al.  Multi-parameter mechanism design and sequential posted pricing , 2010, BQGT.

[30]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2014, SIGCOMM.