An Online Auction Mechanism for Dynamic Virtual Cluster Provisioning in Geo-Distributed Clouds

It is common for cloud users to require clusters of inter-connected virtual machines (VMs) in a geo-distributed IaaS cloud, to run their services. Compared to isolated VMs, key challenges on dynamic virtual cluster (VC) provisioning (computation + communication resources) lie in two folds: (1) optimal placement of VCs and inter-VM traffic routing involve NP-hard problems, which are non-trivial to solve offline, not to mention if an online efficient algorithm is sought; (2) an efficient pricing mechanism is missing, which charges a market-driven price for each VC as a whole upon request, while maximizing system efficiency or provider revenue over the entire span. This paper proposes efficient online auction mechanisms to address the above challenges. We first design SWMOA, a novel online algorithm for dynamic VC provisioning and pricing, achieving truthfulness, individual rationality, computation efficiency, and <inline-formula><tex-math notation="LaTeX">$(1+2\log \mu)$</tex-math><alternatives> <inline-graphic xlink:href="wu-ieq1-2601905.gif"/></alternatives></inline-formula>-competitiveness in social welfare, where <inline-formula><tex-math notation="LaTeX">$\mu$</tex-math><alternatives> <inline-graphic xlink:href="wu-ieq2-2601905.gif"/></alternatives></inline-formula> is related to the problem size. Next, applying a randomized reduction technique, we convert the social welfare maximizing auction into a revenue maximizing online auction, PRMOA, achieving <inline-formula><tex-math notation="LaTeX">$O(\log \mu)$ </tex-math><alternatives><inline-graphic xlink:href="wu-ieq3-2601905.gif"/></alternatives></inline-formula> -competitiveness in provider revenue, as well as truthfulness, individual rationality and computation efficiency. We investigate auction design in different cases of resource cost functions in the system. We validate the efficacy of the mechanisms through solid theoretical analysis and trace-driven simulations.

[1]  Kui Ren,et al.  When cloud meets eBay: Towards effective pricing for cloud computing , 2012, 2012 Proceedings IEEE INFOCOM.

[2]  William Vickrey,et al.  Counterspeculation, Auctions, And Competitive Sealed Tenders , 1961 .

[3]  Mohamed Faten Zhani,et al.  Venice: Reliable virtual data center embedding in clouds , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[4]  Anna R. Karlin,et al.  Competitive auctions , 2006, Games Econ. Behav..

[5]  Zongpeng Li,et al.  A truthful (1-ε)-optimal mechanism for on-demand cloud resource provisioning , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[6]  Stefan Schmid,et al.  Competitive and deterministic embeddings of virtual networks , 2011, Theor. Comput. Sci..

[7]  Zongpeng Li,et al.  Core-Selecting Auctions for Dynamically Allocating Heterogeneous VMs in Cloud Computing , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[8]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2014, SIGCOMM.

[9]  Yossi Azar,et al.  Reducing truth-telling online mechanisms to online optimization , 2003, STOC '03.

[10]  Xiaohua Jia,et al.  Fair Pricing in the Sky: Truthful Frequency Allocation with Dynamic Spectrum Supply , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[11]  Dorgival O. Guedes,et al.  Gatekeeper: Supporting Bandwidth Guarantees for Multi-tenant Datacenter Networks , 2011, WIOV.

[12]  Nikhil R. Devanur,et al.  Primal Dual Gives Almost Optimal Energy-Efficient Online Algorithms , 2014, ACM Trans. Algorithms.

[13]  Rajkumar Buyya,et al.  Power‐aware provisioning of virtual machines for real‐time Cloud services , 2011, Concurr. Comput. Pract. Exp..

[14]  A. Rowstron,et al.  Towards predictable datacenter networks , 2011, SIGCOMM.

[15]  Joseph Naor,et al.  The Design of Competitive Online Algorithms via a Primal-Dual Approach , 2009, Found. Trends Theor. Comput. Sci..

[16]  Aleksander Madry,et al.  Faster approximation schemes for fractional multicommodity flow problems via dynamic graph algorithms , 2010, STOC '10.

[17]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[18]  Zongpeng Li,et al.  Online Auctions in IaaS Clouds: Welfare and Profit Maximization With Server Costs , 2015, IEEE/ACM Transactions on Networking.

[19]  Zongpeng Li,et al.  Dynamic resource provisioning in cloud computing: A randomized auction approach , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[20]  Moti Medina,et al.  Online Multi-Commodity Flow with High Demands , 2012, WAOA.

[21]  Andrew V. Goldberg,et al.  Competitive auctions and digital goods , 2001, SODA '01.

[22]  Antony I. T. Rowstron,et al.  The price is right: towards location-independent costs in datacenters , 2011, HotNets-X.

[23]  Chaitanya Swamy,et al.  Truthful and near-optimal mechanism design via linear programming , 2005, 46th Annual IEEE Symposium on Foundations of Computer Science (FOCS'05).

[24]  Qiang Liu,et al.  Virtual Network Embedding for Evolving Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[25]  Helen J. Wang,et al.  SecondNet: a data center network virtualization architecture with bandwidth guarantees , 2010, CoNEXT.

[26]  Joseph Naor,et al.  Online Primal-Dual Algorithms for Covering and Packing Problems , 2005, ESA.

[27]  Yoav Shoham,et al.  Truth revelation in approximately efficient combinatorial auctions , 2002, EC '99.

[28]  Anees Shaikh,et al.  CloudNaaS: a cloud networking platform for enterprise applications , 2011, SoCC.

[29]  Athanasios V. Vasilakos,et al.  Incentive-Compatible Online Mechanisms for Resource Provisioning and Allocation in Clouds , 2014, 2014 IEEE 7th International Conference on Cloud Computing.

[30]  Raouf Boutaba,et al.  Virtual Network Embedding with Coordinated Node and Link Mapping , 2009, IEEE INFOCOM 2009.

[31]  Ibrahim Matta,et al.  A decomposition-based architecture for distributed virtual network embedding , 2014, DCC '14.

[32]  Zongpeng Li,et al.  An online auction framework for dynamic resource provisioning in cloud computing , 2014, SIGMETRICS '14.

[33]  Jiang Liu,et al.  Adaptive scheme based on status feedback for virtual network mapping , 2011 .

[34]  Jie Wu,et al.  Let's stay together: Towards traffic aware virtual machine placement in data centers , 2012, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.