An Efficient Online Placement Scheme for Cloud Container Clusters

Containers represent an agile alternative to virtual machines (VMs), for providing cloud computing services. Containers are more flexible and lightweight, and can be easily instrumented. Enterprise users often create clusters of inter-connected containers to provision complex services. Compared to traditional cloud services, key challenges in container cluster (CC) provisioning lie in the optimal placement of containers while considering inter-container traffic in a CC. The challenge further escalates, when CCs are provisioned in an online fashion. We propose an online algorithm to address the above challenges, aiming to maximize the aggregate value of all served clusters. We first study a one-shot CC placement problem. Leveraging techniques of exhaustive sampling and ST rounding, we design an efficient one-shot algorithm to determine the placement scheme of a given CC. We then propose a primal-dual online placement scheme that employs the one-shot algorithm as a building block to make decisions upon the arrival of each CC request. Through both theoretical analysis and trace-driven simulations, we verify that the online placement algorithm is computationally efficient and achieves a good competitive ratio.

[1]  Phone Lin,et al.  A Kubernetes-Based Monitoring Platform for Dynamic Cloud Resource Provisioning , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[2]  Zongpeng Li,et al.  Dynamic resource provisioning in cloud computing: A randomized auction approach , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[3]  Onur Mutlu,et al.  Gaia: Geo-Distributed Machine Learning Approaching LAN Speeds , 2017, NSDI.

[4]  Xiangke Liao,et al.  Resource stealing: a resource multiplexing method for mix workloads in cloud system , 2015, The Journal of Supercomputing.

[5]  Michael J. Pazzani,et al.  Content-Based Recommendation Systems , 2007, The Adaptive Web.

[6]  Zongpeng Li,et al.  An Online Auction Framework for Dynamic Resource Provisioning in Cloud Computing , 2016, IEEE/ACM Transactions on Networking.

[7]  Zongpeng Li,et al.  An online mechanism for dynamic virtual cluster provisioning in geo-distributed clouds , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[8]  Marek Karpinski,et al.  Polynomial Time Approximation Schemes for Dense Instances of NP-Hard Problems , 1999, J. Comput. Syst. Sci..

[9]  Ishai Menache,et al.  Efficient online scheduling for deadline-sensitive jobs: extended abstract , 2013, SPAA.

[10]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2014, SIGCOMM.

[11]  Ying Wang,et al.  Energy Efficient Virtual Cluster Embedding in Public Data Centers , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[12]  Zongpeng Li,et al.  An Efficient Cloud Market Mechanism for Computing Jobs With Soft Deadlines , 2017, IEEE/ACM Transactions on Networking.

[13]  Moti Medina,et al.  Online Multi-Commodity Flow with High Demands , 2012, WAOA.

[14]  Ye Tao,et al.  Containerized resource provisioning framework for multimedia big data application , 2017, Multimedia Tools and Applications.

[15]  Duan Chen,et al.  Dynamic Network Function Instance Scaling Based on Traffic Forecasting and VNF Placement in Operator Data Centers , 2019, IEEE Transactions on Parallel and Distributed Systems.

[16]  Jie Wu,et al.  Let's stay together: Towards traffic aware virtual machine placement in data centers , 2012, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[17]  Ness B. Shroff,et al.  Online multi-resource allocation for deadline sensitive jobs with partial values in the cloud , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[18]  Jan Mendling,et al.  Optimized Container-Based Process Execution in the Cloud , 2018, OTM Conferences.

[19]  Alan M. Frieze,et al.  A new rounding procedure for the assignment problem with applications to dense graph arrangement problems , 1996, Proceedings of 37th Conference on Foundations of Computer Science.

[20]  Zizhuo Wang,et al.  A Dynamic Near-Optimal Algorithm for Online Linear Programming , 2009, Oper. Res..

[21]  Zongpeng Li,et al.  Online Auctions in IaaS Clouds: Welfare and Profit Maximization With Server Costs , 2015, IEEE/ACM Transactions on Networking.

[22]  Éva Tardos,et al.  An approximation algorithm for the generalized assignment problem , 1993, Math. Program..

[23]  Raouf Boutaba,et al.  Virtual Network Embedding with Coordinated Node and Link Mapping , 2009, IEEE INFOCOM 2009.

[24]  Franck Le,et al.  Online Scaling of NFV Service Chains Across Geo-Distributed Datacenters , 2016, IEEE/ACM Transactions on Networking.

[25]  Zongpeng Li,et al.  An efficient auction mechanism for service chains in the NFV market , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[26]  Swades De,et al.  Joint VNF Placement and CPU Allocation in 5G , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[27]  Joseph Naor,et al.  The Design of Competitive Online Algorithms via a Primal-Dual Approach , 2009, Found. Trends Theor. Comput. Sci..

[28]  Nair Maria Maia de Abreu,et al.  A survey for the quadratic assignment problem , 2007, Eur. J. Oper. Res..

[29]  Dan Li,et al.  Survivable and bandwidth-guaranteed embedding of virtual clusters in cloud data centers , 2016, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.