Joint Optimization of Server and Network Resource Utilization in Cloud Data Centers

Virtual machine placement is a key component of cloud resource management, which may affect network bandwidth allocation. In this paper, we revisit the virtual machine placement problem in cloud data centers and aim to maximize the overall resource utilization in multiple dimensions, while ensuring that the resource constraints on both the server such as CPU capacity and the network such as bandwidth are not violated. We model the bandwidth-guaranteed virtual machine placement problem and prove its NP-hardness, and design offline and online algorithms to solve the problem. We first consider the offline version and develop approximation algorithms with bounded performance ratios for both the homogeneous and the heterogeneous cases. Then, for the online version, we propose simple and efficient heuristics based on the insights from the offline algorithm design. Comprehensive experimental results verify that the overall resource utilization can be significantly improved by applying our proposals.

[1]  Zoltán Ádám Mann,et al.  Allocation of Virtual Machines in Cloud Data Centers—A Survey of Problem Models and Optimization Algorithms , 2015, ACM Comput. Surv..

[2]  吴杰,et al.  User-Controlled Security Mechanism in Data-Centric Clouds , 2015 .

[3]  Rolf Stadler,et al.  Resource Management in Clouds: Survey and Research Challenges , 2015, Journal of Network and Systems Management.

[4]  Leah Epstein,et al.  On-Line Maximizing the Number of Items Packed in Variable-Sized Bins , 2002, Acta Cybern..

[5]  Ying Zhang,et al.  Providing bandwidth guarantees, work conservation and low latency simultaneously in the cloud , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[6]  Arun Venkataramani,et al.  Black-box and Gray-box Strategies for Virtual Machine Migration , 2007, NSDI.

[7]  Lin Wang,et al.  Power-efficient assignment of virtual machines to physical machines , 2016, Future Gener. Comput. Syst..

[8]  Jie Wu,et al.  Reducing Power Consumption in Data Centers by Jointly Considering VM Placement and Flow Scheduling , 2015, J. Interconnect. Networks.

[9]  Naisargi Patel,et al.  VM placement of multidimensional resources using cartesian coordinates based approach , 2015, 2015 5th Nirma University International Conference on Engineering (NUiCONE).

[10]  Fabrizio Petrini,et al.  k-ary n-trees: high performance networks for massively parallel architectures , 1997, Proceedings 11th International Parallel Processing Symposium.

[11]  Arun Venkataramani,et al.  Sandpiper: Black-box and gray-box resource management for virtual machines , 2009, Comput. Networks.

[12]  Anirudha Sahoo,et al.  On Theory of VM Placement: Anomalies in Existing Methodologies and Their Mitigation Using a Novel Vector Based Approach , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[13]  Jie Wu,et al.  Multi-resource energy-efficient routing in cloud data centers with network-as-a-service , 2015, 2015 IEEE Symposium on Computers and Communication (ISCC).

[14]  Christopher Thraves,et al.  Power-efficient assignment of virtual machines to physical machines , 2013, Future Gener. Comput. Syst..

[15]  Srikanth Kandula,et al.  Multi-resource packing for cluster schedulers , 2014, SIGCOMM.

[16]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[17]  Brian J. Watson,et al.  Autonomic Virtual Machine Placement in the Data Center , 2008 .

[18]  Athanasios V. Vasilakos,et al.  GreenDCN: A General Framework for Achieving Energy Efficiency in Data Center Networks , 2013, IEEE Journal on Selected Areas in Communications.

[19]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[20]  Hans Kellerer,et al.  An approximation algorithm with absolute worst-case performance ratio 2 for two-dimensional vector packing , 2003, Oper. Res. Lett..

[21]  Richard M. Karp,et al.  Theoretical Improvements in Algorithmic Efficiency for Network Flow Problems , 1972, Combinatorial Optimization.

[22]  Joan Boyar,et al.  The Accommodating Function - A Generalization of the Competitive Ratio , 1999, WADS.

[23]  Athanasios V. Vasilakos,et al.  Joint virtual machine assignment and traffic engineering for green data center networks , 2014, PERV.

[24]  Lin Wang,et al.  Joint Optimization of Operational Cost and Performance Interference in Cloud Data Centers , 2014, IEEE Transactions on Cloud Computing.