An optimization of virtual machine selection and placement by using memory content similarity for server consolidation in cloud

Abstract Optimizing the virtual machine (VM) migration is an important issue of server consolidation in the cloud data center. By leveraging the content similarity among the memory of VMs, the time and the amount of transferred data in VM migration, as well as the pressure of network traffic, can be reduced. There are two problems in server consolidation: (1) determining which VMs should be migrated from the overloaded hosts (VM selection problem) and (2) how to place these VMs to the destination hosts (VM placement problem). By exploiting the content similarity, we redefine the above two problems into one problem to minimize the transferred memory data in VM migration. Given a fixed host overloaded threshold, an approximation algorithm is proposed to solve the problem with one overloaded host and one destination host. For the case of multiple overloaded hosts and destination hosts, two heuristic algorithms are presented with fixed and dynamic overloaded threshold respectively. We conduct a real workload trace based simulation to evaluate the performance of our algorithms. The result shows that our algorithms can produce fewer transferred VM memory data and consume less energy than existing policies.

[1]  Helmut Hlavacs,et al.  Dynamic Virtual Machine Consolidation: A Multi Agent Learning Approach , 2015, 2015 IEEE International Conference on Autonomic Computing.

[2]  Tao Zhang,et al.  Tuning the Aggressive TCP Behavior for Highly Concurrent HTTP Connections in Intra-Datacenter , 2017, IEEE/ACM Transactions on Networking.

[3]  Guruh Fajar Shidik,et al.  Improvement of Energy Efficiency at Cloud Data Center Based on Fuzzy Markov Normal Algorithm VM Selection in Dynamic VM Consolidation , 2016 .

[4]  Chunyi Peng,et al.  An empirical analysis of similarity in virtual machine images , 2011, Middleware '11.

[5]  Safraz Rampersaud,et al.  A Sharing-Aware Greedy Algorithm for Virtual Machine Maximization , 2014, 2014 IEEE 13th International Symposium on Network Computing and Applications.

[6]  Steven Hand,et al.  Satori: Enlightened Page Sharing , 2009, USENIX Annual Technical Conference.

[7]  Prashant J. Shenoy,et al.  Sharing-aware algorithms for virtual machine colocation , 2011, SPAA '11.

[8]  Peter Desnoyers,et al.  Memory buddies: exploiting page sharing for smart colocation in virtualized data centers , 2009, VEE '09.

[9]  Mahdi Fahmideh,et al.  Cloud migration process - A survey, evaluation framework, and open challenges , 2016, J. Syst. Softw..

[10]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[11]  Huaglory Tianfield,et al.  Energy-Aware Virtual Machine Consolidation for Cloud Data Centers , 2014, 2014 IEEE/ACM 7th International Conference on Utility and Cloud Computing.

[12]  Jianxin Wang,et al.  Dealing with 4-Variables by Resolution: An Improved MaxSAT Algorithm , 2015, WADS.

[13]  Christine Morin,et al.  Shrinker: Improving Live Migration of Virtual Clusters over WANs with Distributed Data Deduplication and Content-Based Addressing , 2011, Euro-Par.

[14]  Safraz Rampersaud,et al.  Sharing-Aware Online Algorithms for Virtual Machine Packing in Cloud Environments , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[15]  Umesh Deshpande,et al.  Inter-rack live migration of multiple virtual machines , 2012, VTDC '12.

[16]  Yixin Cao,et al.  Approximate association via dissociation , 2015, Discret. Appl. Math..

[17]  George Varghese,et al.  Difference engine , 2010, OSDI.

[18]  Jianer Chen,et al.  Dealing with 4-variables by resolution: An improved MaxSAT algorithm , 2017, Theor. Comput. Sci..

[19]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[20]  Xiaoshu Zhu,et al.  A multi-objective biclustering algorithm based on fuzzy mathematics , 2017, Neurocomputing.

[21]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[22]  Chen Zhou,et al.  Virtual machine selection and placement for dynamic consolidation in Cloud computing environment , 2015, Frontiers of Computer Science.

[23]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[24]  Jianer Chen,et al.  Deeper local search for parameterized and approximation algorithms for maximum internal spanning tree , 2017, Inf. Comput..

[25]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[26]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[27]  Maziar Goudarzi,et al.  Server Consolidation Techniques in Virtualized Data Centers: A Survey , 2017, IEEE Systems Journal.

[28]  Safraz Rampersaud,et al.  A Multi-resource Sharing-Aware Approximation Algorithm for Virtual Machine Maximization , 2015, 2015 IEEE International Conference on Cloud Engineering.

[29]  Yi Pan,et al.  FSQCN: Fast and Simple Quantized Congestion Notification in Data Center Ethernet , 2016, 2016 IEEE 36th International Conference on Distributed Computing Systems (ICDCS).

[30]  Feng Xia,et al.  Virtual machine migration in cloud data centers: a review, taxonomy, and open research issues , 2015, The Journal of Supercomputing.

[31]  Wen J. Li,et al.  Leveraging content similarity among VMI files to allocate virtual machines in cloud , 2018, Future Gener. Comput. Syst..

[32]  Shoubin Dong,et al.  Dynamic VM Consolidation for Energy-Aware and SLA Violation Reduction in Cloud Computing , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[33]  Hui Wang,et al.  Multi-Tiered On-Demand Resource Scheduling for VM-Based Data Center , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[34]  Prashant J. Shenoy,et al.  An Empirical Study of Memory Sharing in Virtual Machines , 2012, USENIX Annual Technical Conference.

[35]  Rajkumar Buyya,et al.  Adaptive threshold-based approach for energy-efficient consolidation of virtual machines in cloud data centers , 2010, MGC '10.

[36]  Hai Jin,et al.  Live Virtual Machine Migration via Asynchronous Replication and State Synchronization , 2011, IEEE Transactions on Parallel and Distributed Systems.