A Dynamic Virtual Machine Placement and Migration Scheme for Data Centers

We study the problem of virtual machine (VM) placement and migration in a data center. In the current approaches, VMs are assigned to physical servers using on-demand provisioning. Such an approach is simple but it often results in a poor performance due to resource fragmentation. Additionally, sub-optimal VM placement usually generates unneeded VM migration and unnecessary cross network traffic. The efficiency of a datacenter therefore significantly depends on how VMs are provisioned and where they are placed. A good placement scheme will not only improve the quality of service but also reduce the operation cost of the data center. In this paper, we study the problem of optimal VM placement and migration to minimize resource usage and power consumption in a data center. We formulate the optimization problem as a joint multiple objective function and solve it by leveraging the framework of convex optimization. Due to the intractable nature of the combinatorial optimization, we then propose Multi-level Join VM Placement and Migration (MJPM) algorithms based on the relaxed convex optimization framework to approximate the optimal solution. The theoretical analysis demonstrates the effectiveness of our proposed algorithms that substantially increases data center efficiency. In addition, our extensive simulation results on different practical topologies show significant performance improvement over the existing approaches.

[1]  Xiangming Dai,et al.  Energy-Efficient Virtual Machines Scheduling in Multi-Tenant Data Centers , 2016, IEEE Transactions on Cloud Computing.

[2]  Anna Bernasconi,et al.  Introduction to Storage Area Networks , 2003 .

[3]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[4]  Yu Cai,et al.  Dynamic Virtual Machine Placement for Cloud Computing Environments , 2014, 2014 43rd International Conference on Parallel Processing Workshops.

[5]  Martin Bichler,et al.  A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers , 2010, IEEE Transactions on Services Computing.

[6]  Randy H. Katz Network-attached storage systems , 1992, Proceedings Scalable High Performance Computing Conference SHPCC-92..

[7]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[8]  Albert Y. Zomaya,et al.  A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems , 2010, Adv. Comput..

[9]  Thinh P. Nguyen,et al.  Joint virtual machine placement and migration scheme for datacenters , 2014, 2014 IEEE Global Communications Conference.

[10]  M. Korupolu,et al.  Server-storage virtualization: Integration and load balancing in data centers , 2008, 2008 SC - International Conference for High Performance Computing, Networking, Storage and Analysis.

[11]  Sonja Filiposka,et al.  Community-based VM placement framework , 2015, The Journal of Supercomputing.

[12]  Benjamin Hindman,et al.  Dominant Resource Fairness: Fair Allocation of Multiple Resource Types , 2011, NSDI.

[13]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, Cluster Computing.

[14]  Suman Nath,et al.  Energy-Aware Server Provisioning and Load Dispatching for Connection-Intensive Internet Services , 2008, NSDI.

[15]  Johan Tordsson,et al.  Cloud brokering mechanisms for optimized placement of virtual machines across multiple providers , 2012, Future Gener. Comput. Syst..

[16]  M. Newman,et al.  Finding community structure in very large networks. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[17]  Duc A. Tran,et al.  S-PUT: An EA-based framework for socially aware data partitioning , 2014, Comput. Networks.

[18]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[19]  Jie Wu,et al.  Migration-based virtual machine placement in cloud systems , 2013, 2013 IEEE 2nd International Conference on Cloud Networking (CloudNet).

[20]  David S. Johnson,et al.  Bin Packing , 2008, Encyclopedia of Algorithms.

[21]  Hans Kellerer,et al.  The Subset Sum Problem , 2004 .

[22]  Victor C. M. Leung,et al.  Link-Aware Virtual Machine Placement for Cloud Services based on Service-Oriented Architecture , 2020, IEEE Transactions on Cloud Computing.

[23]  Xiaofei Wang,et al.  Dynamic Resource Prediction and Allocation for Cloud Data Center Using the Multiobjective Genetic Algorithm , 2018, IEEE Systems Journal.

[24]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[25]  Danny H. K. Tsang,et al.  M-Convex VM Consolidation: Towards a Better VM Workload Consolidation , 2016, IEEE Transactions on Cloud Computing.

[26]  Michalis Faloutsos,et al.  On power-law relationships of the Internet topology , 1999, SIGCOMM '99.

[27]  Alexandre Hollocou,et al.  A linear streaming algorithm for community detection in very large networks , 2017, ArXiv.

[28]  Zhen Xiao,et al.  Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[29]  Vijay V. Vazirani,et al.  Approximation Algorithms , 2001, Springer Berlin Heidelberg.

[30]  Arun Venkataramani,et al.  Black-box and Gray-box Strategies for Virtual Machine Migration , 2007, NSDI.

[31]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[32]  Deng Pan,et al.  Efficient VM placement with multiple deterministic and stochastic resources in data centers , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[33]  Jing Xu,et al.  Multi-Objective Virtual Machine Placement in Virtualized Data Center Environments , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[34]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[35]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[36]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.