Using live virtual machine migration to improve resource efficiency in virtualized data centers

Efficient resource management is still an open problem in data centers. Although there has been continued improvement in the performance of such large scale systems, the improvements have been mostly at the expense of adding more servers to the system; increasing space requirements and power consumption sometimes without making an effort to better utilize available resources. Modern data centers are growing at a such high pace that space and power consumption are becoming limiting factors. Virtualization has the potential to address these limitations by increasing resource efficiency throughout the data center. Because hardware resources are being shared by different virtual machines (VM), it is important that the placement of a VM in a physical host does not degrade the performance the overall system. In this thesis, we are focused analyzing the benefits that live VM migration can have on virtualized data centers. Specifically, it is our goal to develop a robust VM migration framework that can be used to improve resource efficiency throughout the data center. In this thesis we propose a metric that we can accurately quantify the load of a virtualized enterprise server. We demonstrate how this metric can be used to load balance a entire system. We also consider extension to our framework to consider reducing power consumption.

[1]  Frank Bellosa,et al.  Balancing power consumption in multiprocessor systems , 2006, EuroSys.

[2]  Albert Y. Zomaya,et al.  A task-based adaptive TTL approach for Web server load balancing , 2005, 10th IEEE Symposium on Computers and Communications (ISCC'05).

[3]  Karsten Schwan,et al.  VirtualPower: coordinated power management in virtualized enterprise systems , 2007, SOSP.

[4]  Hua Chen,et al.  Load Balancing in Server Consolidation , 2009, 2009 IEEE International Symposium on Parallel and Distributed Processing with Applications.

[5]  Xuejun Yang,et al.  A General Metric of Load Balancing in delta-Range , 2003, APPT.

[6]  Hoon Choi,et al.  Virtual machine migration in self-managing virtualized server environments , 2009, 2009 11th International Conference on Advanced Communication Technology.

[7]  Rohit Gupta,et al.  A Two Stage Heuristic Algorithm for Solving the Server Consolidation Problem with Item-Item and Bin-Item Incompatibility Constraints , 2008, 2008 IEEE International Conference on Services Computing.

[8]  Mor Harchol-Balter,et al.  Exploiting process lifetime distributions for dynamic load balancing , 1995, SIGMETRICS.

[9]  Leonard Kleinrock,et al.  Queueing Systems: Volume I-Theory , 1975 .

[10]  Renato J. O. Figueiredo,et al.  Experimental Study of Virtual Machine Migration in Support of Reservation of Cluster Resources , 2007, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing (VTDC '07).

[11]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[12]  Ludmila Cherkasova,et al.  XenMon: QoS Monitoring and Performance Profiling Tool , 2005 .

[13]  Kartik Gopalan,et al.  Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning , 2009, VEE '09.

[14]  Yellu Sreenivasulu,et al.  FAST TRANSPARENT MIGRATION FOR VIRTUAL MACHINES , 2014 .

[15]  Ali R. Hurson,et al.  Scheduling and Load Balancing in Parallel and Distributed Systems , 1995 .

[16]  Reinhold Weicker,et al.  Dhrystone: a synthetic systems programming benchmark , 1984, CACM.

[17]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[18]  Domenico Ferrari,et al.  A Load Index for Dynamic Load Balancing , 1986, FJCC.

[19]  Salim Hariri,et al.  Autonomic Computing: An Overview , 2004, UPP.

[20]  Aameek Singh,et al.  Shares and utilities based power consolidation in virtualized server environments , 2009, 2009 IFIP/IEEE International Symposium on Integrated Network Management.

[21]  Karthick Rajamani,et al.  A performance-conserving approach for reducing peak power consumption in server systems , 2005, ICS '05.

[22]  Brian D. Noble,et al.  When Virtual Is Better Than Real , 2001 .

[23]  M. Rosenblum,et al.  Optimizing the migration of virtual computers , 2002, OSDI '02.

[24]  Luiz De Rose,et al.  Detecting Application Load Imbalance on High End Massively Parallel Systems , 2007, Euro-Par.

[25]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[26]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[27]  Robert P. Goldberg,et al.  Survey of virtual machine research , 1974, Computer.

[28]  Willy Zwaenepoel,et al.  Diagnosing performance overheads in the xen virtual machine environment , 2005, VEE '05.

[29]  Pamela H. Vance,et al.  Knapsack Problems: Algorithms and Computer Implementations (S. Martello and P. Toth) , 1993, SIAM Rev..

[30]  Frank Bellosa,et al.  Energy Management for Hypervisor-Based Virtual Machines , 2007, USENIX Annual Technical Conference.

[31]  Domenico Ferrari,et al.  An Empirical Investigation of Load Indices for Load Balancing Applications , 1987, Performance.

[32]  Andrew Sohn,et al.  Autonomous learning for efficient resource utilization of dynamic VM migration , 2008, ICS '08.

[33]  Peter Desnoyers,et al.  Memory buddies: exploiting page sharing for smart colocation in virtualized data centers , 2009, VEE '09.

[34]  Mahadev Satyanarayanan,et al.  Internet suspend/resume , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[35]  Joris Slegers,et al.  Dynamic Server Allocation for Power and Performance , 2008, SIPEW.

[36]  Amin Vahdat,et al.  Enforcing Performance Isolation Across Virtual Machines in Xen , 2006, Middleware.

[37]  Domenico Ferrari,et al.  An Experimental Study of Load Balancing Performance , 1987 .

[38]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[39]  Andrzej Kochut,et al.  On Strategies for Dynamic Resource Management in Virtualized Server Environments , 2007, 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[40]  Hai Jin,et al.  Magnet: A novel scheduling policy for power reduction in cluster with virtual machines , 2008, 2008 IEEE International Conference on Cluster Computing.

[41]  Dejan S. Milojicic,et al.  Process migration , 1999, ACM Comput. Surv..

[42]  Anoop Gupta,et al.  Complete computer system simulation: the SimOS approach , 1995, IEEE Parallel Distributed Technol. Syst. Appl..

[43]  Scott Devine,et al.  Disco: running commodity operating systems on scalable multiprocessors , 1997, TOCS.

[44]  Gil Neiger,et al.  Intel virtualization technology , 2005, Computer.