Memory Reclamation and Compression Using Accurate Working Set Size Estimation

Minimizing the total amount of physical memory consumption of the virtual machines (VM) concurrently running on a physical server is a key to improving a hyper visor's consolidation ratio, defined as the maximum number of VMs that can run on a physical server without performance degradation. This paper describes the design, implementation and evaluation of a memory resource manager called Gatun that constantly measures the working set size of each running VM, and exploits this information to make the best of the available physical memory on a physical server. The per-VM working set size information allows Gatun to reclaim only unused physical memory from each running VM without negatively affecting its performance, and to compress the right subset of memory pages for each VM to reduce its memory pressure to the maximal extent possible. Compared with a state-of-the-art commercial hyper visor, Gatun is able to make noticeably more efficient utilization of a virtualized server's physical memory because of its ability to capture and leverage the per-VM working set size information.

[1]  Dharmendra S. Modha,et al.  CAR: Clock with Adaptive Replacement , 2004, FAST.

[2]  Tzi-cker Chiueh,et al.  Working Set-based Physical Memory Ballooning , 2013, ICAC.

[3]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[4]  David A. Padua,et al.  Calculating stack distances efficiently , 2002, MSP/ISMM.

[5]  George Varghese,et al.  Difference engine , 2010, OSDI.

[6]  Tzi-cker Chiueh,et al.  Introspection-based memory de-duplication and migration , 2013, VEE '13.

[7]  Irene Zhang,et al.  Fast restore of checkpointed memory using working set estimation , 2011, VEE '11.

[8]  Song Jiang,et al.  CLOCK-Pro: An Effective Improvement of the CLOCK Replacement , 2005, USENIX Annual Technical Conference, General Track.

[9]  Zhenlin Wang,et al.  Dynamic memory balancing for virtual machines , 2009, OPSR.

[10]  Yingwei Luo,et al.  Low Cost Working Set Size Tracking , 2011, USENIX Annual Technical Conference.

[11]  Steven Hand,et al.  Satori: Enlightened Page Sharing , 2009, USENIX Annual Technical Conference.

[12]  Kai Shen,et al.  Virtual Machine Memory Access Tracing with Hypervisor Exclusive Cache , 2007, USENIX Annual Technical Conference.