Towards Massive Consolidation in Data Centers with SEaMLESS

In Data Centers (DCs), an abundance of virtual machines (VMs) remain idle due to network services awaiting for incoming connections, or due to established-and-idling sessions. These VMs lead to wastage of RAM – the scarcest resource in DCs – as they lock their allocated memory. In this paper, we introduce SEaMLESS, a solution designed to (i) transform fully-fledged idle VMs into lightweight and resourceless virtual network functions (VNFs), then (ii) reduces the allocated memory to those idle VMs. By replacing idle VMs with VNFs, SEaMLESS provides fast VM restoration upon user activity detection, thereby introducing limited impact on the Quality of Experience (QoE). Our results show that SEaMLESS can consolidate hundreds of VMs as VNFs onto one single machine. SEaMLESS is thus able to release the majority of the memory allocated to idle VMs. This freed memory can then be reassigned to new VMs, or lead to massive consolidation, to enable a better utilization of DC resources.

[1]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[2]  Rajkumar Buyya,et al.  Energy Efficient Resource Management in Virtualized Cloud Data Centers , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[3]  Nelson Luis Saldanha da Fonseca,et al.  Topology-Aware Virtual Machine Placement in Data Centers , 2015, Journal of Grid Computing.

[4]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[5]  Emmanuel Jeannot,et al.  Adding Virtualization Capabilities to the Grid'5000 Testbed , 2012, CLOSER.

[6]  Carlos de Alfonso,et al.  Automatic memory-based vertical elasticity and oversubscription on cloud platforms , 2016, Future Gener. Comput. Syst..

[7]  Fabien Hermenier,et al.  BtrPlace: A Flexible Consolidation Manager for Highly Available Applications , 2013, IEEE Transactions on Dependable and Secure Computing.

[8]  Hari Balakrishnan,et al.  TCP Connection Migration , 2000 .

[9]  S. Durga,et al.  A SURVEY ON ENERGY EFFICIENT SERVER CONSOLIDATION THROUGH VM LIVE MIGRATION , 2012 .

[10]  Irene Zhang,et al.  Optimizing VM Checkpointing for Restore Performance in VMware ESXi , 2013, USENIX Annual Technical Conference.

[11]  Eyal de Lara,et al.  Oasis: energy proportionality with hybrid server consolidation , 2016, EuroSys.

[12]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[13]  Florian Schmidt,et al.  My VM is Lighter (and Safer) than your Container , 2017, SOSP.

[14]  Yan Chen,et al.  QoS Requirements of Network Applications on the Internet , 2004, Inf. Knowl. Syst. Manag..

[15]  Massimo Bernaschi,et al.  SockMi: a solution for migrating TCP/IP connections , 2007, 15th EUROMICRO International Conference on Parallel, Distributed and Network-Based Processing (PDP'07).

[16]  José Antonio Lozano,et al.  Towards a Greener Cloud Infrastructure Management using Optimized Placement Policies , 2015, Journal of Grid Computing.

[17]  Eyal de Lara,et al.  Jettison: efficient idle desktop consolidation with partial VM migration , 2012, EuroSys '12.

[18]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, Cluster Computing.

[19]  Jim Groom,et al.  Docker - Build, Ship, and Run Any App, Anywhere , 2014 .

[20]  Christof Fetzer,et al.  DreamServer: Truly On-Demand Cloud Services , 2014, SYSTOR 2014.

[21]  Gustavo Alonso,et al.  Application level ballooning for efficient server consolidation , 2013, EuroSys '13.

[22]  Umesh Deshpande,et al.  Agile Live Migration of Virtual Machines , 2016, 2016 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[23]  Djamal Zeghlache,et al.  Energy Efficient VM Scheduling for Cloud Data Centers: Exact Allocation and Migration Algorithms , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[24]  Aman Kansal,et al.  Sleepless in Seattle No Longer , 2010, USENIX Annual Technical Conference.

[25]  Kang G. Shin,et al.  LiteGreen: Saving Energy in Networked Desktops Using Virtualization , 2010, USENIX Annual Technical Conference.

[26]  Liang Zhang,et al.  Picocenter: supporting long-lived, mostly-idle applications in cloud environments , 2016, EuroSys.

[27]  Myriana Rifai,et al.  SEaMLESS: a SErvice migration cLoud architecture for energy saving and memory releaSing capabilities , 2017, SoCC.