Highly consolidated servers with container-based virtualization

A huge number of inter-connected computers run in data centers. These computers consume large amount of power. Server consolidation with virtualization is a popular method to address this problem. The more computers are consolidated, the more energy is saved. However, highly consolidating, wherein many servers are consolidated into one physical computer, may result in large performance decline. Achieving high consolidation without large performance decline is important. Container-based operating system virtualization is an emerging method for constructing low-overhead virtualized environment. In this work, we focus on Docker, a popular container-based virtualizing system, and investigate its performance, especially performance in highly consolidated environment. First, we compare the performance with and without container-based virtualization, then show that container-based virtualization can provide similar performance to that without virtualization in CPU processing and networking but cannot provide comparable performance in I/O processing with the default setup. Second, we explore the relationship between the number of containers and the obtained performance. We then demonstrate that the I/O performance severely decreases as the number of consolidated servers increase. Third, we discuss the reason why the I/O performance drops largely and applications of highly consolidated servers.

[1]  Erol Gelenbe,et al.  Energy-Efficient Cloud Computing , 2010, Comput. J..

[2]  Saneyasu Yamaguchi,et al.  File Placing Control for Improving the I/O Performance of Hadoop in Virtualized Environment , 2016, 2016 Fourth International Symposium on Computing and Networking (CANDAR).

[3]  Yi Zhong,et al.  State-of-the-art research study for green cloud computing , 2011, The Journal of Supercomputing.

[4]  Saneyasu Yamaguchi,et al.  I/O scheduling in Android devices with flash storage , 2014, ICUIMC '14.

[5]  Chandra Krintz,et al.  Paravirtualization for HPC Systems , 2006, ISPA Workshops.

[6]  Anees Shaikh,et al.  Virtualization-Based Techniques for Enabling Multi-tenant Management Tools , 2007, DSOM.

[7]  Andrea C. Arpaci-Dusseau,et al.  Geiger: monitoring the buffer cache in a virtual machine environment , 2006, ASPLOS XII.

[8]  Daniel Raho,et al.  KVM, Xen and Docker: A performance analysis for ARM based NFV and cloud computing , 2015, 2015 IEEE 3rd Workshop on Advances in Information, Electronic and Electrical Engineering (AIEEE).

[9]  Sherali Zeadally,et al.  A survey and taxonomy on energy efficient resource allocation techniques for cloud computing systems , 2016, Computing.

[10]  Hubertus Franke,et al.  Class-based Prioritized Resource Control in Linux , 2003 .

[11]  Eric W. Biederman,et al.  Multiple Instances of the Global Linux Namespaces , 2010 .

[12]  Lucas Chaufournier,et al.  Containers and Virtual Machines at Scale: A Comparative Study , 2016, Middleware.

[13]  Rami Rosen,et al.  Linux containers and the future cloud , 2014 .

[14]  A. Kivity,et al.  kvm : the Linux Virtual Machine Monitor , 2007 .

[15]  Peng Li.  Centralized and decentralized lab approaches based on different virtualization models , 2010 .

[16]  Saneyasu Yamaguchi,et al.  Host OS page cache hit ratio improvement based on guest OS page drop , 2015, iiWAS.

[17]  Saneyasu Yamaguchi,et al.  Advising cache for lower cache , 2017, IMCOM.

[18]  D. Zarefsky.  The U.S. and the world , 2014 .

[19]  Saneyasu Yamaguchi,et al.  A Server Cache Size Aware Cache Replacement Algorithm for Block Level Network Storage , 2011, 2011 Tenth International Symposium on Autonomous Decentralized Systems.

[20]  Robert N. M. Watson,et al.  Jails: confining the omnipotent root , 2000 .

[21]  Larry L. Peterson,et al.  Container-based operating system virtualization: a scalable, high-performance alternative to hypervisors , 2007, EuroSys '07.

[22]  Saneyasu Yamaguchi,et al.  Improving the I/O Performance in the Reduce Phase of Hadoop , 2015, 2015 Third International Symposium on Computing and Networking (CANDAR).

[23]  Antony I. T. Rowstron,et al.  Software-defined caching: managing caches in multi-tenant data centers , 2015, SoCC.

[24]  Crispin Cowan,et al.  Linux security modules: general security support for the linux kernel , 2002, Foundations of Intrusion Tolerant Systems, 2003 [Organically Assured and Survivable Information Systems].

[25]  Saneyasu Yamaguchi,et al.  Filesystem Layout Reorganization in Virtualized Environment , 2012, 2012 9th International Conference on Ubiquitous Intelligence and Computing and 9th International Conference on Autonomic and Trusted Computing.

[26]  B. Yamini,et al.  Cloud virtualization: A potential way to reduce global warming , 2010, Recent Advances in Space Technology Services and Climate Change 2010 (RSTS & CC-2010).

[27]  Hubertus Franke,et al.  CKRM: Class-based Prioritized Resource Control in Linux , 2003 .

[28]  Benoit des Ligneris,et al.  Virtualization of Linux based computers: the Linux-VServer project , 2005, 19th International Symposium on High Performance Computing Systems and Applications (HPCS'05).

[29]  Daniel Price,et al.  Solaris Zones: Operating System Support for Consolidating Commercial Workloads , 2004, LISA.

[30]  Saurabh Kumar,et al.  Energy Efficient Utilization of Resources in Cloud Computing Systems , 2016 .

[31]  Bill McCarty,et al.  Selinux: NSA's Open Source Security Enhanced Linux , 2004 .

[32]  John Paul Martin,et al.  System Performance Evaluation of Para Virtualization, Container Virtualization, and Full Virtualization Using Xen, OpenVZ, and XenServer , 2014, 2014 Fourth International Conference on Advances in Computing and Communications.

[33]  Dirk Merkel,et al.  Docker: lightweight Linux containers for consistent development and deployment , 2014 .

[34]  Abhishek Chandra,et al.  Does virtualization make disk scheduling passé? , 2010, OPSR.

[35]  Carlos de Alfonso,et al.  Container-based virtual elastic clusters , 2017, J. Syst. Softw..

[36]  Ada Gavrilovska,et al.  On disk I/O scheduling in virtual machines , 2010 .

[37]  Philippe Merle,et al.  Model-Driven Management of Docker Containers , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[38]  Miika Komu,et al.  Hypervisors vs. Lightweight Virtualization: A Performance Comparison , 2015, 2015 IEEE International Conference on Cloud Engineering.

[39]  Peter H. Gum,et al.  System/370 Extended Architecture: Facilities for Virtual Machines , 1983, IBM J. Res. Dev..

[40]  César A. F. De Rose,et al.  A Performance Comparison of Container-Based Virtualization Systems for MapReduce Clusters , 2014, PDP.

[41]  Love H. Seawright,et al.  VM/370 - A Study of Multiplicity and Usefulness , 1979, IBM Syst. J..

[42]  Zhenlin Wang,et al.  Dynamic memory balancing for virtual machines , 2009, OPSR.

[43]  M. Yamada,et al.  An integrated I/O analyzing system for virtualized environment , 2012, 2012 8th International Conference on Computing Technology and Information Management (NCM and ICNIT).

[44]  Jon Watson,et al.  VirtualBox: bits and bytes masquerading as machines , 2008 .

[45]  César A. F. De Rose,et al.  Performance Evaluation of Container-Based Virtualization for High Performance Computing Environments , 2013, 2013 21st Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[46]  Peter Druschel,et al.  Resource containers: a new facility for resource management in server systems , 1999, OSDI '99.