Customer-oriented diagnosis of memory provisioning for IaaS clouds

Infrastructure-as-a-service clouds enable customers to use computing resources in a flexible manner to satisfy their needs, and pay only for the allocated resources. One challenge for IaaS customers is the correct provisioning of their resources. Many users end up underprovisioning, hurting application performance, or overprovisioning, paying for resources that are not really necessary. Memory is an essential resource for any computing system, and is frequently a nperformance-limiting factor in cloud environments. In this work, we propose a model that enables cloud customers to determine whether the memory allocated to their virtual machines is correctly provisioned, underprovisioned, or overprovisioned. The model uses two metrics collected inside a VM, resident and committed memory, and defines thresholds for these metrics that characterize each provisioning level. Experimental results with Linux guests on Xen, running four benchmarks with different workloads and varying memory capacity, show that the model was able to accurately diagnose memory provisioning in 98% of the scenarios evaluated.

[1]  Svetozar Miuÿ,et al.  DejaVu: Accelerating Resource Allocation in Virtualized Environments , 2012 .

[2]  Ricardo José Pfitscher,et al.  Diagnóstico do provisionamento de recursos para máquinas virtuais em nuvens IaaS , 2014 .

[3]  Mark Russinovich,et al.  Windows® Internals: Including Windows Server 2008 and Windows Vista, Fifth Edition , 2009 .

[4]  Kun Wang,et al.  A Distributed Self-Learning Approach for Elastic Provisioning of Virtualized Cloud Resources , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[5]  Rajkumar Buyya,et al.  SLA-oriented resource provisioning for cloud computing: Challenges, architecture, and solutions , 2011, 2011 International Conference on Cloud and Service Computing.

[6]  Sherif Sakr,et al.  On understanding the economics and elasticity challenges of deploying business applications on public cloud infrastructure , 2012, Journal of Internet Services and Applications.

[7]  Sameh Elnikety,et al.  Performance Comparison of Middleware Architectures for Generating Dynamic Web Content , 2003, Middleware.

[8]  Yingwei Luo,et al.  Dynamic memory balancing for virtual machines , 2009, ACM SIGOPS Oper. Syst. Rev..

[9]  George Neville-Neil,et al.  The Design and Implementation of the FreeBSD Operating System , 2014 .

[10]  Chuck Silvers,et al.  UBC: An Efficient Unified I/O and Memory Caching Subsystem for NetBSD , 2000, USENIX Annual Technical Conference, FREENIX Track.

[11]  Richard McDougall,et al.  Solaris Internals: Solaris 10 and OpenSolaris Kernel Architecture , 2006 .

[12]  Prashant J. Shenoy,et al.  An Empirical Study of Memory Sharing in Virtual Machines , 2012, USENIX Annual Technical Conference.

[13]  David H. Bailey,et al.  The NAS parallel benchmarks summary and preliminary results , 1991, Proceedings of the 1991 ACM/IEEE Conference on Supercomputing (Supercomputing '91).

[14]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[15]  Kaushik Dutta,et al.  Modeling virtualized applications using machine learning techniques , 2012, VEE '12.

[16]  Filipe Marques,et al.  SLA Design from a Business Perspective , 2005, DSOM.

[17]  Amer Diwan,et al.  The DaCapo benchmarks: java benchmarking development and analysis , 2006, OOPSLA '06.

[18]  Arun Venkataramani,et al.  Black-box and Gray-box Strategies for Virtual Machine Migration , 2007, NSDI.

[19]  Xiaoyun Zhu,et al.  Memory overbooking and dynamic control of Xen virtual machines in consolidated environments , 2009, 2009 IFIP/IEEE International Symposium on Integrated Network Management.

[20]  Laura Hoch.  Understanding The Linux Virtual Memory Manager , 2016 .

[21]  Jerome A. Rolia,et al.  Resource contention detection and management for consolidated workloads , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[22]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[23]  Peter J. Denning,et al.  Working Sets Past and Present , 1980, IEEE Transactions on Software Engineering.

[24]  Artur Baruchi,et al.  A Survey Analysis of Memory Elasticity Techniques , 2010, Euro-Par Workshops.