iTune: Engineering the Performance of Xen Hypervisor via Autonomous and Dynamic Scheduler Reconfiguration

Despite the widespread use of server virtualization technologies in cloud data centers, system administrators experience multiple challenges in configuring the hypervisor’s scheduler parameters to optimize its performance. Manually tuning the scheduler’s parameters is a common practice, however, this approach is not effective particularly when dealing with dynamically changing workload and resource utilizations on the host machines. This problem becomes even harder if cloud resources are overbooked while hosting both latency-sensitive and batched applications. To address these issues, this paper presents iTune, which is a framework for engineering the performance of a hypervisor intelligently via autonomous scheduler configurations. Concretely, iTune optimizes the Xen hypervisor’s scheduler configuration parameters autonomously through a three phase process comprising: (1) Discoverer, which monitors and saves the resource usage history of the host machines and groups set of related host machine workloads, (2) Optimizer, where optimum Xen scheduler configuration parameters for each workload cluster are explored by employing a simulated annealing machine learning algorithm, and (3) Observer, where iTune monitors the resource usage of host machines online, classifies them into one of the categories found in the Discoverer phase, and loads the optimum scheduler parameters determined in the Optimizer phase. Experimental results validate our claims.

[1]  Jie Wang,et al.  Optimizing MPI Runtime Parameter Settings by Using Machine Learning , 2009, PVM/MPI.

[2]  Rina Panigrahy,et al.  Validating Heuristics for Virtual Machines Consolidation , 2011 .

[3]  Ludmila Cherkasova,et al.  Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor , 2005, USENIX ATC, General Track.

[4]  Brian D. Noble,et al.  Small is better: avoiding latency traps in virtualized data centers , 2013, SoCC.

[5]  Aniruddha Gokhale,et al.  iOverbook : Managing Cloud-based Soft Real-time Applications in a Resource-Overbooked Data Center , 2013 .

[6]  Martin F. Arlitt,et al.  Maximizing server utilization while meeting critical SLAs via weight-based collocation management , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[7]  Xianghua Xu,et al.  Performance Evaluation of the CPU Scheduler in XEN , 2008, 2008 International Symposium on Information Science and Engineering.

[8]  Prashant J. Shenoy,et al.  Empirical evaluation of latency-sensitive application performance in the cloud , 2010, MMSys '10.

[9]  Kang G. Shin,et al.  Automated control of multiple virtualized resources , 2009, EuroSys '09.

[10]  Amin Vahdat,et al.  Dynamic Scheduling of Virtual Machines Running HPC Workloads in Scientific Grids , 2007, 2009 3rd International Conference on New Technologies, Mobility and Security.

[11]  Navjot Singh,et al.  XenTune: Detecting Xen Scheduling Bottlenecks for Media Applications , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[12]  Hai Jin,et al.  Communication-driven scheduling for virtual clusters in cloud , 2014, HPDC '14.

[13]  Cong Xu,et al.  vSlicer: latency-aware virtual machine scheduling via differentiated-frequency CPU slicing , 2012, HPDC '12.

[14]  Johan Tordsson,et al.  An Autonomic Approach to Risk-Aware Data Center Overbooking , 2014, IEEE Transactions on Cloud Computing.

[15]  Dan Feng,et al.  An Improved Xen Credit Scheduler for I/O Latency-Sensitive Applications on Multicores , 2013, 2013 International Conference on Cloud Computing and Big Data.

[16]  Dejan S. Milojicic,et al.  OpenNebula: A Cloud Management Tool , 2011, IEEE Internet Computing.

[17]  Chenyang Lu,et al.  RT-Xen: Towards real-time hypervisor scheduling in Xen , 2011, 2011 Proceedings of the Ninth ACM International Conference on Embedded Software (EMSOFT).

[18]  Aniruddha S. Gokhale,et al.  iPlace: An Intelligent and Tunable Power- and Performance-Aware Virtual Machine Placement Technique for Cloud-Based Real-Time Applications , 2014, 2014 IEEE 17th International Symposium on Object/Component/Service-Oriented Real-Time Distributed Computing.

[19]  Aniruddha S. Gokhale,et al.  A self-tuning system based on application Profiling and Performance Analysis for optimizing Hadoop MapReduce cluster configuration , 2013, 20th Annual International Conference on High Performance Computing.

[20]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[21]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[22]  P. Rousseeuw Silhouettes: a graphical aid to the interpretation and validation of cluster analysis , 1987 .

[23]  Antonio Corradi,et al.  VM consolidation: A real case based on OpenStack Cloud , 2014, Future Gener. Comput. Syst..

[24]  Rachel Householder,et al.  On Cloud-based Oversubscription , 2014, ArXiv.

[25]  Ludmila Cherkasova,et al.  XenMon: QoS Monitoring and Performance Profiling Tool , 2005 .