Developing Co-scheduling Mechanisms for Virtual Machines in Clouds

Virtualization technology, such as Xen, allows multiple virtual machines (VM) to co-exist in a single multi-core physical machine. Multiple VMs may host different processes of the same parallel program. Ideally, the multiple VMs should be scheduled to run simultaneously by the VM manager. However, the existing schedulers in Xen do not support this type of co-scheduling. This paper presents a light weight co-scheduling mechanism for virtual cluster and parallel workload in Xen vitual platform. The co-scheduler is able to greatly improve the performance of parallel applications running in virtualized environments.

[1]  Hai Jin,et al.  Scheduling overcommitted VM: Behavior monitoring and dynamic switching-frequency scaling , 2013, Future Gener. Comput. Syst..

[2]  Cho-Li Wang,et al.  Network performance isolation for latency-sensitive cloud applications , 2013, Future Gener. Comput. Syst..

[3]  Navjot Singh,et al.  Supporting soft real-time tasks in the xen hypervisor , 2010, VEE '10.

[4]  Ravi Pendse,et al.  Credit scheduling and prefetching in hypervisors using Hidden Markov Models , 2010, IEEE Local Computer Network Conference.

[5]  Abraham Silberschatz,et al.  Operating system concepts (3rd ed.) , 1991 .

[6]  Hui Lu,et al.  vTurbo: Accelerating Virtual Machine I/O Processing Using Designated Turbo-Sliced Core , 2013, USENIX Annual Technical Conference.

[7]  Po-Chun Huang,et al.  An Efficient Virtual CPU Scheduling Algorithm for Xen Hypervisor in Virtualized Environment , 2013 .

[8]  Hai Jin,et al.  Analyzing and Improving MPI Communication Performance in Overcommitted Virtualized Systems , 2011, 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems.

[9]  Scott Shenker,et al.  Analysis and simulation of a fair queueing algorithm , 1989, SIGCOMM 1989.

[10]  Yoichi Muraoka,et al.  HPC Benchmarks on Amazon EC2 , 2010, 2010 IEEE 24th International Conference on Advanced Information Networking and Applications Workshops.

[11]  Sisu Xi.  Real-Time Virtualization and Cloud Computing , 2014 .

[12]  Hussein M. Abdel-Wahab,et al.  A proportional share resource allocation algorithm for real-time, time-shared systems , 1996, 17th IEEE Real-Time Systems Symposium.

[13]  Sindhu M.,et al.  An Optimum Multilevel CPU Scheduling Algorithm , 2010, 2010 International Conference on Advances in Computer Engineering.

[14]  Md. Nasim Akhtar,et al.  A New Multilevel CPU Scheduling Algorithm , 2006 .

[15]  Gao Deyuan,et al.  Design fast round robin scheduler in FPGA , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[16]  Uwe Schwiegelshohn,et al.  Parallel Job Scheduling - A Status Report , 2004, JSSPP.

[17]  Robin Fairbairns,et al.  The Design and Implementation of an Operating System to Support Distributed Multimedia Applications , 1996, IEEE J. Sel. Areas Commun..

[18]  Cong Xu,et al.  vSlicer: latency-aware virtual machine scheduling via differentiated-frequency CPU slicing , 2012, HPDC '12.

[19]  Peter H. Gum,et al.  System/370 Extended Architecture: Facilities for Virtual Machines , 1983, IBM J. Res. Dev..

[20]  Jin-Soo Kim,et al.  Inter-domain socket communications supporting high performance and full binary compatibility on Xen , 2008, VEE '08.

[21]  Constantinos Evangelinos,et al.  Cloud Computing for parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere- , 2008 .

[22]  Dhabaleswar K. Panda,et al.  Efficient one-copy MPI shared memory communication in Virtual Machines , 2008, 2008 IEEE International Conference on Cluster Computing.

[23]  Amin Vahdat,et al.  Dynamic Scheduling of Virtual Machines Running HPC Workloads in Scientific Grids , 2007, 2009 3rd International Conference on New Technologies, Mobility and Security.

[24]  Harrick M. Vin,et al.  A hierarchial CPU scheduler for multimedia operating systems , 1996, OSDI '96.

[25]  Stephen P. Crago,et al.  Hypervisor performance analysis for real-time workloads , 2016, 2016 IEEE High Performance Extreme Computing Conference (HPEC).

[26]  Harrick M. Vin,et al.  A hierarchial CPU scheduler for multimedia operating systems , 1996, OSDI '96.

[27]  Íñigo Goiri.  Autonomic resource management for the Xen Hypervisor , 2007 .

[28]  Ying Zhang,et al.  The multi-processor load balance scheduler based on XEN , 2012, 2012 International Conference on Systems and Informatics (ICSAI2012).

[29]  Ludmila Cherkasova,et al.  Measuring CPU Overhead for I/O Processing in the Xen Virtual Machine Monitor , 2005, USENIX ATC, General Track.

[30]  Kenneth J. Duda,et al.  Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler , 2000, OPSR.

[31]  Anand Sivasubramaniam,et al.  Xen and Co.: Communication-Aware CPU Management in Consolidated Xen-Based Hosting Platforms , 2009, IEEE Transactions on Computers.

[32]  Xubin He,et al.  Hybrid Co-scheduling Optimizations for Concurrent Applications in Virtualized Environments , 2011, 2011 IEEE Sixth International Conference on Networking, Architecture, and Storage.

[33]  Chia-Ying Tseng,et al.  An Enhanced CPU Scheduler for XEN Hypervisor to Improve Performance in Virtualized Environment , 2012 .

[34]  Insup Lee,et al.  Real-time multi-core virtual machine scheduling in Xen , 2014, 2014 International Conference on Embedded Software (EMSOFT).

[35]  Insup Lee,et al.  Realizing Compositional Scheduling through Virtualization , 2012, 2012 IEEE 18th Real Time and Embedded Technology and Applications Symposium.

[36]  Minglu Li,et al.  The hybrid scheduling framework for virtual machine systems , 2009, VEE '09.

[37]  U. Saleem,et al.  Simulation of CPU scheduling algorithms , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[38]  Amin Vahdat,et al.  Enforcing Performance Isolation Across Virtual Machines in Xen , 2006, Middleware.

[39]  S. Suranauwarat.  A CPU scheduling algorithm simulator , 2007, 2007 37th Annual Frontiers In Education Conference - Global Engineering: Knowledge Without Borders, Opportunities Without Passports.

[40]  Hui Zhang,et al.  WF/sup 2/Q: worst-case fair weighted fair queueing , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[41]  Jun Wu,et al.  LA-Credit: A Load-Awareness Scheduling Algorithm for Xen Virtualized Platforms , 2016, 2016 IEEE 2nd International Conference on Big Data Security on Cloud (BigDataSecurity), IEEE International Conference on High Performance and Smart Computing (HPSC), and IEEE International Conference on Intelligent Data and Security (IDS).

[42]  Chenyang Lu,et al.  RT-Xen: Towards real-time hypervisor scheduling in Xen , 2011, 2011 Proceedings of the Ninth ACM International Conference on Embedded Software (EMSOFT).

[43]  Heeseung Jo,et al.  Task-aware virtual machine scheduling for I/O performance. , 2009, VEE '09.

[44]  Timothy Wood,et al.  Adaptive dynamic priority scheduling for virtual desktop infrastructures , 2012, 2012 IEEE 20th International Workshop on Quality of Service.

[45]  Sanjay Jha,et al.  Processing resource scheduling in programmable networks , 2005, Comput. Commun..

[46]  QueueingJon,et al.  WF 2 Q : Worst-case Fair Weighted Fair , 1996 .

[47]  Hong Rong,et al.  Time-Stealer: A Stealthy Threat for Virtualization Scheduler and Its Countermeasures , 2013, ICICS.

[48]  Cho-Li Wang,et al.  vBalance: using interrupt load balance to improve I/O performance for SMP virtual machines , 2012, SoCC '12.

[49]  Chong Li,et al.  RT-Open Stack: CPU Resource Management for Real-Time Cloud Computing , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[50]  Alan L. Cox,et al.  Scheduling I/O in virtual machine monitors , 2008, VEE '08.

[51]  R. B. Garg,et al.  A Comparative Study of CPU Scheduling Algorithms , 2013, ArXiv.

[52]  Abhay Parekh,et al.  A generalized processor sharing approach to flow control in integrated services networks: the single-node case , 1993, TNET.

[53]  Chitra G Desai,et al.  Exploring CPU Scheduling Strategies in Xen Virtualization Technology , 2013 .

[54]  Adit Ranadive,et al.  Performance implications of virtualizing multicore cluster machines , 2008, HPCVirt '08.

[55]  Jian Li,et al.  Adjustable Credit Scheduling for High Performance Network Virtualization , 2012, 2012 IEEE International Conference on Cluster Computing.

[56]  James E. Smith,et al.  Virtual machines - versatile platforms for systems and processes , 2005 .