Affinity aware scheduling model of cluster nodes in private clouds

Abstract Running applications on a cloud environment without checking and meeting their allocation and performance requirements may lead to unexpected application slowdown and infrastructure under-utilization. In addition, competition for same shared resources may cause performance degradation when applications with similar resource usage profiles are scheduled concurrently. This paper presents an affinity-based model for scheduling virtual machines that host and run scientific applications on a private cloud environment. The main contributions of the proposed model are: i) an approach that exploits the concept of affinity relations among competitive applications; ii) a set of experiments using consolidated HPC benchmarks and their analysis to assess the performance of two concurrent applications; and iii) a novel scheduling algorithm based on an affinity relation among competitive applications.

[1]  Donald E. Knuth,et al.  The Art of Computer Programming, Volume 4, Fascicle 2: Generating All Tuples and Permutations (Art of Computer Programming) , 2005 .

[2]  Jing Zhang,et al.  OpenCL and the 13 dwarfs: a work in progress , 2012, ICPE '12.

[3]  Peter C. J. Graham,et al.  Compatibility-based static VM placement minimizing interference , 2017, J. Netw. Comput. Appl..

[4]  Christina Delimitrou,et al.  Paragon: QoS-aware scheduling for heterogeneous datacenters , 2013, ASPLOS '13.

[5]  P. Mell,et al.  SP 800-145. The NIST Definition of Cloud Computing , 2011 .

[6]  Bruno Schulze,et al.  The Impact of Hypervisor Layer on Database Applications , 2012, 2012 IEEE Fifth International Conference on Utility and Cloud Computing.

[7]  Bruno Schulze,et al.  Leveraging High Performance Computing for Bioinformatics: A Methodology that Enables a Reliable Decision-Making , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[8]  Calton Pu,et al.  An Analysis of Performance Interference Effects in Virtual Environments , 2007, 2007 IEEE International Symposium on Performance Analysis of Systems & Software.

[9]  Xi Chen,et al.  CloudScope: Diagnosing and Managing Performance Interference in Multi-tenant Clouds , 2015, 2015 IEEE 23rd International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[10]  Larry Rudolph,et al.  Metrics and Benchmarking for Parallel Job Scheduling , 1998, JSSPP.

[11]  Yongzhao Zhan,et al.  Virtualization and Cloud Computing , 2019, CompTIA® A+® Complete Practice Tests.

[12]  Jie Xu,et al.  Improved energy-efficiency in cloud datacenters with interference-aware virtual machine placement , 2013, 2013 IEEE Eleventh International Symposium on Autonomous Decentralized Systems (ISADS).

[13]  Yingwei Luo,et al.  Evaluating and Optimizing I/O Virtualization in Kernel-based Virtual Machine (KVM) , 2010, NPC.

[14]  Qinghua Gao,et al.  Performance Measuring and Comparing of Virtual Machine Monitors , 2008, 2008 IEEE/IFIP International Conference on Embedded and Ubiquitous Computing.

[15]  Daniel R. Page.  Generalized Algorithm for Restricted Weak Composition Generation , 2013, J. Math. Model. Algorithms Oper. Res..

[16]  Jack J. Dongarra,et al.  Evaluation of the HPC Challenge Benchmarks in Virtualized Environments , 2011, Euro-Par Workshops.

[17]  Djamshid Tavangarian,et al.  The PRIOmark Parallel I/O-Benchmark , 2005, Parallel and Distributed Computing and Networks.

[18]  Lin Wang,et al.  Joint Optimization of Operational Cost and Performance Interference in Cloud Data Centers , 2014, IEEE Transactions on Cloud Computing.