QoS and preemption aware scheduling in federated and virtualized Grid computing environments

Resource provisioning is one of the challenges in federated Grid environments. In these environments each Grid serves requests from external users along with local users. Recently, this resource provisioning is performed in the form of Virtual Machines (VMs). The problem arises when there are insufficient resources for local users to be served. The problem gets complicated further when external requests have different QoS requirements. Serving local users could be solved by preempting VMs from external users which impose overheads on the system. Therefore, the question is how the number of VM preemptions in a Grid can be minimized. Additionally, how we can decrease the likelihood of preemption for requests with more QoS requirements. We propose a scheduling policy in InterGrid, as a federated Grid, which reduces the number of VM preemptions and dispatches external requests in a way that fewer requests with QoS constraints get affected by preemption. Extensive simulation results indicate that the number of VM preemptions is decreased at least by 60%, particularly, for requests with more QoS requirements.

[1]  Keqin Li,et al.  Optimal load distribution in nondedicated heterogeneous cluster and grid computing environments , 2008, J. Syst. Archit..

[2]  Bruno Gaujal,et al.  Optimal routing in parallel, non-observable queues and the price of anarchy revisited , 2010, 2010 22nd International Teletraffic Congress (lTC 22).

[3]  S. Zhou,et al.  A Trace-Driven Simulation Study of Dynamic Load Balancing , 1987, IEEE Trans. Software Eng..

[4]  Bharadwaj Veeravalli,et al.  Novel critical-path based low-energy scheduling algorithms for heterogeneous multiprocessor real-time embedded systems , 2007, 2007 International Conference on Parallel and Distributed Systems.

[5]  Rajkumar Buyya,et al.  A toolkit for modelling and simulating data Grids: an extension to GridSim , 2008, Concurr. Comput. Pract. Exp..

[6]  Jyh-Biau Chang,et al.  A progressive multi-layer resource reconfiguration framework for time-shared grid systems , 2009, Future Gener. Comput. Syst..

[7]  Borja Sotomayor,et al.  Resource Leasing and the Art of Suspending Virtual Machines , 2009, 2009 11th IEEE International Conference on High Performance Computing and Communications.

[8]  Arie Hordijk,et al.  Periodic routing to parallel queues and billiard sequences , 2004, Math. Methods Oper. Res..

[9]  Sanjeev Baskiyar,et al.  A general distributed scalable grid scheduler for independent tasks , 2009, J. Parallel Distributed Comput..

[10]  Hui Li,et al.  Workload Characteristics of a Multi-cluster Supercomputer , 2004, JSSPP.

[11]  Stephen A. Jarvis,et al.  Dynamic scheduling of parallel jobs with QoS demands in multiclusters and grids , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[12]  Li Ding,et al.  DYNAMIC ROUTING OF CUSTOMERS WITH GENERAL DELAY COSTS IN A MULTISERVER QUEUING SYSTEM , 2009, Probability in the Engineering and Informational Sciences.

[13]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[14]  Miron Livny,et al.  Scheduling Mixed Workloads in Multi-grids: The Grid Execution Hierarchy , 2006, 2006 15th IEEE International Conference on High Performance Distributed Computing.

[15]  P. Sadayappan,et al.  Scheduling of Parallel Jobs in a Heterogeneous Multi-site Environement , 2003, JSSPP.

[16]  Alexandru Iosup,et al.  Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[17]  David E. Irwin,et al.  Dynamic virtual clusters in a grid site manager , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[18]  Renato J. O. Figueiredo,et al.  Experimental Study of Virtual Machine Migration in Support of Reservation of Cluster Resources , 2007, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing (VTDC '07).

[19]  Stephen A. Jarvis,et al.  Allocating non-real-time and soft real-time jobs in multiclusters , 2006, IEEE Transactions on Parallel and Distributed Systems.

[20]  Lior Amar,et al.  The Power of Preemption in Economic Online Markets , 2008, GECON.

[21]  Rajkumar Buyya,et al.  Harnessing Cloud Technologies for a Virtualized Distributed Computing Infrastructure , 2009, IEEE Internet Computing.

[22]  Anca I. D. Bucur,et al.  Priorities among multiple queues for processor co-allocation in multicluster systems , 2003, 36th Annual Simulation Symposium, 2003..

[23]  David E. Culler,et al.  PlanetLab: an overlay testbed for broad-coverage services , 2003, CCRV.

[24]  Christian Grimme,et al.  Prospects of Collaboration between Compute Providers by Means of Job Interchange , 2007, JSSPP.

[25]  Rudolf Eigenmann,et al.  Prediction of Resource Availability in Fine-Grained Cycle Sharing Systems Empirical Evaluation , 2007, Journal of Grid Computing.

[26]  Rajkumar Buyya,et al.  Resource Provisioning based on Leases Preemption in InterGrid , 2011, ACSC.

[27]  Uwe Schwiegelshohn,et al.  Fairness in parallel job scheduling , 2000 .

[28]  Ishfaq Ahmad,et al.  Dynamic Critical-Path Scheduling: An Effective Technique for Allocating Task Graphs to Multiprocessors , 1996, IEEE Trans. Parallel Distributed Syst..

[29]  Angela C. Sodan,et al.  Service control with the preemptive parallel job scheduler Scojo-PECT , 2011, Cluster Computing.

[30]  Philip S. Yu,et al.  Dynamic load balancing in geographically distributed heterogeneous Web servers , 1998, Proceedings. 18th International Conference on Distributed Computing Systems (Cat. No.98CB36183).

[31]  Borja Sotomayor,et al.  Combining batch execution and leasing using virtual machines , 2008, HPDC '08.

[32]  Rajkumar Buyya,et al.  Performance analysis of multiple site resource provisioning: effects of the precision of availability information , 2008, HiPC'08.

[33]  Rajkumar Buyya,et al.  InterGrid: a case for internetworking islands of Grids , 2008, Concurr. Comput. Pract. Exp..

[34]  Andrew V. Goldberg,et al.  Quincy: fair scheduling for distributed computing clusters , 2009, SOSP '09.

[35]  Anurag Kumar,et al.  Adaptive Optimal Load Balancing in a Nonhomogeneous Multiserver System with a Central Job Scheduler , 1990, IEEE Trans. Computers.

[36]  Sebastien Goasguen,et al.  Dynamic Provisioning of Virtual Organization Clusters , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[37]  Zhiling Lan,et al.  Analyzing and adjusting user runtime estimates to improve job scheduling on the Blue Gene/P , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS).

[38]  Rajkumar Kettimuthu,et al.  Selective preemption strategies for parallel job scheduling , 2002, Proceedings International Conference on Parallel Processing.

[39]  Xian-He Sun,et al.  Performance Modeling and Prediction of Nondedicated Network Computing , 2002, IEEE Trans. Computers.

[40]  Mark J. Clement,et al.  Preemption Based Backfill , 2002, JSSPP.