Co-scheduling Deadline-Sensitive Applications in Large-scale Grid Systems

In large-scale grid systems, plenty of applications are constrained by soft or hard deadline requirement. However, it is difficult to guarantee the deadline requirements of these applications because of the dynamical nature of distributed systems. In this paper, a novel approach is proposed to evaluate the deadline-guarantee of co-allocation schemes that obtained from conventional co-allocation policies. Based on this approach, a hybrid-policy co-allocation model is also proposed to address the issue of deadline-constrained resource co-allocation in grid environments. The proposed model integrates multiple co-allocation policies to generate different co-allocation schemes, and selects the one with optimal deadline-guarantee for grid applications. By this way, the hybrid-policy model combines the merits of different policies, and overcomes the shortcomings of those policies. Extensive simulations are conducted to verify the effectiveness and the performance of the proposed model in terms of deadline-miss rate. Experimental results show that it can provide coallocation scheme with enhanced deadline-guarantee as well as lower deadline-miss rate.

[1]  Dror G. Feitelson,et al.  The workload on parallel supercomputers: modeling the characteristics of rigid jobs , 2003, J. Parallel Distributed Comput..

[2]  Jan Weglarz,et al.  Hierarchical scheduling strategies for parallel tasks and advance reservations in grids , 2013, J. Sched..

[3]  Ming Wu,et al.  QoS Oriented Resource Reservation in Shared Environments , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[4]  John F. Karpovich,et al.  Support for extensibility and site autonomy in the Legion grid system object model , 2003, J. Parallel Distributed Comput..

[5]  Emmanuel Jeannot,et al.  On the distribution of sequential jobs in random brokering for heterogeneous computational grids , 2006, IEEE Transactions on Parallel and Distributed Systems.

[6]  Peter M. A. Sloot,et al.  The distributed ASCI Supercomputer project , 2000, OPSR.

[7]  Ian T. Foster,et al.  The Globus Replica Location Service: Design and Experience , 2009, IEEE Transactions on Parallel and Distributed Systems.

[8]  Chien-Min Wang,et al.  Dynamic resource selection heuristics for a non-reserved bidding-based Grid environment , 2010, Future Gener. Comput. Syst..

[9]  Henri Casanova,et al.  Benefits and Drawbacks of Redundant Batch Requests , 2007, Journal of Grid Computing.

[10]  Layuan Li,et al.  Cross-layer optimization policy for QoS scheduling in computational grid , 2008, J. Netw. Comput. Appl..

[11]  Helen D. Karatza,et al.  Gang scheduling in multi-core clusters implementing migrations , 2011, Future Gener. Comput. Syst..

[12]  Richard Wolski,et al.  Writing Programs that Run EveryWare on the Computational Grid , 2001, IEEE Trans. Parallel Distributed Syst..

[13]  Jitender S. Deogun,et al.  Scheduling real-time divisible loads with advance reservations , 2011, Real-Time Systems.

[14]  Li Chunlin,et al.  Cross-layer optimization policy for QoS scheduling in computational grid , 2008 .

[15]  V. Kumar,et al.  Job Scheduling in the presence of Multiple Resource Requirements , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[16]  Dick H. J. Epema,et al.  An evaluation of the close-to-files processor and data co-allocation policy in multiclusters , 2004, 2004 IEEE International Conference on Cluster Computing (IEEE Cat. No.04EX935).

[17]  Stephen A. Jarvis,et al.  Allocating non-real-time and soft real-time jobs in multiclusters , 2006, IEEE Transactions on Parallel and Distributed Systems.

[18]  Chao-Tung Yang,et al.  Resource brokering using a multi‐site resource allocation strategy for computational grids , 2011, Concurr. Comput. Pract. Exp..

[19]  Marcelo Finger,et al.  Resource use pattern analysis for predicting resource availability in opportunistic grids , 2010, Concurr. Comput. Pract. Exp..

[20]  Anca I. D. Bucur,et al.  Scheduling Policies for Processor Coallocation in Multicluster Systems , 2007, IEEE Transactions on Parallel and Distributed Systems.

[21]  Rajkumar Buyya,et al.  Task granularity policies for deploying bag-of-task applications on global grids , 2013, Future Gener. Comput. Syst..

[22]  Ger Koole,et al.  Resource allocation in grid computing , 2008, J. Sched..

[23]  Helen D. Karatza,et al.  Evaluation of gang scheduling performance and cost in a cloud computing system , 2010, The Journal of Supercomputing.

[24]  Jinjun Chen,et al.  Research trends in cloud, cluster and grid computing , 2012, Cluster Computing.

[25]  Guanfeng Liu,et al.  An enhanced load balancing mechanism based on deadline control on GridSim , 2012, Future Gener. Comput. Syst..