Static strategy and dynamic adjustment: An effective method for Grid task scheduling

Task scheduling is the key technology in Grid computing. Hierarchical organization is suitable for the computational Grid because of the dynamic, heterogeneous and autonomous nature of the Grid. Although a number of Grid systems adopt this organization, few of them has dealt with task scheduling for the hierarchical architecture. In this paper, we present an effective method, fully taking into account both historical Grid trade data and dynamic variation of the Grid market to improve the task scheduling for a hierarchical Grid market. The main idea of the proposed method is a combination of an off-line static strategy using time series prediction and an on-line dynamic adjustment using reinforcement learning. The superiority of this new scheduling algorithm, in improving the inquiry efficiency for resource consumers, getting better load balancing of the whole hierarchical Grid market, and achieving higher success rate of the Grid service request, is demonstrated by simulation experiments.

[1]  Ching-Hsien Hsu,et al.  Performance effective pre-scheduling strategy for heterogeneous grid systems in the master slave paradigm , 2007, Future Gener. Comput. Syst..

[2]  Hong Peng,et al.  Macroeconomics based Grid resource allocation , 2008, Future Gener. Comput. Syst..

[3]  R. F. Freund,et al.  Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[4]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[5]  Shoubao Yang,et al.  Decentralized Computational Market Model for Grid Resource Management , 2003, GCC.

[6]  Rajkumar Buyya,et al.  GridSim: a toolkit for the modeling and simulation of distributed resource management and scheduling for Grid computing , 2002, Concurr. Comput. Pract. Exp..

[7]  Li Chunlin,et al.  QoS based resource scheduling by computational economy in computational grid , 2006 .

[8]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[9]  Mohammad Kazem Akbari,et al.  A parallel solution for scheduling of real time applications on grid environments , 2009, Future Gener. Comput. Syst..

[10]  Hong Peng,et al.  Macro Adjustment Based Task Scheduling in Hierarchical Grid Market , 2007, International Conference on Computational Science.

[11]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[12]  J. Stuart Hunter,et al.  The exponentially weighted moving average , 1986 .

[13]  Ian T. Foster,et al.  Globus: a Metacomputing Infrastructure Toolkit , 1997, Int. J. High Perform. Comput. Appl..

[14]  Rajkumar Buyya,et al.  A Market-Oriented Grid Directory Service for Publication and Discovery of Grid Service Providers and their Services , 2006, The Journal of Supercomputing.

[15]  David Abramson,et al.  High performance parametric modeling with Nimrod/G: killer application for the global grid? , 2000, Proceedings 14th International Parallel and Distributed Processing Symposium. IPDPS 2000.

[16]  Richard Wolski,et al.  Analyzing Market-Based Resource Allocation Strategies for the Computational Grid , 2001, Int. J. High Perform. Comput. Appl..

[17]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[18]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[19]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[20]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[21]  Jan Broeckhove,et al.  A commodity market algorithm for pricing substitutable Grid resources , 2007, Future Gener. Comput. Syst..

[22]  Albert Y. Zomaya,et al.  Artificial life techniques for load balancing in computational grids , 2007, J. Comput. Syst. Sci..

[23]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[24]  John F. Karpovich,et al.  Resource management in Legion , 1999, Future Gener. Comput. Syst..

[25]  Warren Smith,et al.  A directory service for configuring high-performance distributed computations , 1997, Proceedings. The Sixth IEEE International Symposium on High Performance Distributed Computing (Cat. No.97TB100183).

[26]  Rajkumar Buyya,et al.  Economic-based Distributed Resource Management and Scheduling for Grid Computing , 2002, ArXiv.

[27]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).