Applying reinforcement learning to scheduling strategies in an actual grid environment

Grid environments are dynamic and heterogeneous by nature, therefore requiring adaptive scheduling strategies. Reinforcement learning is an interesting and simple adaptive approach that may work well in actual grid environments. In this work, we employ reinforcement learning to classify available resources in a grid environment, giving support to two scheduling algorithms, AG and MQD. We study the makespan optimisation and load balancing. An algorithm known as RR is used for normalising purposes.

[1]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[2]  Fangpeng Dong.  A Taxonomy of Task Scheduling Algorithms in the Grid , 2007, Parallel Process. Lett..

[3]  Selim G. Akl,et al.  Scheduling Algorithms for Grid Computing: State of the Art and Open Problems , 2006 .

[4]  Peter Dayan,et al.  Technical Note: Q-Learning , 2004, Machine Learning.

[5]  Francine Berman,et al.  The AppLeS Parameter Sweep Template: User-Level Middleware for the Grid , 2000, ACM/IEEE SC 2000 Conference (SC'00).

[6]  Kristina Lerman,et al.  Resource allocation in the grid using reinforcement learning , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[7]  Jiadao Li,et al.  Learning-based negotiation strategies for grid scheduling , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[8]  Eduardo Huedo,et al.  The GridWay Framework for Adaptive Scheduling and Execution on Grids , 2001, Scalable Comput. Pract. Exp..

[9]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[10]  Ivan Rodero,et al.  Evaluation of Coordinated Grid Scheduling Strategies , 2009, 2009 11th IEEE International Conference on High Performance Computing and Communications.

[11]  Albert Y. Zomaya,et al.  A Grid Scheduling Algorithm for Bag-of-Tasks Applications Using Multiple Queues with Duplication , 2006, 5th IEEE/ACIS International Conference on Computer and Information Science and 1st IEEE/ACIS International Workshop on Component-Based Software Engineering,Software Architecture and Reuse (ICIS-COMSAR'06).

[12]  Peter Dayan,et al.  Q-learning , 1992, Machine Learning.

[13]  Henri Casanova,et al.  Simgrid: a toolkit for the simulation of application scheduling , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[14]  Francine Berman,et al.  New Grid Scheduling and Rescheduling Methods in the GrADS Project , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[15]  Bruno Schulze,et al.  GRAND: toward scalability in a Grid environment , 2007, Concurr. Comput. Pract. Exp..

[16]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[17]  Francine Berman,et al.  Adaptive Computing on the Grid Using AppLeS , 2003, IEEE Trans. Parallel Distributed Syst..

[18]  Cristina Boeres,et al.  An EasyGrid portal for scheduling system‐aware applications on computational Grids , 2006, Concurr. Comput. Pract. Exp..

[19]  Francisco Vilar Brasileiro,et al.  Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids , 2003, Euro-Par.

[20]  Rajkumar Buyya,et al.  A grid service broker for scheduling distributed data-oriented applications on global grids , 2004, MGC '04.

[21]  Miron Livny,et al.  Adaptive Scheduling for Master-Worker Applications on the Computational Grid , 2000, GRID.