Meta-scheduling and Task Reallocation in a Grid Environment

In this paper, we study the impact of task reallocations/migrations on a grid platform, composed of parallel resources, each supervised by a batch scheduler. Results of simulations using real life traces show that gains of 40% can be attained on the average waiting time of jobs even if tasks are initially mapped by a meta-scheduler on the cluster giving the best completion time.

[1]  Uwe Schwiegelshohn,et al.  Analysis of first-come-first-serve parallel job scheduling , 1998, SODA '98.

[2]  Ibm Redbooks,et al.  Workload Management With Loadleveler , 2001 .

[3]  Laurent Lefèvre,et al.  The GREEN-NET framework: Energy efficiency in large scale distributed systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[4]  R. F. Freund,et al.  Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems , 1999, Proceedings. Eighth Heterogeneous Computing Workshop (HCW'99).

[5]  Mitsuhisa Sato,et al.  Ninf: A Network Based Information Library for Global World-Wide Computing Infrastructure , 1997, HPCN Europe.

[6]  David A. Lifka,et al.  The ANL/IBM SP Scheduling System , 1995, JSSPP.

[7]  Uwe Schwiegelshohn,et al.  Parallel Job Scheduling - A Status Report , 2004, JSSPP.

[8]  Eddy Caron,et al.  Diet: A Scalable Toolbox to Build Network Enabled Servers on the Grid , 2006, Int. J. High Perform. Comput. Appl..

[9]  Julita Corbalán,et al.  A Job Self-scheduling Policy for HPC Infrastructures , 2007, JSSPP.

[10]  Franck Cappello,et al.  Grid'5000: A Large Scale And Highly Reconfigurable Experimental Grid Testbed , 2006, Int. J. High Perform. Comput. Appl..

[11]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[12]  Selim G. Akl,et al.  Scheduling Algorithms for Grid Computing: State of the Art and Open Problems , 2006 .

[13]  Mark J. Clement,et al.  Core Algorithms of the Maui Scheduler , 2001, JSSPP.

[14]  Yves Caniou,et al.  Simbatch: An API for Simulating and Predicting the Performance of Parallel Resources Managed by Batch Systems , 2008, Euro-Par Workshops.

[15]  Rajkumar Buyya,et al.  Rescheduling co-allocation requests based on flexible advance reservations and processor remapping , 2008, 2008 9th IEEE/ACM International Conference on Grid Computing.

[16]  Jianhui Yue,et al.  Global Backfilling Scheduling in Multiclusters , 2004, AACC.

[17]  Georges Da Costa,et al.  2005 IEEE International Symposium on Cluster Computing and the Grid , 2005, CCGRID.

[18]  Wolfgang Gentzsch,et al.  Sun Grid Engine: towards creating a compute power grid , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[19]  Ivan Rodero,et al.  The Grid Backfilling: a Multi-Site Scheduling Architecture with Data Mining Prediction Techniques , 2008 .