Efficient Batch Job Scheduling in Grids Using Cellular Memetic Algorithms

Computational grids are an important emerging paradigm for large-scale distributed computing. As grid systems become more wide-spread, techniques for efficiently exploiting the large amount of grid computing resources become increasingly indispensable. A key aspect in order to benefit from these resources is the scheduling of jobs to grid resources. Due to the complex nature of grid systems, the design of efficient grid schedulers becomes challenging since such schedulers have to be able to optimize many conflicting criteria in very short periods of time. This problem has been tackled in the literature by several different metaheuristics, and our main focus in this work is to develop a new highly competitive technique with respect to the existing ones. For that, we exploit the capabilities of cellular memetic algorithms (cMAs), a kind of memetic algorithm with structured population, for obtaining efficient batch schedulers for grid systems, and the obtained results will be compared versus the state of the art. A careful design of the cMA methods and operators for the problem yielded to an efficient and robust implementation. Our experimental study, based on a known static benchmark for the problem, shows that this heuristic approach is able to deliver very high quality planning of jobs to grid nodes and thus it can be used to design efficient dynamic schedulers for real grid systems. Such dynamic schedulers can be obtained by running the cMA-based scheduler in batch mode for a very short time to schedule jobs arriving in the system since the last activation of the cMA scheduler.

[1]  Bernabé Dorronsoro,et al.  Cellular memetic algorithms evaluated on SAT , 2005 .

[2]  Enrique Alba,et al.  The exploration/exploitation tradeoff in dynamic cellular genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[3]  Hisao Ishibuchi,et al.  Hybrid Evolutionary Algorithms , 2007 .

[4]  Steven Tuecke,et al.  The Anatomy of the Grid , 2003 .

[5]  Enrique Alba,et al.  Selection intensity in cellular evolutionary algorithms for regular lattices , 2005, IEEE Transactions on Evolutionary Computation.

[6]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[7]  Fatos Xhafa,et al.  Requirements for an Event-Based Simulation Package for Grid Systems , 2007, J. Interconnect. Networks.

[8]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[9]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[10]  Arif Ghafoor,et al.  A distributed heterogeneous supercomputing management system , 1993, Computer.

[11]  Denis Trystram,et al.  Multiple Sequence Alignment and Phylogenetic Inference , 2007, Grid Computing for Bioinformatics and Computational Biology.

[12]  Jack Dongarra,et al.  Applying NetSolve's network-enabled server , 1998 .

[13]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[14]  Albert Y. Zomaya,et al.  Grid Computing for Bioinformatics and Computational Biology (Wiley Series in Bioinformatics) , 2007 .

[15]  Stephen J. Wright Solving optimization problems on computational grids. , 2001 .

[16]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[17]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[18]  E. Talbi Parallel combinatorial optimization , 2006 .

[19]  Enrique Alba,et al.  Cellular Evolutionary Algorithms: Evaluating the Influence of Ratio , 2000, PPSN.

[20]  P. Uthayopas,et al.  Fast simulation model for grid scheduling using HyperSim , 2003, Proceedings of the 2003 Winter Simulation Conference, 2003..

[21]  V Dimartino Sub optimal scheduling in a grid using genetic algorithms , 2004 .

[22]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[23]  Enrique Alba,et al.  Design and evaluation of tabu search method for job scheduling in distributed environments , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[24]  Albert Y. Zomaya,et al.  Grids in bioinformatics and computational biology , 2006, J. Parallel Distributed Comput..

[25]  Max E. Valentinuzzi Handbook of bioinspired algorithms and applications , 2006, BioMedical Engineering OnLine.

[26]  Enrique Alba,et al.  Observations in using Grid-enabled technologies for solving multi-objective optimization problems , 2006, Parallel Comput..

[27]  R. F. Freund,et al.  Scheduling resources in multi-user, heterogeneous, computing environments with SmartNet , 1998, Proceedings Seventh Heterogeneous Computing Workshop (HCW'98).

[28]  Marco Mililotti,et al.  Sub optimal scheduling in a grid using genetic algorithms , 2004, Parallel Comput..

[29]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[30]  Ian T. Foster,et al.  Condor-G: A Computation Management Agent for Multi-Institutional Grids , 2004, Cluster Computing.

[31]  Albert Y. Zomaya,et al.  Grid Computing for Bioinformatics and Computational Biology , 2007, Wiley series on bioinformatics.

[32]  G. Wright Solving Optimization Problems on Computational , 2000 .

[33]  Fatos Xhafa,et al.  Use of genetic algorithms for scheduling jobs in large scale grid applications , 2006 .

[34]  Vincenzo Di Martino,et al.  Sub optimal scheduling in a grid using genetic algorithms , 2003, Parallel Comput..

[35]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[36]  Ishfaq Ahmad,et al.  Optimal task assignment in heterogeneous distributed computing systems , 1998, IEEE Concurr..

[37]  Enrique Alba,et al.  Advanced models of cellular genetic algorithms evaluated on SAT , 2005, GECCO '05.

[38]  Stephen J. Wright,et al.  Decomposition Algorithms for Stochastic Programming on a Computational Grid , 2001, Comput. Optim. Appl..

[39]  David Abramson,et al.  Nimrod/G: an architecture for a resource management and scheduling system in a global computational grid , 2000, Proceedings Fourth International Conference/Exhibition on High Performance Computing in the Asia-Pacific Region.

[40]  Rajkumar Buyya,et al.  Nature's heuristics for scheduling jobs on Computational Grids , 2000 .

[41]  Bernabé Dorronsoro,et al.  Cellular Memetic Algorithms , 2005 .

[42]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..