Hybrid meta-heuristic algorithms for independent job scheduling in grid computing

Abstract The term ‘grid computing’ is used to describe an infrastructure that connects geographically distributed computers and heterogeneous platforms owned by multiple organizations allowing their computational power, storage capabilities and other resources to be selected and shared. The job scheduling problem is recognized as being one of the most important and challenging issues in grid computing environments. This paper proposes two strongly coupled hybrid meta-heuristic schedulers. The first scheduler combines Ant Colony Optimization and Variable Neighbourhood Search in which the former acts as the primary algorithm which, during its execution, calls the latter as a supporting algorithm, while the second merges the Genetic Algorithm with Variable Neighbourhood Search in the same fashion. Several experiments were carried out to analyze the performance of the proposed schedulers in terms of minimizing the makespan using well known benchmarks. The experiments show that the proposed schedulers achieved impressive results compared to other selected approaches from the bibliography.

[1]  Fatos Xhafa,et al.  Enhancing the genetic-based scheduling in computational grids by a structured hierarchical population , 2011, Future Gener. Comput. Syst..

[2]  Enrique Alba,et al.  SCHEDULING IN HETEROGENEOUS COMPUTING AND GRID ENVIRONMENTS USING A PARALLEL CHC EVOLUTIONARY ALGORITHM , 2012, Comput. Intell..

[3]  Fatos Xhafa,et al.  Requirements for an Event-Based Simulation Package for Grid Systems , 2007, J. Interconnect. Networks.

[4]  Ku Ruhana Ku-Mahamud,et al.  Scheduling jobs in computational grid using hybrid ACS and GA approach , 2014, 2014 IEEE Computers, Communications and IT Applications Conference.

[5]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[6]  Pierre Hansen,et al.  Variable neighborhood search: basics and variants , 2017, EURO J. Comput. Optim..

[7]  Lucio Agostinho Rocha,et al.  A Bio-inspired Approach to Provisioning of Virtual Resources in Federated Clouds , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[8]  Enrique Alba,et al.  The Problem Aware Local Search algorithm: an efficient technique for permutation-based problems , 2017, Soft Comput..

[9]  Fatos Xhafa,et al.  A GA+TS Hybrid Algorithm for Independent Batch Scheduling in Computational Grids , 2011, 2011 14th International Conference on Network-Based Information Systems.

[10]  Enrique Alba,et al.  A New Local Search Algorithm for the DNA Fragment Assembly Problem , 2007, EvoCOP.

[11]  Fatos Xhafa,et al.  A GA(TS) Hybrid Algorithm for Scheduling in Computational Grids , 2009, HAIS.

[12]  D. Manimegalai,et al.  Task Scheduling Using Two-Phase Variable Neighborhood Search Algorithm on Heterogeneous Computing and Grid Environments , 2015, Arabian Journal for Science and Engineering.

[13]  Keith L. Clark,et al.  On Optimal Parameters for Ant Colony Optimization Algorithms , 2005, IC-AI.

[14]  Stefka Fidanova,et al.  Ant Algorithm for Grid Scheduling Problem , 2005, LSSC.

[15]  Shengxiang Yang,et al.  Dynamic railway junction rescheduling using population based ant colony optimisation , 2014, 2014 14th UK Workshop on Computational Intelligence (UKCI).

[16]  Enrique Alba,et al.  A parallel micro evolutionary algorithm for heterogeneous computing and grid scheduling , 2012, Appl. Soft Comput..

[17]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[18]  Fatos Xhafa,et al.  An Experimental Study on Genetic Algorithms for Resource Allocation on Grid Systems , 2007, J. Interconnect. Networks.

[19]  Shengxiang Yang,et al.  A genetic algorithm for independent job scheduling in grid computing , 2017 .

[20]  Viktor K. Prasanna,et al.  Heterogeneous computing: challenges and opportunities , 1993, Computer.

[21]  John Levine,et al.  A hybrid ant algorithm for scheduling independent jobs in heterogeneous computing environments , 2004 .

[22]  Pierre Hansen,et al.  Variable Neighborhood Search , 2018, Handbook of Heuristics.

[23]  Thomas Stützle,et al.  The Ant Colony Optimization Metaheuristic: Algorithms, Applications, and Advances , 2003 .

[24]  A. Abraham,et al.  Scheduling jobs on computational grids using a fuzzy particle swarm optimization algorithm , 2010, Future Gener. Comput. Syst..

[25]  Thomas Stützle,et al.  Parameter Adaptation in Ant Colony Optimization , 2012, Autonomous Search.

[26]  Shengxiang Yang,et al.  Meta-Heuristically Seeded Genetic Algorithm for Independent Job Scheduling in Grid Computing , 2017, EvoApplications.

[27]  Fatos Xhafa,et al.  A Hybrid Evolutionary Heuristic for Job Scheduling on Computational Grids , 2007 .

[28]  Enrique Alba,et al.  A Tabu Search Algorithm for Scheduling Independent Jobs in Computational Grids , 2009, Comput. Informatics.

[29]  Cristian Mateos,et al.  A bio-inspired scheduler for minimizing makespan and flowtime of computational mechanics applications on federated clouds , 2016, J. Intell. Fuzzy Syst..

[30]  A. Perallos,et al.  Crossover versus Mutation: A Comparative Analysis of the Evolutionary Strategy of Genetic Algorithms Applied to Combinatorial Optimization Problems , 2014, TheScientificWorldJournal.

[31]  Enrique Alba,et al.  An improved problem aware local search algorithm for the DNA fragment assembly problem , 2017, Soft Comput..

[32]  D. Manimegalai,et al.  Multiobjective Variable Neighborhood Search algorithm for scheduling independent jobs on computational grid , 2015 .

[33]  Cristian Mateos,et al.  Distributed job scheduling based on Swarm Intelligence: A survey , 2014, Comput. Electr. Eng..

[34]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[35]  Fatos Xhafa,et al.  Evaluation of Hybridization of GA and TS Algorithms for Independent Batch Scheduling in Computational Grids , 2011, 2011 International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[36]  Thomas Stützle,et al.  MAX-MIN Ant System , 2000, Future Gener. Comput. Syst..

[37]  John K. Antonio,et al.  Software support for heterogeneous computing , 1996, CSUR.

[38]  Ian T. Foster,et al.  The History of the Grid , 2022, High Performance Computing Workshop.

[39]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[40]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[41]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[42]  Rajkumar Buyya,et al.  Nature's heuristics for scheduling jobs on Computational Grids , 2000 .

[43]  D. Manimegalai,et al.  Efficient Job Scheduling on Computational Grid with Differential Evolution Algorithm , 2011 .

[44]  Enrique Alba,et al.  Efficient Batch Job Scheduling in Grids using Cellular Memetic Algorithms , 2007, IPDPS.

[45]  Oscar H. Ibarra,et al.  Heuristic Algorithms for Scheduling Independent Tasks on Nonidentical Processors , 1977, JACM.

[46]  Fatos Xhafa,et al.  Computational models and heuristic methods for Grid scheduling problems , 2010, Future Gener. Comput. Syst..

[47]  Howard Jay Siegel,et al.  Task execution time modeling for heterogeneous computing systems , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[48]  Fatos Xhafa,et al.  Genetic algorithm based schedulers for grid computing systems , 2007 .