A biased random-key genetic algorithm for scheduling heterogeneous multi-round systems

A divisible load is an amount W of computational work that can be arbitrarily divided into independent chunks of load. In many divisible load applications, the load can be parallelized in a master–worker fashion, where the master distributes the load among a set P of worker processors to be processed in parallel. The master can only send load to one worker at a time, and the transmission can be done in a single round or in multiple rounds. The multi-round divisible load scheduling problem consists in (a) selecting the subset A⊆P of workers that will process the load, (b) defining the order in which load will be transmitted to each of them, (c) defining the number m of transmission rounds that will be used, and (d) deciding the amount of load that will be transmitted to each worker i∈A at each round k∈{1,…,m}, so as to minimize the makespan. We propose a heuristic approach that determines the transmission order, the set of the active processors and the number of rounds by a biased random-key genetic algorithm. The amount of load transmitted to each worker is computed in polynomial time by closed-form formulas. Computational results showed that the proposed genetic algorithm outperformed a closed-form state-of-the-art heuristic, obtaining makespans that are 11.68% smaller on average for a set of benchmark problems.

[1]  Celso C. Ribeiro,et al.  Design of Survivable Networks: A survey , 2005 .

[2]  Mauricio G. C. Resende,et al.  A biased random key genetic algorithm for 2D and 3D bin packing problems , 2013 .

[3]  Celso C. Ribeiro,et al.  A biased random-key genetic algorithm for routing and wavelength assignment , 2011, J. Glob. Optim..

[4]  Yuping Wang,et al.  Optimization Algorithm for Divisible Load Scheduling on Heterogeneous Star Networks , 2014, J. Softw..

[5]  Maciej Drozdowski,et al.  Scheduling multiple divisible loads in homogeneous star systems , 2008, J. Sched..

[6]  Arnold L. Rosenberg,et al.  Sharing partitionable workloads in heterogeneous NOWs: greedier is not better , 2001, Proceedings 42nd IEEE Symposium on Foundations of Computer Science.

[7]  Maciej Drozdowski,et al.  Multi-installment Divisible Load Processing in Heterogeneous Systems with Limited Memory , 2005, PPAM.

[8]  Celso C. Ribeiro,et al.  A biased random-key genetic algorithm for single-round divisible load scheduling , 2015, Int. Trans. Oper. Res..

[9]  Hamidah Ibrahim,et al.  A new method for job scheduling in a non-dedicated heterogeneous system , 2011, WCIT.

[10]  Debasish Ghose,et al.  Multi-installment load distribution in tree networks with delays , 1995 .

[11]  Celso C. Ribeiro,et al.  Exploiting run time distributions to compare sequential and parallel stochastic local search algorithms , 2012, J. Glob. Optim..

[12]  Mikkel Thorup,et al.  Survivable IP network design with OSPF routing , 2007, Networks.

[13]  Henri Casanova,et al.  UMR: a multi-round algorithm for scheduling divisible workloads , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[14]  Pawel Wolniewicz,et al.  Optimum divisible load scheduling on heterogeneous stars with limited memory , 2006, Eur. J. Oper. Res..

[15]  Thomas Stützle,et al.  Evaluating Las Vegas Algorithms: Pitfalls and Remedies , 1998, UAI.

[16]  Subramaniam Shamala,et al.  New method for scheduling heterogeneous multi-installment systems , 2012, Future Gener. Comput. Syst..

[17]  Henri Casanova,et al.  RUMR: robust scheduling for divisible workloads , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.

[18]  Takuji Nishimura,et al.  Mersenne twister: a 623-dimensionally equidistributed uniform pseudo-random number generator , 1998, TOMC.

[19]  Yves Robert,et al.  Optimal algorithms for scheduling divisible workloads on heterogeneous systems , 2003, Proceedings International Parallel and Distributed Processing Symposium.

[20]  Maciej Drozdowski,et al.  Selected problems of scheduling tasks in multiprocessor computer systems , 1997 .

[21]  Henri Casanova,et al.  Scheduling divisible loads on star and tree networks: results and open problems , 2005, IEEE Transactions on Parallel and Distributed Systems.

[22]  Celso C. Ribeiro,et al.  New heuristics and integer programming formulations for scheduling divisible load tasks , 2009, 2009 IEEE Symposium on Computational Intelligence in Scheduling.

[23]  Mauricio G. C. Resende,et al.  An extended Akers graphical method with a biased random-key genetic algorithm for job-shop scheduling , 2014, Int. Trans. Oper. Res..

[24]  Jitender S. Deogun,et al.  Multi-round real-time divisible load scheduling for clusters , 2008, HiPC'08.

[25]  Bharadwaj Veeravalli,et al.  Divisible load scheduling on single-level tree networks with buffer constraints , 2000, IEEE Trans. Aerosp. Electron. Syst..

[26]  Mauricio G. C. Resende,et al.  A biased random-key genetic algorithm for the minimization of open stacks problem , 2016, Int. Trans. Oper. Res..

[27]  Mitsuo Gen,et al.  Multi-objective multi-population biased random-key genetic algorithm for the 3-D container loading problem , 2015, Comput. Ind. Eng..

[28]  Panos M. Pardalos,et al.  A Genetic Algorithm for the Weight Setting Problem in OSPF Routing , 2002, J. Comb. Optim..

[29]  Celso C. Ribeiro,et al.  Probability Distribution of Solution Time in GRASP: An Experimental Investigation , 2002, J. Heuristics.

[30]  Ching-Hsien Hsu,et al.  On improving resource utilization and system throughput of master slave job scheduling in heterogeneous systems , 2008, The Journal of Supercomputing.

[31]  Mauricio G. C. Resende,et al.  An evolutionary algorithm for manufacturing cell formation , 2004, Comput. Ind. Eng..

[32]  Arnaud Legrand,et al.  On the Complexity of Multi-Round Divisible Load Scheduling , 2007 .

[33]  Mauricio G. C. Resende,et al.  Biased random-key genetic algorithms for combinatorial optimization , 2011, J. Heuristics.

[34]  Dalila B.M.M. Fontes,et al.  A Biased Random Key Genetic Algorithm Approach , 2010 .

[35]  Maciej Drozdowski,et al.  Multi‐installment divisible load processing in heterogeneous distributed systems , 2007, Concurr. Comput. Pract. Exp..

[36]  Hyoung Joong Kim A Novel Optimal Load Distribution Algorithm for Divisible Loads , 2004, Cluster Computing.

[37]  Joanna Berlinska,et al.  Heuristics for multi-round divisible loads scheduling with limited memory , 2010, Parallel Comput..

[38]  Yuping Wang,et al.  New Model and Genetic Algorithm for Divisible Load Scheduling in Heterogeneous Distributed Systems , 2013, Int. J. Pattern Recognit. Artif. Intell..

[39]  W. Spears,et al.  On the Virtues of Parameterized Uniform Crossover , 1995 .

[40]  Celso C. Ribeiro,et al.  TTT plots: a perl program to create time-to-target plots , 2007, Optim. Lett..

[41]  James C. Bean,et al.  Genetic Algorithms and Random Keys for Sequencing and Optimization , 1994, INFORMS J. Comput..

[42]  Jacek Blazewicz,et al.  Distributed Processing of Divisible Jobs with Communication Startup Costs , 1997, Discret. Appl. Math..

[43]  Mauricio G. C. Resende,et al.  Improved heuristics for the regenerator location problem , 2014, Int. Trans. Oper. Res..

[44]  Henri Casanova,et al.  Multiround algorithms for scheduling divisible loads , 2005, IEEE Transactions on Parallel and Distributed Systems.

[45]  Joanna Berlinska,et al.  Experimental study of scheduling with memory constraints using hybrid methods , 2009, J. Comput. Appl. Math..

[46]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[47]  Celso C. Ribeiro,et al.  A hybrid genetic algorithm for the weight setting problem in OSPF/IS‐IS routing , 2005, Networks.

[48]  Yves Robert,et al.  The Master-Slave Paradigm with Heterogeneous Processors , 2001, CLUSTER.

[49]  Celso C. Ribeiro,et al.  tttplots-compare: a perl program to compare time-to-target plots or general runtime distributions of randomized algorithms , 2015, Optim. Lett..

[50]  Mauricio G. C. Resende,et al.  A genetic algorithm for the resource constrained multi-project scheduling problem , 2008, Eur. J. Oper. Res..

[51]  Yves Robert,et al.  Scheduling divisible workloads on heterogeneous platforms , 2003, Parallel Comput..

[52]  Pawel Wolniewicz,et al.  Divisible Load Scheduling in Systems with Limited Memory , 2004, Cluster Computing.

[53]  A Shokripour,et al.  Notice of RetractionA method for scheduling last installment in a heterogeneous multi-installment system , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[54]  Thomas Stützle,et al.  Improvements on the Ant-System: Introducing the MAX-MIN Ant System , 1997, ICANNGA.