Static Multi-processor Scheduling with Ant Colony Optimisation & Local Search

Efficient multi-processor scheduling is essentially the problem of allocating a set of computational jobs to a set of processors to minimise the overall execution time. There are many variations of this problem, most of which are NP-hard, so we must rely on heuristics to solve real world problem instances. This dissertation describes several novel approaches using the ant colony optimisation (ACO) meta-heuristic and local search techniques, including tabu search, to two important versions of the problem: the static scheduling of independent jobs onto homogeneous and heterogeneous processors. Finding good schedules for jobs allocated on homogeneous processors is an important consideration if efficient use is to be made of a multiple-CPU machine, for example. An ACO algorithm to solve this problem is presented which, when combined with a fast local search procedure, can outperform traditional approaches on benchmark problems instances for the closely related bin packing problem. The algorithm cannot compete, however, with more modern specialised techniques. Scheduling jobs onto hetereogeneous processors is a more general problem which has potential applications in domains such as grid computing. A fast local search procedure for this problem is described which can quickly and effectively improve solutions built by other techniques. When used in conjunction with a well-known heuristic, Min-min, it can find shorter schedules on benchmark problems than other solution techniques found in the literature, and in significantly less time. A tabu search algorithm is also presented which can improve on solutions found by the local search procedure but takes longer. Finally a hybrid ACO algorithm which incorporates the local and tabu searches is described which outperforms both, but takes significantly longer to run.

[1]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[2]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[3]  Paolo Toth,et al.  Knapsack Problems: Algorithms and Computer Implementations , 1990 .

[4]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[5]  Bart Selman,et al.  Local search strategies for satisfiability testing , 1993, Cliques, Coloring, and Satisfiability.

[6]  Roger L. Wainwright,et al.  A parallel island model genetic algorithm for the multiprocessor scheduling problem , 1994, SAC '94.

[7]  Fred W. Glover,et al.  Applying tabu search with influential diversification to multiprocessor scheduling , 1994, Comput. Oper. Res..

[8]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[9]  Emanuel Falkenauer,et al.  A hybrid grouping genetic algorithm for bin packing , 1996, J. Heuristics.

[10]  Colin Reeves,et al.  Hybrid genetic algorithms for bin-packing and related problems , 1996, Ann. Oper. Res..

[11]  Marco E. Vink Solving Combinatorial Problems Using Evolutionary Algorithms , 1997 .

[12]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[13]  S V Zwaan,et al.  ANT COLONY OPTIMISATION FOR JOB SHOP SCHEDULING , 1998 .

[14]  Baikunth Nath,et al.  A Genetic Algorithm for Scheduling Independent Jobs on Uniform Machines with Multiple Objectives , 1998 .

[15]  Ian P. Gent Heuristic Solution of Open Bin Packing Problems , 1998, J. Heuristics.

[16]  Arne Thesen,et al.  Design and Evaluation of Tabu Search Algorithms for Multiprocessor Scheduling , 1998, J. Heuristics.

[17]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..

[18]  Ishfaq Ahmad,et al.  Benchmarking and Comparison of the Task Graph Scheduling Algorithms , 1999, J. Parallel Distributed Comput..

[19]  Thomas Stützle,et al.  MAX-MIN Ant System , 2000, Future Gener. Comput. Syst..

[20]  Rajkumar Buyya,et al.  Nature's heuristics for scheduling jobs on Computational Grids , 2000 .

[21]  Min-You Wu,et al.  A high-performance mapping algorithm for heterogeneous computing systems , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[22]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[23]  Adriana C. F. Alvim,et al.  A Hybrid Improvement Heuristic for the Bin Packing Problem , 2001 .

[24]  Frederick Ducatelle Ant Colony Optimisation for Bin Packing and Cutting Stock Problems , 2001 .

[25]  Barbara Webb,et al.  Swarm Intelligence: From Natural to Artificial Systems , 2002, Connect. Sci..

[26]  Thomas Stützle,et al.  The Ant Colony Optimization Metaheuristic: Algorithms, Applications, and Advances , 2003 .

[27]  Frederick Ducatelle,et al.  Ant colony optimization and local search for bin packing and cutting stock problems , 2004, J. Oper. Res. Soc..

[28]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.