Adaptive iterated local search for cross-domain optimisation

We propose two adaptive variants of a multiple neighborhood iterated local search algorithm. These variants employ online learning techniques, also called adaptive operation selection, in order to select which perturbation to apply at each iteration step from a set of available move operators. Using a common software interface (the HyFlex framework), the proposed algorithms are tested across four hard combinatorial optimisation problems: permutation flow shop, 1D bin packing, maximum satisfiability, and personnel scheduling (including instance data from real-world industrial applications). Using the HyFlex framework, exactly the same high level search strategy can be applied to all the domains and instances. Our results confirm that the adaptive variants outperform a baseline iterated local search with uniform random selection of the move operators. We argue that the adaptive algorithms proposed are general yet powerful, and contribute to the goal of increasing the generality and applicability of heuristic search.

[1]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[2]  Hector J. Levesque,et al.  A New Method for Solving Hard Satisfiability Problems , 1992, AAAI.

[3]  Marko Privosnik The scalability of evolved on line bin packing heuristics , 2007, 2007 IEEE Congress on Evolutionary Computation.

[4]  Dirk Thierens Adaptive Operator Selection for Iterated Local Search , 2009, SLS.

[5]  Michel Gendreau,et al.  Handbook of Metaheuristics , 2010 .

[6]  Emanuel Falkenauer,et al.  A hybrid grouping genetic algorithm for bin packing , 1996, J. Heuristics.

[7]  Nottingham Ng,et al.  A Hybrid Heuristic Ordering and Variable Neighbourhood Search for the Nurse Rostering Problem , 2005 .

[8]  Edmund K. Burke,et al.  HyFlex: A Flexible Framework for the Design and Analysis of Hyper-heuristics , 2009 .

[9]  Thomas Stützle,et al.  A simple and effective iterated greedy algorithm for the permutation flowshop scheduling problem , 2007, Eur. J. Oper. Res..

[10]  Peter I. Cowling,et al.  A Memetic Approach to the Nurse Rostering Problem , 2001, Applied Intelligence.

[11]  Edmund K. Burke,et al.  A scatter search methodology for the nurse rostering problem , 2010, J. Oper. Res. Soc..

[12]  Michèle Sebag,et al.  Extreme Value Based Adaptive Operator Selection , 2008, PPSN.

[13]  Sanja Petrovic,et al.  The Cross-Domain Heuristic Search Challenge - An International Research Competition , 2011, LION.

[14]  Gabriela Ochoa,et al.  A HyFlex Module for the One Dimensional Bin Packing Problem , 2011 .

[15]  Edmund K. Burke,et al.  A Time Predefined Variable Depth Search for Nurse Rostering , 2013, INFORMS J. Comput..

[16]  Helena Ramalhinho Dias Lourenço,et al.  Iterated Local Search , 2001, Handbook of Metaheuristics.

[17]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[18]  Inyong Ham,et al.  A heuristic algorithm for the m-machine, n-job flow-shop sequencing problem , 1983 .

[19]  Edward W. Felten,et al.  Large-step markov chains for the TSP incorporating local search heuristics , 1992, Oper. Res. Lett..

[20]  Thomas Stützle,et al.  An Iterated Greedy heuristic for the sequence dependent setup times flowshop problem with makespan and weighted tardiness objectives , 2008, Eur. J. Oper. Res..

[21]  John Baxter,et al.  Local Optima Avoidance in Depot Location , 1981 .

[22]  Éric D. Taillard,et al.  Benchmarks for basic scheduling problems , 1993 .

[23]  Thomas Stützle,et al.  SATLIB: An Online Resource for Research on SAT , 2000 .

[24]  Marco Laumanns,et al.  PISA: A Platform and Programming Language Independent Interface for Search Algorithms , 2003, EMO.

[25]  Gabriela Ochoa,et al.  A HyFlex Module for the Permutation Flow Shop Problem , 2010 .

[26]  Gleb Belov,et al.  A cutting plane algorithm for the one-dimensional cutting stock problem with multiple stock lengths , 2002, Eur. J. Oper. Res..

[27]  Sanja Petrovic,et al.  Iterated local search vs. hyper-heuristics: Towards general-purpose search algorithms , 2010, IEEE Congress on Evolutionary Computation.

[28]  Jeffrey D. Ullman,et al.  L worst-case performance bounds for rumple one-dimensional packing algorithms siam j , 1974 .

[29]  Dirk Thierens,et al.  An Adaptive Pursuit Strategy for Allocating Operator Probabilities , 2005, BNAIC.

[30]  Graham Kendall,et al.  A Classification of Hyper-heuristic Approaches , 2010 .

[31]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[32]  Toby Walsh,et al.  Towards an Understanding of Hill-Climbing Procedures for SAT , 1993, AAAI.

[33]  Graham Kendall,et al.  A Hyperheuristic Approach to Scheduling a Sales Summit , 2000, PATAT.

[34]  Bart Selman,et al.  Noise Strategies for Improving Local Search , 1994, AAAI.

[35]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .