Diversified Late Acceptance Search

The well-known Late Acceptance Hill Climbing (LAHC) search aims to overcome the main downside of traditional Hill Climbing (HC) search, which is often quickly trapped in a local optimum due to strictly accepting only non-worsening moves within each iteration. In contrast, LAHC also accepts worsening moves, by keeping a circular array of fitness values of previously visited solutions and comparing the fitness values of candidate solutions against the least recent element in the array. While this straightforward strategy has proven effective, there are nevertheless situations where LAHC can unfortunately behave in a similar manner to HC. For example, when a new local optimum is found, often the same fitness value is stored many times in the array. To address this shortcoming, we propose new acceptance and replacement strategies to take into account worsening, improving, and sideways movement scenarios with the aim to improve the diversity of values in the array. Compared to LAHC, the proposed Diversified Late Acceptance Search approach is shown to lead to better quality solutions that are obtained with a lower number of iterations on benchmark Travelling Salesman Problems and Quadratic Assignment Problems.

[1]  Sanja Petrovic,et al.  A Step Counting Hill Climbing Algorithm applied to University Examination Timetabling , 2016, J. Sched..

[2]  Eduardo G. Carrano,et al.  Late acceptance hill-climbing for high school timetabling , 2016, J. Sched..

[3]  Eric Bourreau,et al.  Machine reassignment problem: the ROADEF/EURO challenge 2012 , 2016, Annals of Operations Research.

[4]  Anmar Abuhamdah,et al.  Experimental Result of Late Acceptance Randomized Descent Algorithm for Solving Course Timetabling Problems , 2010 .

[5]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[6]  Ryan R. Curtin,et al.  A generic and fast C++ optimization framework , 2017, ArXiv.

[7]  Conrad Sanderson,et al.  ensmallen: a flexible C++ library for efficient function optimization , 2018, NIPS 2018.

[8]  D. Landa-Silva,et al.  Great deluge with non-linear decay rate for solving course timetabling problems , 2008, 2008 4th International IEEE Conference Intelligent Systems.

[9]  Edmund K. Burke,et al.  The late acceptance Hill-Climbing heuristic , 2017, Eur. J. Oper. Res..

[10]  Fernando G. Lobo,et al.  Parameter-less late acceptance hill-climbing , 2017, GECCO.

[11]  G. Dueck New optimization heuristics , 1993 .

[12]  Paul McMullan,et al.  An Extended Implementation of the Great Deluge Algorithm for Course Timetabling , 2007, International Conference on Computational Science.

[13]  Túlio A. M. Toffolo,et al.  The winning approach for the Verolog Solver Challenge 2014: the Swap-Body Vehicle Routing Problem , 2015 .

[14]  Gerhard W. Dueck,et al.  Threshold accepting: a general purpose optimization algorithm appearing superior to simulated anneal , 1990 .

[15]  Thomas Stützle,et al.  Stochastic Local Search: Foundations & Applications , 2004 .

[17]  Sanja Petrovic,et al.  A time-predefined local search approach to exam timetabling problems , 2004 .

[18]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[19]  Joe Henry Obit,et al.  Non-linear great deluge with learning mechanism for solving the course timetabling problem , 2009 .

[20]  E. A. Newman,et al.  Techniques for Producing School Timetables on a Computer and their Application to other Scheduling Problems , 1961, Comput. J..