Improving hyper-heuristic performance through feature transformation

Hyper-heuristics are powerful search methodologies that can adapt to different kinds of problems. One element of paramount importance, however, is the selection module that they incorporate. Traditional approaches define a set of features for characterizing a problem and, thus, define how to best solve it. However, some features may vary nonlinearly as the solver progresses, requiring higher resolution in specific areas of the feature domain. This work focuses on assessing the advantage of using feature transformations to improve the given resolution and, as a consequence, to improve the overall performance of a hyper-heuristic. We provide evidence that using feature transformations may result in a better discrimination of the problem instance and, as consequence, a better performance of the hyper-heuristics. The feature transformation strategy was applied to an evolutionary-based hyper-heuristic model taken from the literature and tested on constraint satisfaction problems The proposed strategy increased the median success rate of hyper-heuristics by more than 13% and reduced its standard deviation in about 7%, while reducing the median number of adjusted consistency checks by almost 30%.

[1]  Ben Paechter,et al.  A Lifelong Learning Hyper-heuristic Method for Bin Packing , 2015, Evolutionary Computation.

[2]  Lakhdar Sais,et al.  Boosting Systematic Search by Weighting Constraints , 2004, ECAI.

[3]  Alex Alves Freitas,et al.  Contrasting meta-learning and hyper-heuristic research: the role of evolutionary algorithms , 2013, Genetic Programming and Evolvable Machines.

[4]  Susan L. Epstein,et al.  The Adaptive Constraint Engine , 2002, CP.

[5]  Hugo Terashima-Marín,et al.  Combine and conquer: an evolutionary hyper-heuristic approach for solving constraint satisfaction problems , 2016, Artificial Intelligence Review.

[6]  James M. McCollum,et al.  A constraint satisfaction algorithm for microcontroller selection and pin assignment , 2010, Proceedings of the IEEE SoutheastCon 2010 (SoutheastCon).

[7]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[8]  Barry O'Sullivan,et al.  Evolving Instance Specific Algorithm Configuration , 2021, SOCS.

[9]  Hugo Terashima-Marín,et al.  A Neuro-evolutionary Hyper-heuristic Approach for Constraint Satisfaction Problems , 2015, Cognitive Computation.

[10]  Sanja Petrovic,et al.  Case-Based Reasoning as a Heuristic Selector in a Hyper-Heuristic for Course Timetabling Problems , 2002 .

[11]  Sanja Petrovic,et al.  HyFlex: A Benchmark Framework for Cross-Domain Heuristic Search , 2011, EvoCOP.

[12]  Eoin O'Mahony,et al.  Using Case-based Reasoning in an Algorithm Portfolio for Constraint Solving ? , 2008 .

[13]  Bart Demoen,et al.  Learning a Hidden Markov Model-Based Hyper-heuristic , 2015, LION.

[14]  Edmund K. Burke,et al.  A Reinforcement Learning - Great-Deluge Hyper-Heuristic for Examination Timetabling , 2010, Int. J. Appl. Metaheuristic Comput..

[15]  Rina Dechter,et al.  Experimental Evaluation of Preprocessing Algorithms for Constraint Satisfaction Problems , 1994, Artif. Intell..

[16]  Sanja Petrovic,et al.  Case-based heuristic selection for timetabling problems , 2006, J. Sched..

[17]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[18]  John R. Rice,et al.  The Algorithm Selection Problem , 1976, Adv. Comput..

[19]  Arturo Garcia-Perez,et al.  Designing a microchannel heat sink with colloidal coolants through the entropy generation minimisation criterion and global optimisation algorithms , 2016 .

[20]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[21]  Toby Walsh,et al.  The Constrainedness of Search , 1996, AAAI/IAAI, Vol. 1.

[22]  Paul Walton Purdom,et al.  Search Rearrangement Backtracking and Polynomial Average Time , 1983, Artif. Intell..

[23]  A. B. Petrochenkov,et al.  Structural synthesis of complex electrotechnical equipment on the basis of the constraint satisfaction method , 2015 .

[24]  Patrick De Causmaecker,et al.  A new hyper-heuristic as a general problem solver: an implementation in HyFlex , 2013, J. Sched..