Parameter Tuning Problem in Metaheuristics: A Self-Adaptive Local Search Algorithm for Combinatorial Problems

Combinatorial optimization is an important mathematical topic that consists of finding an optimal solution from a finite set of search space. Many problems encountered in real life are defined as combinatorial optimization. There is an increasing interest among researchers to develop heuristic algorithms for combinatorial optimization problems, because enumeration based search is not feasible for them. So, obtaining global optimum solutions for these problems, within a reasonable time, is extremely difficult by exact algorithms. Particularly in recent years, high-level metaheuristics have been developed for combinatorial optimization problems. On the other hand, it is known that metaheuristic algorithms are controlled by a set of parameters. The best parameter set reveals better performance such as solution quality and computer times. The process to find the best parameter set is called parameter optimization or parameter tuning that requires a deep learning of the problem structure or a roughly trial-and-error process. An alternative way for tuning is to control parameters through the running of the algorithms. Those algorithms utilize some feedback from the search and change the parameter values adaptively depending on the knowledge. There is a great deal to develop adaptive algorithms for combinatorial optimization problems to overcome the difficulties of parameter tuning. While a survey is carried out about parameter tuning approaches for metaheuristics, the performance of a new self-adaptive local search (SALS) algorithm is introduced in this chapter, and investigated for the vehicle routing problem considering both single and multi-objectives on a large scale suit of test problems.

[1]  V. Vassiliadis,et al.  A Backtracking Adaptive Threshold Accepting Algorithm for the Vehicle Routing Problem , 2002 .

[2]  Nicos Christofides,et al.  An Algorithm for the Vehicle-dispatching Problem , 1969 .

[3]  George C. Runger,et al.  Using Experimental Design to Find Effective Parameter Settings for Heuristics , 2001, J. Heuristics.

[4]  Cigdem Alabas-Uslu A self-tuning heuristic for a multi-objective vehicle routing problem , 2008, J. Oper. Res. Soc..

[5]  Sadiq M. Sait,et al.  Iterative computer algorithms with applications in engineering - solving combinatorial optimization problems , 2000 .

[6]  A. E. Eiben,et al.  A method for parameter calibration and relevance estimation in evolutionary algorithms , 2006, GECCO '06.

[7]  Christian Prins,et al.  A simple and effective evolutionary algorithm for the vehicle routing problem , 2004, Comput. Oper. Res..

[8]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[9]  Bruce L. Golden,et al.  Very large-scale vehicle routing: new test problems, algorithms, and results , 2005, Comput. Oper. Res..

[10]  Cigdem Alabas-Uslu,et al.  A Self-Adaptive Heuristic Algorithm for Combinatorial Optimization Problems , 2014, Int. J. Comput. Intell. Syst..

[11]  Resit Unal,et al.  Comparative studies on design of experiments for tuning parameters in a genetic algorithm for a scheduling problem , 2011 .

[12]  David Salt,et al.  Instance-specific multi-objective parameter tuning based on fuzzy logic , 2012, Eur. J. Oper. Res..

[13]  Fernando G. Lobo,et al.  A parameter-less genetic algorithm , 1999, GECCO.

[14]  Ángel Corberán,et al.  Heuristic solutions to the problem of routing school buses with multiple objectives , 2002, J. Oper. Res. Soc..

[15]  Gisbert Schneider,et al.  Optimized Particle Swarm Optimization (OPSO) and its application to artificial neural network training , 2006, BMC Bioinformatics.

[16]  Christos D. Tarantilis,et al.  Solving the vehicle routing problem with adaptive memory programming methodology , 2005, Comput. Oper. Res..

[17]  J. E. Smith,et al.  Co-evolving memetic algorithms: a learning approach to robust scalable optimisation , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[18]  Thomas Stützle,et al.  A Racing Algorithm for Configuring Metaheuristics , 2002, GECCO.

[19]  Thomas Stützle,et al.  Automatic Algorithm Configuration Based on Local Search , 2007, AAAI.

[20]  Cigdem Alabas-Uslu,et al.  A self-tuning heuristic for the design of communication networks , 2015, J. Oper. Res. Soc..

[21]  Cigdem Alabas-Uslu,et al.  A local search heuristic with self-tuning parameter for permutation flow-shop scheduling problem , 2009, 2009 IEEE Symposium on Computational Intelligence in Scheduling.

[22]  Olli Bräysy,et al.  Active-guided evolution strategies for large-scale capacitated vehicle routing problems , 2007, Comput. Oper. Res..

[23]  Michael Affenzeller,et al.  Parameter Meta-optimization of Metaheuristic Optimization Algorithms , 2011, EUROCAST.

[24]  Zbigniew Michalewicz,et al.  Self-Adaptive Genetic Algorithm for Numeric Functions , 1996, PPSN.

[25]  Bruce L. Golden,et al.  A Parallel Algorithm for the Vehicle Routing Problem , 2011, INFORMS J. Comput..

[26]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[27]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[28]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[29]  Joaquín A. Pacheco,et al.  Tabu search for a multi-objective routing problem , 2006, J. Oper. Res. Soc..

[30]  Paolo Toth,et al.  The Granular Tabu Search and Its Application to the Vehicle-Routing Problem , 2003, INFORMS J. Comput..

[31]  Ahamad Tajudin Abdul Khader,et al.  A parameter-less genetic algorithm with customized crossover and mutation operators , 2011, GECCO '11.

[32]  James P. Kelly,et al.  A Network Flow-Based Tabu Search Heuristic for the Vehicle Routing Problem , 1996, Transp. Sci..

[33]  Thomas Stützle,et al.  Improvement Strategies for the F-Race Algorithm: Sampling Design and Iterative Refinement , 2007, Hybrid Metaheuristics.

[34]  Christos D. Tarantilis,et al.  BoneRoute: An Adaptive Memory-Based Method for Effective Fleet Management , 2002, Ann. Oper. Res..

[35]  Natalio Krasnogor,et al.  A Study on the use of ``self-generation'' in memetic algorithms , 2004, Natural Computing.

[36]  Leslie Pérez Cáceres,et al.  The irace package: Iterated racing for automatic algorithm configuration , 2016 .

[37]  Roberto Battiti,et al.  The Reactive Tabu Search , 1994, INFORMS J. Comput..

[38]  Felix Dobslaw,et al.  A parameter-tuning framework for metaheuristics based on design of experiments and artificial neural networks , 2010 .

[39]  Richard F. Hartl,et al.  D-Ants: Savings Based Ants divide and conquer the vehicle routing problem , 2004, Comput. Oper. Res..

[40]  Manuel Laguna,et al.  Fine-Tuning of Algorithms Using Fractional Experimental Designs and Local Search , 2006, Oper. Res..

[41]  Cláudio F. Lima,et al.  Parameter-Less Optimization with the Extended Compact Genetic Algorithm and Iterated Local Search , 2004, GECCO.

[42]  Thomas Bartz-Beielstein,et al.  Experimental Research in Evolutionary Computation - The New Experimentalism , 2010, Natural Computing Series.

[43]  Messias Borges Silva,et al.  Improving the Performance of Metaheuristics: An Approach Combining Response Surface Methodology and Racing Algorithms , 2015 .

[44]  Zbigniew Michalewicz,et al.  Parameter control in evolutionary algorithms , 1999, IEEE Trans. Evol. Comput..

[45]  Christos D. Tarantilis,et al.  A List Based Threshold Accepting Algorithm for the Capacitated Vehicle Routing Problem , 2002, Int. J. Comput. Math..