Local search for the Traveling Salesman Problem: A comparative study

The Traveling Salesman Problem (TSP) is one of the most well-studied combinatorial optimization problems. Best heuristics for solving the TSP known today are Lin-Kernighan (LK) local search methods. Recently, Multi-Neighborhood Search (MNS) has been proposed and was demonstrated to outperform Variable Neighborhood Search based methods on the TSP. While LK performs a variable k-opt based search operation, MNS is able to carry out multiple 2-, 3-, or 4-opt moves at once, which are discovered by a highly efficient scan of the current solution. Apart from LK and MNS, many other modern heuristics for TSPs can be found in the relevant literature. However, existing studies rarely use robust statistics for the heuristic algorithms in comparison, let alone investigate their progress over time. This leads to flawed comparisons of simple end-of-run statistics and inappropriate or even incorrect conclusions. In this paper, we thoroughly compare LK and MNS as well as their hybrid versions with Evolutionary Algorithms (EAs) and Population-based Ant Colony Optimization (PACO). This work, to the best of our knowledge, is the first statistically sound comparison of the two efficient heuristics as well as their hybrids with EAs and PACO over time based on a large-scale experimental study. We not only show that hybrid PACO-MNS and PACO-LK are both very efficient, but also find that the full runtime behavior comparison provides deeper and clearer insights whereas a focus of final results could indeed have led to a deceitful conclusion.

[1]  Raymond Ros,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[2]  Pedro Larrañaga,et al.  Genetic Algorithms for the Travelling Salesman Problem: A Review of Representations and Operators , 1999, Artificial Intelligence Review.

[3]  Michael Guntsch,et al.  Applying Population Based ACO to Dynamic Optimization Problems , 2002, Ant Algorithms.

[4]  Abraham P. Punnen,et al.  The traveling salesman problem and its variations , 2007 .

[5]  N. Hansen,et al.  Real-Parameter Black-Box Optimization Benchmarking: Experimental Setup , 2010 .

[6]  Kenneth de Jong,et al.  Evolutionary computation: a unified approach , 2007, GECCO.

[7]  J. Monnot,et al.  The Traveling Salesman Problem and its Variations , 2014 .

[8]  Xin Yao,et al.  Evolutionary Optimization , 2002 .

[9]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[10]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[11]  Raymond Chiong,et al.  Local search for real-world scheduling and planning , 2012, Eng. Appl. Artif. Intell..

[12]  D. Fogel An evolutionary approach to the traveling salesman problem , 1988, Biological Cybernetics.

[13]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[14]  Thomas Stützle,et al.  Ant colony optimization: artificial ants as a computational intelligence technique , 2006 .

[15]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[16]  Thomas Stützle,et al.  Evaluating Las Vegas Algorithms: Pitfalls and Remedies , 1998, UAI.

[17]  Thomas Weise,et al.  Global Optimization Algorithms -- Theory and Application , 2009 .

[18]  Pierre Hansen,et al.  Variable neighbourhood search: methods and applications , 2010, Ann. Oper. Res..

[19]  Mark S. Boddy,et al.  Solving Time-Dependent Planning Problems , 1989, IJCAI.

[20]  Raymond Chiong,et al.  Nature That Breeds Solutions , 2012, Int. J. Signs Semiot. Syst..

[21]  Eugene L. Lawler,et al.  The Traveling Salesman Problem: A Guided Tour of Combinatorial Optimization , 1985 .

[22]  Keld Helsgaun,et al.  An effective implementation of the Lin-Kernighan traveling salesman heuristic , 2000, Eur. J. Oper. Res..

[23]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[24]  Zbigniew Michalewicz,et al.  Evolutionary Optimization , 2012, Variants of Evolutionary Algorithms for Real-World Applications.

[25]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[26]  Gerhard Reinelt,et al.  TSPLIB - A Traveling Salesman Problem Library , 1991, INFORMS J. Comput..

[27]  Juliane Jung,et al.  The Traveling Salesman Problem: A Computational Study , 2007 .

[28]  Raymond Chiong,et al.  A hybrid nearest neighbour and progressive improvement approach for Travelling Salesman Problem , 2008, 2008 International Symposium on Information Technology.

[29]  Holger H. Hoos,et al.  UBCSAT: An Implementation and Experimentation Environment for SLS Algorithms for SAT & MAX-SAT , 2004, SAT.

[30]  Forschungsinstitut für Diskrete Chained Lin-Kernighan for Large Traveling Salesman Problems , 2003 .

[31]  Rukshan Athauda,et al.  Comparing a hybrid branch and bound algorithm with evolutionary computation methods, local search and their hybrids on the TSP , 2014, 2014 IEEE Symposium on Computational Intelligence in Production and Logistics Systems (CIPLS).

[32]  Zbigniew Michalewicz,et al.  Benchmarking Optimization Algorithms: An Open Source Framework for the Traveling Salesman Problem , 2014, IEEE Computational Intelligence Magazine.

[33]  William J. Cook,et al.  The Traveling Salesman Problem: A Computational Study , 2007 .

[34]  Darrell Whitley,et al.  Scheduling problems and traveling salesman: the genetic edge recombination , 1989 .

[35]  Keld Helsgaun,et al.  General k-opt submoves for the Lin–Kernighan TSP heuristic , 2009, Math. Program. Comput..

[36]  Luca Maria Gambardella,et al.  Solving symmetric and asymmetric TSPs by ant colonies , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.