Generating instances with performance differences for more than just two algorithms

In recent years, Evolutionary Algorithms (EAs) have frequently been adopted to evolve instances for optimization problems that pose difficulties for one algorithm while being rather easy for a competitor and vice versa. Typically, this is achieved by either minimizing or maximizing the performance difference or ratio which serves as the fitness function. Repeating this process is useful to gain insights into strengths/weaknesses of certain algorithms or to build a set of instances with strong performance differences as a foundation for automatic per-instance algorithm selection or configuration. We contribute to this branch of research by proposing fitness-functions to evolve instances that show large performance differences for more than just two algorithms simultaneously. As a proof-of-principle, we evolve instances of the multi-component Traveling Thief Problem (TTP) for three incomplete TTP-solvers. Our results point out that our strategies are promising, but unsurprisingly their success strongly relies on the algorithms' performance complementarity.

[1]  Kate Smith-Miles,et al.  Generating New Space-Filling Test Instances for Continuous Black-Box Optimization , 2020, Evolutionary Computation.

[2]  Bryant A. Julstrom,et al.  Evolving heuristically difficult instances of combinatorial problems , 2009, GECCO.

[3]  Markus Wagner,et al.  The Dynamic Travelling Thief Problem: Benchmarks and Performance of Evolutionary Algorithms , 2020, ICONIP.

[4]  Thomas Bartz-Beielstein,et al.  Benchmarking in Optimization: Best Practice and Open Issues , 2020, ArXiv.

[5]  Vincent A. Cicirello JavaPermutationTools: A Java Library of Permutation Distance Metrics , 2018, J. Open Source Softw..

[6]  He Jiang,et al.  Evolving Hard and Easy Traveling Salesman Problem Instances: A Multi-objective Approach , 2014, SEAL.

[7]  Josef Pihera,et al.  Application of Machine Learning to Algorithm Selection for TSP , 2014, 2014 IEEE 26th International Conference on Tools with Artificial Intelligence.

[8]  Günter Rudolph,et al.  Multiobjective optimization for interwoven systems , 2017 .

[9]  Markus Wagner,et al.  Stealing Items More Efficiently with Ants: A Swarm Intelligence Approach to the Travelling Thief Problem , 2016, ANTS Conference.

[10]  S. Martello,et al.  Dynamic Programming and Strong Bounds for the 0-1 Knapsack Problem , 1999 .

[11]  Wanru Gao,et al.  Feature-Based Diversity Optimization for Problem Instance Classification , 2015, Evolutionary Computation.

[12]  Kevin Tierney,et al.  Deep Learning Assisted Heuristic Tree Search for the Container Pre-marshalling Problem , 2017, Comput. Oper. Res..

[13]  Mohamed El Yafrani,et al.  Cosolver2B: An efficient local search heuristic for the Travelling Thief Problem , 2015, 2015 IEEE/ACS 12th International Conference of Computer Systems and Applications (AICCSA).

[14]  Jano I van Hemert,et al.  Evolving combinatorial problem instances that are difficult to solve. , 2006, Evolutionary computation.

[15]  Jano I. van Hemert,et al.  Evolving Combinatorial Problem Instances That Are Difficult to Solve , 2006, Evolutionary Computation.

[16]  Sergey Polyakovskiy,et al.  A Fully Polynomial Time Approximation Scheme for Packing While Traveling , 2017, ALGOCLOUD.

[17]  Markus Wagner,et al.  Discrepancy-based evolutionary diversity optimization , 2018, GECCO.

[18]  Carlos A. Coello Coello,et al.  Evolutionary-based tailoring of synthetic instances for the Knapsack problem , 2019, Soft Comput..

[19]  Moncef Tagina,et al.  A new hybrid ant colony algorithms for the traveling thief problem , 2019, GECCO.

[20]  Andreas Bortfeldt,et al.  A tree search procedure for the container relocation problem , 2012, Comput. Oper. Res..

[21]  Kalyanmoy Deb,et al.  A non-dominated sorting based customized random-key genetic algorithm for the bi-objective traveling thief problem , 2020, Journal of Heuristics.

[22]  Dirk Thierens,et al.  Investigation of the traveling thief problem , 2019, GECCO.

[23]  Markus Wagner,et al.  Evolving diverse TSP instances by means of novel and creative mutation operators , 2019, FOGA '19.

[24]  Markus Wagner,et al.  Approximate Approaches to the Traveling Thief Problem , 2015, GECCO.

[25]  Bernd Bischl,et al.  A novel feature-based approach to characterize algorithm performance for the traveling salesperson problem , 2012, Annals of Mathematics and Artificial Intelligence.

[26]  Adam Wierzbicki,et al.  Socially inspired algorithms for the travelling thief problem , 2014, GECCO.

[27]  Mohamed El Yafrani,et al.  Efficiently solving the Traveling Thief Problem using hill climbing and simulated annealing , 2018, Inf. Sci..

[28]  Xin Yao,et al.  Dynamic Multi-objective Optimization of the Travelling Thief Problem , 2020, ArXiv.

[29]  M. A. Hakim Newton,et al.  A Cooperative Coordination Solver for Travelling Thief Problems , 2019, ArXiv.

[30]  Markus Wagner,et al.  Evolutionary diversity optimization using multi-objective indicators , 2018, GECCO.

[31]  Mohamed El Yafrani,et al.  Population-based vs. Single-solution Heuristics for the Travelling Thief Problem , 2016, GECCO.

[32]  Kalyanmoy Deb,et al.  Solving the Bi-objective Traveling Thief Problem with Multi-objective Evolutionary Algorithms , 2017, EMO.

[33]  Heike Trautmann,et al.  Understanding Characteristics of Evolved Instances for State-of-the-Art Inexact TSP Solvers with Maximum Performance Difference , 2016, AI*IA.

[34]  Zbigniew Michalewicz,et al.  A comprehensive benchmark set and heuristics for the traveling thief problem , 2014, GECCO.

[35]  Jano I. van Hemert,et al.  Discovering the suitability of optimisation algorithms by learning from evolved instances , 2011, Annals of Mathematics and Artificial Intelligence.

[36]  Heike Trautmann,et al.  Evolving Instances for Maximizing Performance Differences of State-of-the-Art Inexact TSP Solvers , 2016, LION.

[37]  Bernd Bischl,et al.  Local Search and the Traveling Salesman Problem: A Feature-Based Characterization of Problem Hardness , 2012, LION.

[38]  Gerrit K. Janssens,et al.  Vehicle routing problems with loading constraints: state-of-the-art and future directions , 2015, OR Spectr..

[39]  Markus Wagner,et al.  HSEDA: a heuristic selection approach based on estimation of distribution algorithm for the travelling thief problem , 2017, GECCO 2017.

[40]  Markus Wagner,et al.  A case study of algorithm selection for the traveling thief problem , 2016, Journal of Heuristics.

[41]  Xiaoxuan Hu,et al.  Supply chain scheduling with batching, production and distribution , 2016, Int. J. Comput. Integr. Manuf..

[42]  Evolving test instances of the Hamiltonian completion problem , 2020, ArXiv.

[43]  Zbigniew Michalewicz,et al.  The travelling thief problem: The first step in the transition from theoretical problems to realistic problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[44]  Thomas Stützle,et al.  Automatic Algorithm Configuration Based on Local Search , 2007, AAAI.

[45]  Markus Wagner,et al.  Multi-objectiveness in the single-objective traveling thief problem , 2017, GECCO.

[46]  Kate Smith-Miles,et al.  Instance spaces for machine learning classification , 2017, Machine Learning.

[47]  Swagatam Das,et al.  Efficient hybrid local search heuristics for solving the travelling thief problem , 2020, Appl. Soft Comput..

[48]  Manuel Iori,et al.  Routing problems with loading constraints , 2010 .

[49]  Gang Wang,et al.  Integrated supply chain scheduling of procurement, production, and distribution under spillover effects , 2021, Comput. Oper. Res..

[50]  J. I. van Hemert Evolving binary constraint satisfaction problem instances that are difficult to solve , 2003 .

[51]  Zbigniew Michalewicz,et al.  Evolutionary computation for multicomponent problems: opportunities and future directions , 2016, Optimization in Industry.

[52]  Andrew Lim,et al.  Solving the container relocation problem by an improved greedy look-ahead heuristic , 2015, Eur. J. Oper. Res..

[53]  Markus Wagner,et al.  Evolutionary computation plus dynamic programming for the bi-objective travelling thief problem , 2018, GECCO.

[54]  Xiaodong Li,et al.  On investigation of interdependence between sub-problems of the Travelling Thief Problem , 2016, Soft Comput..

[55]  Markus Wagner,et al.  A fitness landscape analysis of the travelling thief problem , 2018, GECCO.

[56]  Markus Wagner,et al.  Exact Approaches for the Travelling Thief Problem , 2017, SEAL.

[57]  Heike Trautmann,et al.  Automated Algorithm Selection: Survey and Perspectives , 2018, Evolutionary Computation.