Multi-Objectivising Combinatorial Optimisation Problems by Means of Elementary Landscape Decompositions

In the last decade, many works in combinatorial optimisation have shown that, due to the advances in multi-objective optimisation, the algorithms from this field could be used for solving single-objective problems as well. In this sense, a number of papers have proposed multi-objectivising single-objective problems in order to use multi-objective algorithms in their optimisation. In this article, we follow up this idea by presenting a methodology for multi-objectivising combinatorial optimisation problems based on elementary landscape decompositions of their objective function. Under this framework, each of the elementary landscapes obtained from the decomposition is considered as an independent objective function to optimise. In order to illustrate this general methodology, we consider four problems from different domains: the quadratic assignment problem and the linear ordering problem (permutation domain), the 0-1 unconstrained quadratic optimisation problem (binary domain), and the frequency assignment problem (integer domain). We implemented two widely known multi-objective algorithms, NSGA-II and SPEA2, and compared their performance with that of a single-objective GA. The experiments conducted on a large benchmark of instances of the four problems show that the multi-objective algorithms clearly outperform the single-objective approaches. Furthermore, a discussion on the results suggests that the multi-objective space generated by this decomposition enhances the exploration ability, thus permitting NSGA-II and SPEA2 to obtain better results in the majority of the tested instances.

[1]  Franz Rendl,et al.  QAPLIB – A Quadratic Assignment Problem Library , 1997, J. Glob. Optim..

[2]  Gerhard Reinelt,et al.  The Linear Ordering Problem: Exact and Heuristic Methods in Combinatorial Optimization , 2011 .

[3]  Frank Neumann,et al.  Minimum spanning trees made easier via multi-objective optimization , 2005, GECCO '05.

[4]  Lov K. Grover Local search and the local structure of NP-complete problems , 1992, Oper. Res. Lett..

[5]  Carlo Mannino,et al.  Models and solution techniques for frequency assignment problems , 2003, 4OR.

[6]  Enrique Alba,et al.  Autocorrelation measures for the quadratic assignment problem , 2012, Appl. Math. Lett..

[7]  Enrique Alba,et al.  Elementary landscape decomposition of the 0-1 unconstrained quadratic optimization , 2011, Journal of Heuristics.

[8]  H. Finner,et al.  Stepwise multiple test procedures and control of directional errors , 1999 .

[9]  Richard A. Watson,et al.  Reducing Local Optima in Single-Objective Problems by Multi-objectivization , 2001, EMO.

[10]  Enrique Alba,et al.  Elementary landscape decomposition of the frequency assignment problem , 2011, Theor. Comput. Sci..

[11]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[12]  Peter F. Stadler,et al.  Fast Fourier Transform for Fitness Landscapes , 2002 .

[13]  Hussein A. Abbass,et al.  Searching under Multi-evolutionary Pressures , 2003, EMO.

[14]  Alexander Mendiburu,et al.  Multi-objectivising the Quadratic Assignment Problem by Means of an Elementary Landscape Decomposition , 2015, CAEPIA.

[15]  Gerhard Reinelt,et al.  The Linear Ordering Problem , 2011 .

[16]  T. Koopmans,et al.  Assignment Problems and the Location of Economic Activities , 1957 .

[17]  Ingo Wegener,et al.  The analysis of evolutionary algorithms on sorting and shortest paths problems , 2004, J. Math. Model. Algorithms.

[18]  P. Stadler Landscapes and their correlation functions , 1996 .

[19]  Fred W. Glover,et al.  One-pass heuristics for large-scale unconstrained binary quadratic problems , 2002, Eur. J. Oper. Res..

[20]  F. Glover,et al.  Adaptive Memory Tabu Search for Binary Quadratic Programs , 1998 .

[21]  Alexander Mendiburu,et al.  A review of distances for the Mallows and Generalized Mallows estimation of distribution algorithms , 2015, Comput. Optim. Appl..

[22]  Zvi Drezner,et al.  Recent Advances for the Quadratic Assignment Problem with Special Emphasis on Instances that are Difficult for Meta-Heuristic Methods , 2005, Ann. Oper. Res..

[23]  Andrew M. Sutton,et al.  A polynomial time computation of the exact correlation structure of k-satisfiability landscapes , 2009, GECCO '09.

[24]  P. Good,et al.  Permutation Tests: A Practical Guide to Resampling Methods for Testing Hypotheses , 1995 .

[25]  Andrew M. Sutton,et al.  Understanding elementary landscapes , 2008, GECCO '08.

[26]  Joshua D. Knowles,et al.  Multiobjectivization by Decomposition of Scalar Cost Functions , 2008, PPSN.

[27]  John E. Beasley,et al.  Heuristic algorithms for the unconstrained binary quadratic programming problem , 1998 .

[28]  Vassilis Zissimopoulos,et al.  On the Classification of NP-complete Problems in Terms of Their Correlation Coefficient , 2000, Discret. Appl. Math..

[29]  Alexander Mendiburu,et al.  Extending distance-based ranking models in estimation of distribution algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[30]  L. Darrell Whitley,et al.  A Tractable Walsh Analysis of SAT and its Implications for Genetic Algorithms , 1998, AAAI/IAAI.

[31]  Gara Miranda,et al.  Using multi-objective evolutionary algorithms for single-objective optimization , 2013, 4OR.

[32]  Borja Calvo,et al.  scmamp: Statistical Comparison of Multiple Algorithms in Multiple Problems , 2016, R J..

[33]  Sigeru Omatu,et al.  Efficient Genetic Algorithms Using Simple Genes Exchange Local Search Policy for the Quadratic Assignment Problem , 2000, Comput. Optim. Appl..

[34]  Enrique Alba,et al.  A Methodology to Find the Elementary Landscape Decomposition of Combinatorial Optimization Problems , 2011, Evolutionary Computation.

[35]  Enrique Alba,et al.  Elementary Landscape Decomposition of the Test Suite Minimization Problem , 2011, SSBSE.

[36]  Alexander Mendiburu,et al.  The linear ordering problem revisited , 2015, Eur. J. Oper. Res..

[37]  Eric Angela,et al.  On the landscape ruggedness of the quadratic assignment problem , 2001 .

[38]  Carlo Mannino,et al.  Models and solution techniques for frequency assignment problems , 2003, 4OR.

[39]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[40]  Vassilis Zissimopoulos,et al.  On the landscape ruggedness of the quadratic assignment problem , 2001, Theor. Comput. Sci..

[41]  Enrique Alba,et al.  Elementary Components of the Quadratic Assignment Problem , 2011, ArXiv.

[42]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[43]  P. Stadler Fitness Landscapes , 1993 .

[44]  Enrique Alba,et al.  Elementary landscape decomposition of the quadratic assignment problem , 2010, GECCO '10.