Generating Easy and Hard Problems using the Proximate Optimality Principle

We present an approach to generating problems of variable difficulty based on the well-known Proximate Optimality Principle (POP), often paraphrased as "similar solutions have similar fitness". We explore definitions of this concept in terms of metrics in objective space and in representation space and define POP in terms of coherence of these metrics. We hypothesise that algorithms will perform well when the neighbourhoods they explore in representation space are coherent with the natural metric induced by fitness on objective space. We develop an explicit method of problem generation which creates bit string problems where the natural fitness metric is coherent or anti-coherent with Hamming neighbourhoods. We conduct experiments to show that coherent problems are easy whereas anti-coherent problems are hard for local hill climbers using the Hamming neighbourhoods.

[1]  John A. W. McCall,et al.  Structural coherence of problem and algorithm: An analysis for EDAs on all 2-bit and 3-bit problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[2]  Laura I. Burke,et al.  A two-phase tabu search approach to the location routing problem , 1999, Eur. J. Oper. Res..

[3]  Atsushi Ishigame,et al.  Multipoint Tabu Search based on proximate optimality principle—application of parts concept , 2007 .

[4]  R. Prim Shortest connection networks and some generalizations , 1957 .

[5]  Qingfu Zhang,et al.  Meta-Heuristic Combining Prior Online and Offline Information for the Quadratic Assignment Problem , 2014, IEEE Transactions on Cybernetics.

[6]  Qingfu Zhang,et al.  An estimation of distribution algorithm with guided mutation for a complex flow shop scheduling problem , 2007, GECCO '07.

[7]  Hui Li,et al.  An Elitist GRASP Metaheuristic for the Multi-objective Quadratic Assignment Problem , 2009, EMO.

[8]  John A. W. McCall,et al.  Minimal walsh structure and ordinal linkage of monotonicity-invariant function classes on bit strings , 2014, GECCO.

[9]  Qingfu Zhang,et al.  An evolutionary algorithm with guided mutation for the maximum clique problem , 2005, IEEE Transactions on Evolutionary Computation.

[10]  Xin Yao,et al.  On the Easiest and Hardest Fitness Functions , 2012, IEEE Transactions on Evolutionary Computation.

[11]  Atsushi Ishigame,et al.  Basic study of proximate optimality principle based combinatorial optimization method , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.