An Analysis of $N\!K$ Landscapes: Interaction Structure, Statistical Properties, and Expected Number of Local Optima

Simulated landscapes have been used for decades to evaluate search strategies whose goal is to find the landscape location with maximum fitness. Understanding properties of landscapes is important for understanding search difficulty. This paper presents a novel and transparent characterization of NK landscapes and derives an analytic expression representing the expected number of local optima. We prove that NK landscapes can be represented by parametric linear interaction models where model coefficients have meaningful interpretations. We derive the statistical properties of the model coefficients, providing insight into how the NK algorithm parses importance to main effects and interactions. An important insight derived from the linear model representation is that the rank of the linear model defined by the NK algorithm is correlated with the number of local optima, a strong determinant of landscape complexity, and search difficulty. We show that the maximal rank for an NK landscape is achieved through epistatic interactions that form partially balanced incomplete block designs. Finally, an analytic expression representing the expected number of local optima on the landscape is derived, providing a way to quickly compute the expected number of local optima for very large landscapes.

[1]  Anton V. Eremeev,et al.  On Confidence Intervals for the Number of Local Optima , 2003, EvoWorkshops.

[2]  E. D. Weinberger,et al.  The NK model of rugged fitness landscapes and its application to maturation of the immune response. , 1989, Journal of theoretical biology.

[3]  L. Darrell Whitley,et al.  A Walsh Analysis of NK-Landscapes , 1997, ICGA.

[4]  L. Altenberg B2.7.2 NK Fitness Landscapes , 1997 .

[5]  Colin R. Reeves,et al.  Epistasis in Genetic Algorithms: An Experimental Design Perspective , 1995, ICGA.

[6]  Stuart A. Kauffman,et al.  The origins of order , 1993 .

[7]  C. Reeves,et al.  Properties of fitness functions and search landscapes , 2001 .

[8]  Sébastien Vérel,et al.  Local Optima Networks of NK Landscapes With Neutrality , 2011, IEEE Transactions on Evolutionary Computation.

[9]  Thomas J. Santner,et al.  An Inequality for Multivariate Normal Probabilities with Application to a Design Problem , 1977 .

[10]  F. Eeckman,et al.  Evolution and Biocomputation: Computational Models of Evolution , 1995 .

[11]  Christian M. Reidys,et al.  Combinatorial Landscapes , 2002, SIAM Rev..

[12]  Colin R. Reeves,et al.  Experiments with Tuneable Fitness Landscapes , 2000, PPSN.

[13]  Lee Altenberg,et al.  Genome Growth and the Evolution of the Genotype-Phenotype Map , 1995, Evolution and Biocomputation.

[14]  Steven N. Evans,et al.  ESTIMATING SOME FEATURES OF NK FITNESS LANDSCAPES , 2002 .

[15]  Sheldon H. Jacobson,et al.  Global optima results for the Kauffman NK model , 2006, Math. Program..

[16]  Sébastien Vérel,et al.  On the structure of multiobjective combinatorial search space: MNK-landscapes with correlated objectives , 2013, Eur. J. Oper. Res..

[17]  Jim Smith,et al.  New Methods for Tunable, Random Landscapes , 2000, FOGA.

[18]  Bart Naudts,et al.  A comparison of predictive measures of problem difficulty in evolutionary algorithms , 2000, IEEE Trans. Evol. Comput..

[19]  A. Genz,et al.  Computation of Multivariate Normal and t Probabilities , 2009 .

[20]  C. Colbourn,et al.  Handbook of Combinatorial Designs , 2006 .

[21]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.

[22]  P. Matthews,et al.  Generating uniformly distributed random latin squares , 1996 .

[23]  Colin R. Reeves,et al.  An Experimental Design Perspective on Genetic Algorithms , 1994, FOGA.

[24]  S. Kauffman,et al.  Searching the Clinical Fitness Landscape , 2012, PloS one.