Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale

In the past decades, different kinds of metaheuristic optimization algorithms [1, 2] have been developed; Simulated Annealing (SA) [3, 4], Evolutionary Algorithms (EAs) [5–7], Differential Evolution (DE) [8, 9], Particle Swarm Optimization (PSO) [10, 11], Ant Colony Optimization (ACO) [12, 13], and Estimation of Distribution Algorithms (EDAs) [14, 15] are just a few of them. These algorithms have shown excellent search abilities but often lose their efficacy when applied to large and complex problems, e.g., problem instances with high dimensions, such as those with more than one hundred decision variables. Many optimization methods suffer from the “curse of dimensionality” [16, 17], which implies that their performance deteriorates quickly as the dimensionality of the search space increases. The reasons for this phenomenon appear to be two-fold. First, the solution space of a problem often increases exponentially with the problem dimension [16, 17] and more efficient search strategies are required to explore all promising regions within a given time budget. Second, also the characteristics of a problem may change with the scale. Rosenbrock’s function [18] (see also Section 2.6), for instance, is unimodal for two dimension but becomes multimodal for higher ones [19]. Because of such a worsening of the features of an optimization problem resulting from an increase in scale, a previously successful search strategy may no longer be capable of finding the optimal solution. Historically, scaling EAs to large-scale problems has attracted much interest, including both theoretical and practical studies. The earliest practical approach might be parallelizing an existing EA [20–22]. Later, cooperative coevolution appeared as another promising method [23, 24]. However, existing works on this topic are often limited to test problems used in individual studies and a systematic evaluation platform is still not available in literature for comparing the scalability of different EAs. This report aims to contribute to solving this problem. In particular, we provide a suite of benchmark functions for large-scale numerical optimization. Although the difficulty of a problem generally increases with its dimensionality, it is natural that some highdimensional problems are easier than others. For example, if the decision variables involved in a problem are independent of each other, the problem can be easily solved by decomposing it into a number of sub-problems, each of which involving only one decision variable while treating all others as constants. This way, even a line search or greedy method can solve the problem efficiently [25]. This class of problem is known as separable problems, and has been formally defined in [26] as follows:

[1]  A. Dickson On Evolution , 1884, Science.

[2]  Philippe L. Toint,et al.  Optimizing partially separable functions without derivatives , 2005, Optim. Methods Softw..

[3]  Cara MacNish Towards unbiased benchmarking of evolutionary and hybrid algorithms for real-valued optimisation , 2007, Connect. Sci..

[4]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[5]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[6]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[7]  Zhenyu Yang,et al.  Large-Scale Global Optimization Using Cooperative Coevolution with Variable Interaction Learning , 2010, PPSN.

[8]  Alfred O. Hero,et al.  Convergent incremental optimization transfer algorithms: application to tomography , 2006, IEEE Transactions on Medical Imaging.

[9]  Thomas Weise,et al.  Global Optimization Algorithms -- Theory and Application , 2009 .

[10]  Cara MacNish,et al.  Benchmarking Evolutionary and Hybrid Algorithms Using Randomized Self-similar Landscapes , 2006, SEAL.

[11]  D. Goldberg,et al.  A Survey of Linkage Learning Techniques in Genetic and Evolutionary Algorithms , 2007 .

[12]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[13]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[14]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[15]  Bernhard Sendhoff,et al.  Three dimensional evolutionary aerodynamic design optimization with CMA-ES , 2005, GECCO '05.

[16]  Yuval Davidor,et al.  Epistasis Variance: A Viewpoint on GA-Hardness , 1990, FOGA.

[17]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[18]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[19]  George B. Dantzig,et al.  Decomposition Principle for Linear Programs , 1960 .

[20]  R. Haftka,et al.  Multidisciplinary aerospace design optimization: survey of recent developments , 1997 .

[21]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[22]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[23]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[24]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[25]  F. Glover,et al.  Handbook of Metaheuristics , 2019, International Series in Operations Research & Management Science.

[26]  D. Goldberg,et al.  Escaping hierarchical traps with competent genetic algorithms , 2001 .

[27]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[28]  Dr. Zbigniew Michalewicz,et al.  How to Solve It: Modern Heuristics , 2004 .

[29]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary aerospace design optimization - Survey of recent developments , 1996 .

[30]  M. Clerc,et al.  Particle Swarm Optimization , 2006 .

[31]  James Kennedy,et al.  Particle swarm optimization , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[32]  Todd Munson,et al.  Benchmarking optimization software with COPS 3.0. , 2001 .

[33]  Raymond Ros,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Experimental Setup , 2009 .

[34]  Heinz Mühlenbein,et al.  Parallel Genetic Algorithms, Population Genetics, and Combinatorial Optimization , 1989, Parallelism, Learning, Evolution.

[35]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[36]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[37]  C. B. Lucasius,et al.  Genetic algorithms for large-scale optimization in chemometrics: An application , 1991 .

[38]  David E. Goldberg,et al.  Combining The Strengths Of Bayesian Optimization Algorithm And Adaptive Evolution Strategies , 2002, GECCO.

[39]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[40]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[41]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[42]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[43]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[44]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[45]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[46]  Yuval Davidor,et al.  Epistasis Variance: Suitability of a Representation to Genetic Algorithms , 1990, Complex Syst..

[47]  YaoXin,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008 .

[48]  Raymond Chiong,et al.  Why Is Optimization Difficult? , 2009, Nature-Inspired Algorithms for Optimisation.

[49]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[50]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[51]  Panos Y. Papalambros,et al.  Hierarchical Decomposition Synthesis in Optimal Systems Design , 1996, DAC 1996.

[52]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[53]  N. Garc'ia-Pedrajas,et al.  CIXL2: A Crossover Operator for Evolutionary Algorithms Based on Population Features , 2005, J. Artif. Intell. Res..

[54]  Erick Cantú-Paz,et al.  A Survey of Parallel Genetic Algorithms , 2000 .

[55]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[56]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[57]  Anne Auger,et al.  Real-Parameter Black-Box Optimization Benchmarking 2009: Noiseless Functions Definitions , 2009 .

[58]  P. Toint,et al.  Partitioned variable metric updates for large structured optimization problems , 1982 .

[59]  Xiaodong Li,et al.  Smart use of computational resources based on contribution for cooperative co-evolutionary algorithms , 2011, GECCO '11.

[60]  Rainer Schrader,et al.  A Note on the Finite Time Behavior of Simulated Annealing , 2000, Math. Oper. Res..

[61]  P. Phillips The language of gene interaction. , 1998, Genetics.

[62]  Francisco Herrera,et al.  MA-SW-Chains: Memetic algorithm based on local search chains for large scale continuous global optimization , 2010, IEEE Congress on Evolutionary Computation.

[63]  P. Toint,et al.  Local convergence analysis for partitioned quasi-Newton updates , 1982 .

[64]  Yaochu Jin,et al.  Adaptive encoding for aerodynamic shape optimization using evolution strategies , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[65]  Josef Stoer,et al.  Numerische Mathematik 1 , 1989 .

[66]  Richard Bellman,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.