Global optimization test problems based on random field composition

The development and identification of effective optimization algorithms for non-convex real-world problems is a challenge in global optimization. Because theoretical performance analysis is difficult, and problems based on models of real-world systems are often computationally expensive, several artificial performance test problems and test function generators have been proposed for empirical comparative assessment and analysis of metaheuristic optimization algorithms. These test problems however often lack the complex function structures and forthcoming difficulties that can appear in real-world problems. This communication presents a method to systematically build test problems with various types and degrees of difficulty. By weighted composition of parameterized random fields, challenging test functions with tunable function features such as, variance contribution distribution, interaction order, and nonlinearity can be constructed. The method is described, and its applicability to optimization performance analysis is described by means of a few basic examples. The method aims to set a step forward in the systematic generation of global optimization test problems, which could lead to a better understanding of the performance of optimization algorithms on problem types with particular characteristics. On request an introductive MATLAB implementation of a test function generator based on the presented method is available.

[1]  Neculai Andrei,et al.  An Unconstrained Optimization Test Functions Collection , 2008 .

[2]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[3]  Riccardo Poli,et al.  Fitness Distributions and GA Hardness , 2004, PPSN.

[4]  Klaus Schittkowski,et al.  Test examples for nonlinear programming codes , 1980 .

[5]  Johannes M. Dieterich,et al.  Empirical review of standard benchmark functions using evolutionary global optimization , 2012, ArXiv.

[6]  Klaus Schittkowski,et al.  More test examples for nonlinear programming codes , 1981 .

[7]  John N. Tsitsiklis,et al.  NP-hardness of deciding convexity of quartic polynomials and related problems , 2010, Math. Program..

[8]  Hermann Schichl,et al.  The optimization test environment , 2014 .

[9]  David H. Wolpert,et al.  What makes an optimization problem hard? , 1995, Complex..

[10]  Marcus Gallagher,et al.  A general-purpose tunable landscape generator , 2006, IEEE Transactions on Evolutionary Computation.

[11]  Jean Charles Gilbert,et al.  Numerical Optimization: Theoretical and Practical Aspects , 2003 .

[12]  Carlos A. Coello Coello,et al.  Test Function Generators for Assessing the Performance of PSO Algorithms in Multimodal Optimization , 2011 .

[13]  Gilbert Laporte,et al.  Metaheuristics: A bibliography , 1996, Ann. Oper. Res..

[14]  Christodoulos A. Floudas,et al.  A review of recent advances in global optimization , 2009, J. Glob. Optim..

[15]  D. Eichmann More Test Examples For Nonlinear Programming Codes , 2016 .

[16]  Xin-She Yang,et al.  Review of Metaheuristics and Generalized Evolutionary Walk Algorithm , 2011, 1105.3668.

[17]  Arnold Neumaier,et al.  Benchmarking Global Optimization and Constraint Satisfaction Codes , 2002, COCOS.

[18]  Bernardetta Addis,et al.  A new class of test functions for global optimization , 2007, J. Glob. Optim..

[19]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[20]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[21]  Carl A. Gunter,et al.  In handbook of theoretical computer science , 1990 .

[22]  R. Adler,et al.  Random Fields and Geometry , 2007 .

[23]  Niccolò Baldanzini,et al.  Representative surrogate problems as test functions for expensive simulators in multidisciplinary design optimization of vehicle structures , 2016 .

[24]  A. Kolmogorov Three approaches to the quantitative definition of information , 1968 .

[25]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[26]  Nicholas I. M. Gould,et al.  CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimization , 2013, Computational Optimization and Applications.

[27]  Ali Ahrari,et al.  On the utility of randomly generated functions for performance evaluation of evolutionary algorithms , 2010, Optim. Lett..

[28]  Andreas Ritter,et al.  Handbook Of Test Problems In Local And Global Optimization , 2016 .

[29]  J. Frédéric Bonnans,et al.  Numerical Optimization: Theoretical and Practical Aspects (Universitext) , 2006 .

[30]  Sergiy Butenko,et al.  Constructing test functions for global optimization using continuous formulations of graph problems , 2005, Optim. Methods Softw..

[31]  Peter J. Fleming,et al.  The MATLAB genetic algorithm toolbox , 1995 .

[32]  Nicholas I. M. Gould,et al.  CUTEr and SifDec: A constrained and unconstrained testing environment, revisited , 2003, TOMS.

[33]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[34]  Shahryar Rahnamayan,et al.  Metaheuristics in large-scale global continues optimization: A survey , 2015, Inf. Sci..

[35]  W. Hoeffding A Class of Statistics with Asymptotically Normal Distribution , 1948 .