A fitness approximation assisted competitive swarm optimizer for large scale expensive optimization problems

Surrogate assisted meta-heuristic algorithms have received increasing attention over the past years due to the fact that many real-world optimization problems are computationally expensive. However, most existing surrogate assisted meta-heuristic algorithms are designed for small or medium scale problems. In this paper, a fitness approximation assisted competitive swarm optimizer is proposed for optimization of large scale expensive problems. Different from most surrogate assisted evolutionary algorithms that use a computational model for approximating the fitness, we estimate the fitness based on the positional relationship between individuals in the competitive swarm optimizer. Empirical study on seven widely used benchmark problems with 100 and 500 decision variables show that the proposed fitness approximation assisted competitive swarm optimizer is able to achieve competitive performance on a limited computational budget.

[1]  Lamjed Ben Said,et al.  Steady state IBEA assisted by MLP neural networks for expensive multi-objective optimization problems , 2014, GECCO.

[2]  Rommel G. Regis,et al.  Evolutionary Programming for High-Dimensional Constrained Expensive Black-Box Optimization Using Radial Basis Functions , 2014, IEEE Transactions on Evolutionary Computation.

[3]  Dr. Alex A. Freitas.  Data Mining and Knowledge Discovery with Evolutionary Algorithms , 2002, Natural Computing Series.

[4]  Andy J. Keane,et al.  Multi-Objective Optimization Using Surrogates , 2010 .

[5]  Yang Yu,et al.  A two-layer surrogate-assisted particle swarm optimization algorithm , 2014, Soft Computing.

[6]  Kai-Yew Lum,et al.  Max-min surrogate-assisted evolutionary algorithm for robust design , 2006, IEEE Transactions on Evolutionary Computation.

[7]  Jeng-Shyang Pan,et al.  Similarity-based evolution control for fitness estimation in particle swarm optimization , 2013, 2013 IEEE Symposium on Computational Intelligence in Dynamic and Uncertain Environments (CIDUE).

[8]  Rajesh Kumar,et al.  A novel two-level particle swarm optimization approach for efficient multiple sequence alignment , 2015, Memetic Comput..

[9]  Antonin Ponsich,et al.  A Survey on Multiobjective Evolutionary Algorithms for the Solution of the Portfolio Optimization Problem and Other Finance and Economics Applications , 2013, IEEE Transactions on Evolutionary Computation.

[10]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[12]  Bernhard Sendhoff,et al.  Comparing neural networks and Kriging for fitness approximation in evolutionary optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[13]  Ruhul A. Sarker,et al.  Differential evolution framework for big data optimization , 2016, Memetic Comput..

[14]  Jing Liu,et al.  A multi-objective memetic algorithm based on decomposition for big optimization problems , 2016, Memetic Comput..

[15]  Andreas Zell,et al.  Evolution strategies assisted by Gaussian processes with improved preselection criterion , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[16]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[17]  Bernhard Sendhoff,et al.  Evolution by Adapting Surrogates , 2013, Evolutionary Computation.

[18]  Chellapilla Patvardhan,et al.  Quantum-Inspired Evolutionary Algorithm for difficult knapsack problems , 2015, Memetic Comput..

[19]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[20]  Kaisa Miettinen,et al.  A survey on handling computationally expensive multiobjective optimization problems using surrogates: non-nature inspired methods , 2015, Structural and Multidisciplinary Optimization.

[21]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[22]  Martin Holena,et al.  Surrogate Model for Continuous and Discrete Genetic Optimization Based on RBF Networks , 2010, IDEAL.

[23]  Xin Yao,et al.  Classification-assisted Differential Evolution for computationally expensive problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[24]  Mohammad Ali Abido,et al.  Differential evolution algorithm for optimal reactive power dispatch , 2011 .

[25]  Tomas Jansson,et al.  Using surrogate models and response surfaces in structural optimization – with application to crashworthiness design and sheet metal forming , 2003 .

[26]  Tapabrata Ray,et al.  Surrogate assisted Simulated Annealing (SASA) for constrained multi-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[27]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Khaled Rasheed,et al.  A Survey of Fitness Approximation Methods Applied in Evolutionary Algorithms , 2010 .

[29]  Robert E. Smith,et al.  Fitness inheritance in genetic algorithms , 1995, SAC '95.

[30]  Bernhard Sendhoff,et al.  Generalizing Surrogate-Assisted Evolutionary Computation , 2010, IEEE Transactions on Evolutionary Computation.

[31]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[32]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[33]  Yew-Soon Ong,et al.  A study on polynomial regression and Gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[34]  Xiaoyan Sun,et al.  A New Surrogate-Assisted Interactive Genetic Algorithm With Weighted Semisupervised Learning , 2013, IEEE Transactions on Cybernetics.

[35]  Tapabrata Ray,et al.  A Decomposition-Based Evolutionary Algorithm for Many Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[36]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[37]  Yanchun Liang,et al.  A novel quantum swarm evolutionary algorithm and its applications , 2007, Neurocomputing.

[38]  Feng Liu,et al.  A knowledge-based evolutionary proactive scheduling approach in the presence of machine breakdown and deterioration effect , 2015, Knowl. Based Syst..

[39]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[40]  Ye Tian,et al.  A Knee Point-Driven Evolutionary Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[41]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[42]  Jeng-Shyang Pan,et al.  A new fitness estimation strategy for particle swarm optimization , 2013, Inf. Sci..