Surrogate-Assisted Cooperative Swarm Optimization of High-Dimensional Expensive Problems

Surrogate models have shown to be effective in assisting metaheuristic algorithms for solving computationally expensive complex optimization problems. The effectiveness of existing surrogate-assisted metaheuristic algorithms, however, has only been verified on low-dimensional optimization problems. In this paper, a surrogate-assisted cooperative swarm optimization algorithm is proposed, in which a surrogate-assisted particle swarm optimization (PSO) algorithm and a surrogate-assisted social learning-based PSO (SL-PSO) algorithm cooperatively search for the global optimum. The cooperation between the PSO and the SL-PSO consists of two aspects. First, they share promising solutions evaluated by the real fitness function. Second, the SL-PSO focuses on exploration while the PSO concentrates on local search. Empirical studies on six 50-D and six 100-D benchmark problems demonstrate that the proposed algorithm is able to find high-quality solutions for high-dimensional problems on a limited computational budget.

[1]  Mark Johnston,et al.  Automatic Programming via Iterated Local Search for Dynamic Job Shop Scheduling , 2015, IEEE Transactions on Cybernetics.

[2]  Yihua Hu,et al.  Multiobjective Design Optimization of IGBT Power Modules Considering Power Cycling and Thermal Cycling , 2015, IEEE Transactions on Power Electronics.

[3]  Roman Neruda,et al.  An Evolutionary Strategy for Surrogate-Based Multiobjective Optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[4]  Jeng-Shyang Pan,et al.  A new fitness estimation strategy for particle swarm optimization , 2013, Inf. Sci..

[5]  Hongnian Yu,et al.  Genetic Algorithm-Based Classifiers Fusion for Multisensor Activity Recognition of Elderly People , 2015, IEEE Journal of Biomedical and Health Informatics.

[6]  Robert E. Smith,et al.  Fitness inheritance in genetic algorithms , 1995, SAC '95.

[7]  Helio J. C. Barbosa,et al.  A study on fitness inheritance for enhanced efficiency in real-coded genetic algorithms , 2012, 2012 IEEE Congress on Evolutionary Computation.

[8]  Bernhard Sendhoff,et al.  Generalizing Surrogate-Assisted Evolutionary Computation , 2010, IEEE Transactions on Evolutionary Computation.

[9]  Bernhard Sendhoff,et al.  A framework for evolutionary optimization with approximate fitness functions , 2002, IEEE Trans. Evol. Comput..

[10]  Alain Ratle,et al.  Kriging as a surrogate fitness landscape in evolutionary optimization , 2001, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[11]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[12]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[13]  Tapabrata Ray,et al.  An Evolutionary Algorithm with Spatially Distributed Surrogates for Multiobjective Optimization , 2007, ACAL.

[14]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[15]  Kyriakos C. Giannakoglou,et al.  A multi-objective metamodel-assisted memetic algorithm with strength-based local refinement , 2009 .

[16]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[17]  R. L. Hardy.  Multiquadric equations of topography and other irregular surfaces , 1971 .

[18]  Wolfgang Ponweiser,et al.  Multiobjective Optimization on a Limited Budget of Evaluations Using Model-Assisted -Metric Selection , 2008, PPSN.

[19]  António Gaspar-Cunha,et al.  A Hybrid Multi-Objective Evolutionary Algorithm Using an Inverse Neural Network , 2004, Hybrid Metaheuristics.

[20]  Antonio Bolufé Röhler,et al.  Multi-swarm hybrid for multi-modal optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[21]  Meng-Sing Liou,et al.  Multiobjective optimization using coupled response surface model and evolutionary algorithm , 2004 .

[22]  Petros Koumoutsakos,et al.  Accelerating evolutionary algorithms with Gaussian process fitness function models , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Heder S. Bernardino,et al.  Surrogate-assisted clonal selection algorithms for expensive optimization problems , 2011, Evol. Intell..

[24]  M. Herrera,et al.  Metamodel-assisted optimization based on multiple kernel regression for mixed variables , 2014, Structural and Multidisciplinary Optimization.

[25]  Rommel G. Regis,et al.  Particle swarm with radial basis function surrogates for expensive black-box optimization , 2014, J. Comput. Sci..

[26]  Qingfu Zhang,et al.  A Gaussian Process Surrogate Model Assisted Evolutionary Algorithm for Medium Scale Expensive Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[28]  M. Farina.  A neural network based generalized response surface multiobjective evolutionary algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[29]  António Gaspar-Cunha,et al.  A Multi-Objective Evolutionary Algorithm Using Neural Networks to Approximate Fitness Evaluations , 2005, Int. J. Comput. Syst. Signals.

[30]  Yong-Hyuk Kim,et al.  An Efficient Genetic Algorithm for Maximum Coverage Deployment in Wireless Sensor Networks , 2013, IEEE Transactions on Cybernetics.

[31]  Keisuke Kameyama,et al.  Particle Swarm Optimization - A Survey , 2009, IEICE Trans. Inf. Syst..

[32]  Marios K. Karakasis,et al.  METAMODEL-ASSISTED MULTI-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2005 .

[33]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[34]  Minho Lee,et al.  Surrogate model assisted ensemble differential evolution algorithm , 2012, 2012 IEEE Congress on Evolutionary Computation.

[35]  Yew-Soon Ong,et al.  A study on polynomial regression and Gaussian process global surrogate model in hierarchical surrogate-assisted evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[36]  Tung-Kuan Liu,et al.  A Novel Crowding Genetic Algorithm and Its Applications to Manufacturing Robots , 2014, IEEE Transactions on Industrial Informatics.

[37]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[38]  Ning Qin,et al.  Surrogate-Based Multi-Objective Aerothermodynamic Design Optimization of Hypersonic Spiked Bodies , 2011 .

[39]  Meng Joo Er,et al.  Face recognition with radial basis function (RBF) neural networks , 2002, IEEE Trans. Neural Networks.

[40]  Vincenzo Catania,et al.  A Study on Evolutionary Multi-Objective Optimization with Fuzzy Approximation for Computational Expensive Problems , 2012, PPSN.

[41]  Tin-Yu Wu,et al.  Low-SAR Path Discovery by Particle Swarm Optimization Algorithm in Wireless Body Area Networks , 2015, IEEE Sensors Journal.

[42]  Michèle Sebag,et al.  A mono surrogate for multiobjective optimization , 2010, GECCO '10.

[43]  Joshua D. Knowles,et al.  ParEGO: a hybrid algorithm with on-line landscape approximation for expensive multiobjective optimization problems , 2006, IEEE Transactions on Evolutionary Computation.

[44]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[45]  Bernhard Sendhoff,et al.  A systems approach to evolutionary multiobjective structural optimization and beyond , 2009, IEEE Computational Intelligence Magazine.

[46]  Yoel Tenne,et al.  A framework for memetic optimization using variable global and local surrogate models , 2009, Soft Comput..

[47]  Xiaoyan Sun,et al.  Directed fuzzy graph-based surrogate model-assisted interactive genetic algorithms with uncertain individual's fitness , 2009, 2009 IEEE Congress on Evolutionary Computation.

[48]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[49]  Albert A. Groenwold,et al.  A Study of Global Optimization Using Particle Swarms , 2005, J. Glob. Optim..

[50]  Ahmed Kattan,et al.  Evolving radial basis function networks via GP for estimating fitness values using surrogate models , 2012, 2012 IEEE Congress on Evolutionary Computation.

[51]  Qingfu Zhang,et al.  Expensive Multiobjective Optimization by MOEA/D With Gaussian Process Model , 2010, IEEE Transactions on Evolutionary Computation.

[52]  Thomas Hemker,et al.  Framework for Particle Swarm Optimization with Surrogate Functions , 2009 .

[53]  M. Clerc,et al.  The swarm and the queen: towards a deterministic and adaptive particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[54]  Shi-Jinn Horng,et al.  An efficient job-shop scheduling algorithm based on particle swarm optimization , 2010, Expert Syst. Appl..

[55]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[56]  Bu-Sung Lee,et al.  Memetic algorithm using multi-surrogates for computationally expensive optimization problems , 2007, Soft Comput..

[57]  Saúl Zapotecas Martínez,et al.  MOEA/D assisted by rbf networks for expensive multi-objective optimization problems , 2013, GECCO '13.

[58]  Tim Hendtlass.  Fitness estimation and the particle swarm optimisation algorithm , 2007, 2007 IEEE Congress on Evolutionary Computation.

[59]  Jeng-Shyang Pan,et al.  Similarity-based evolution control for fitness estimation in particle swarm optimization , 2013, 2013 IEEE Symposium on Computational Intelligence in Dynamic and Uncertain Environments (CIDUE).

[60]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[61]  Aimin Zhou,et al.  A Multioperator Search Strategy Based on Cheap Surrogate Models for Evolutionary Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[62]  Yang Yu,et al.  A two-layer surrogate-assisted particle swarm optimization algorithm , 2014, Soft Computing.

[63]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[64]  Saúl Zapotecas Martínez,et al.  Combining surrogate models and local search for dealing with expensive multi-objective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.