A Variable Search Space Strategy Based on Sequential Trust Region Determination Technique

The complexity of an optimization problem is determined by its decision and objective spaces. Over the past few decades, a large number of works have focused on the performance improvement of metaheuristic algorithms via the objective space, whereas studies related to the decision space have attracted little attentions. Moreover, metaheuristic algorithms may not obtain satisfactory results within an entire feasible region, even if sufficient computational resources are available. Therefore, reducing the search space (i.e., finding a trust region) may be an effective method to ensure that the convergence is sufficiently close to the global optimal region. However, inappropriate subspace size may also weaken the performance of algorithms except for ones with a sufficiently small search space. To alleviate aforementioned problems, a variable search space (VSS) strategy based on a sequential trust region determination approach is proposed in this paper. In the VSS, the entire optimization process is divided into two stages: the first stage is to use an optimization approach for sequentially finding the trust domain of each variable and then determine the best-matched subspace; the second stage is to employ the optimization method for searching an optimal/near-optimal solution within the found trust region. The effectiveness of the VSS is evaluated using two widely used test suites, that is, IEEE CEC2014 and BBOB2012. Experimental results indicate that improving the algorithm performance is an important method for tackling problems, but locating a trust region is also beneficial for metaheuristic algorithms to improve the solution precision, especially for complex optimization problems.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Joong-Rin Shin,et al.  A particle swarm optimization for economic dispatch with nonsmooth cost functions , 2005, IEEE Transactions on Power Systems.

[3]  Xuefeng Yan,et al.  Auto-selection mechanism of differential evolution algorithm variants and its application , 2017, Eur. J. Oper. Res..

[4]  Yu Xue,et al.  Prior knowledge guided differential evolution , 2017, Soft Comput..

[5]  S. K. Park,et al.  Random number generators: good ones are hard to find , 1988, CACM.

[6]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[7]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[8]  Xuefeng Yan,et al.  Self-adaptive differential evolution algorithm with discrete mutation control parameters , 2015, Expert Syst. Appl..

[9]  Kay Chen Tan,et al.  Multiple Exponential Recombination for Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[10]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[11]  Guohua Wu,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016, Inf. Sci..

[12]  R. Luus,et al.  Importance of search-domain reduction in random optimization , 1992 .

[13]  Paul C. Kocher,et al.  The intel random number generator , 1999 .

[14]  Kaisa Miettinen,et al.  On initial populations of a genetic algorithm for continuous optimization problems , 2007, J. Glob. Optim..

[15]  H. Schuster Deterministic chaos: An introduction , 1984 .

[16]  Sean R Eddy,et al.  What is dynamic programming? , 2004, Nature Biotechnology.

[17]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[18]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[19]  Tom Dhaene,et al.  Classification aided domain reduction for high dimensional optimization , 2014, Proceedings of the Winter Simulation Conference 2014.

[20]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[21]  WuGuohua,et al.  Differential evolution with multi-population based ensemble of mutation strategies , 2016 .

[22]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[23]  Qinqin Fan,et al.  Self-adaptive differential evolution algorithm with crossover strategies adaptation and its application in parameter estimation , 2016 .

[24]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[25]  Nguyen Xuan Hoai,et al.  Initialising PSO with randomised low-discrepancy sequences: the comparative results , 2007, 2007 IEEE Congress on Evolutionary Computation.

[26]  Tapabrata Ray,et al.  Differential Evolution With Dynamic Parameters Selection for Optimization Problems , 2014, IEEE Transactions on Evolutionary Computation.

[27]  Ahmet Bedri Özer,et al.  CIDE: Chaotically Initialized Differential Evolution , 2010, Expert Syst. Appl..

[28]  Marco Dorigo,et al.  Optimization, Learning and Natural Algorithms , 1992 .

[29]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[30]  Ponnuthurai N. Suganthan,et al.  Recent advances in differential evolution - An updated survey , 2016, Swarm Evol. Comput..

[31]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[32]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[33]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[34]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[35]  Alex S. Fukunaga,et al.  Improving the search performance of SHADE using linear population size reduction , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[36]  K Ang,et al.  A NOTE ON UNIFORM DISTRIBUTION AND EXPERIMENTAL DESIGN , 1981 .

[37]  Junjie Li,et al.  Rosenbrock artificial bee colony algorithm for accurate global optimization of numerical functions , 2011, Inf. Sci..

[38]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[39]  Gui-Jun Zhang,et al.  Abstract Convex Underestimation Assisted Multistage Differential Evolution , 2017, IEEE Transactions on Cybernetics.

[40]  On the mean square weighted L 2 discrepancy of randomized digital ( t , m , s )-nets over Z , 2022 .

[41]  Carlos A. Coello Coello,et al.  Sequence-Based Deterministic Initialization for Evolutionary Algorithms , 2017, IEEE Transactions on Cybernetics.

[42]  Yong Li,et al.  A Modified Hestenes and Stiefel Conjugate Gradient Algorithm for Large-Scale Nonsmooth Minimizations and Nonlinear Equations , 2015, Journal of Optimization Theory and Applications.

[43]  A. Kai Qin,et al.  A review of population initialization techniques for evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[44]  Songhua Wang,et al.  A Conjugate Gradient Algorithm under Yuan-Wei-Lu Line Search Technique for Large-Scale Minimization Optimization Models , 2018 .

[45]  Mark Harman,et al.  The impact of input domain reduction on search-based test data generation , 2007, ESEC-FSE '07.

[46]  Xiaodong Li,et al.  Initialization methods for large scale global optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[47]  N. Hansen,et al.  Real-Parameter Black-Box Optimization Benchmarking: Experimental Setup , 2010 .

[48]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[49]  Xuefeng Yan,et al.  Self-Adaptive Differential Evolution Algorithm With Zoning Evolution of Control Parameters and Adaptive Mutation Strategies , 2016, IEEE Transactions on Cybernetics.

[50]  Xiwen Lu,et al.  A BFGS trust-region method for nonlinear equations , 2011, Computing.

[51]  P. Bhave,et al.  Optimal Design of Water Networks Using a Modified Genetic Algorithm with Reduction in Search Space , 2008 .

[52]  Christophe Dutang,et al.  A note on random number generation , 2009 .

[53]  Junjie Li,et al.  Slope reliability analysis using surrogate models via new support vector machines with swarm intelligence , 2016 .

[54]  M. Sarma On the convergence of the Baba and Dorea random optimization methods , 1990 .