Center-based sampling for population-based algorithms

Population-based algorithms, such as Differential Evolution (DE), Particle Swarm Optimization (PSO), Genetic Algorithms (GAs), and Evolutionary Strategies (ES), are commonly used approaches to solve complex problems from science and engineering. They work with a population of candidate solutions. In this paper, a novel center-based sampling is proposed for these algorithms. Reducing the number of function evaluations to tackle with high-dimensional problems is a worthwhile attempt; the center-based sampling can open a new research area in this direction. Our simulation results confirm that this sampling, which can be utilized during population initialization and/or generating successive generations, could be valuable in solving large-scale problems efficiently. Quasi-Oppositional Differential Evolution is briefly discussed as an evidence to support the proposed sampling theory. Furthermore, opposition-based sampling and center-based sampling are compared in this paper. Black-box optimization is considered in this paper and all details about the conducted simulations are provided.

[1]  Mario Ventresca,et al.  A diversity maintaining population-based incremental learning algorithm , 2008, Inf. Sci..

[2]  Hamid R. Tizhoosh,et al.  Opposition-Based Reinforcement Learning , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[3]  Shahryar Rahnamayan,et al.  Investigating in scalability of opposition-based differential evolution , 2008 .

[4]  Shahryar Rahnamayan,et al.  Quasi-oppositional Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[5]  Mario Ventresca,et al.  Improving the Convergence of Backpropagation by Opposite Transfer Functions , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[6]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[7]  G. G. Wang,et al.  Mode-pursuing sampling method for global optimization on expensive black-box functions , 2004 .

[8]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[9]  G. G. Wang,et al.  Mode Pursuing Sampling Method for Discrete Variable Optimization on Expensive Black-Box Functions , 2008 .

[10]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[11]  Kaisa Miettinen,et al.  On initial populations of a genetic algorithm for continuous optimization problems , 2007, J. Glob. Optim..