Query-Based Learning for Dynamic Particle Swarm Optimization

In recent years, many researchers have examined dynamic optimization problems (DOPs). The key challenge lies in the fact that the optimal solution of a DOP typically changes over time. This paper focuses on using query-based learning dynamic particle swarm optimization (QBLDPSO) to solve DOPs. QBLDPSO is mainly used for improving multi-population-based PSO; our QBL mechanism includes two learning strategies that integrate the concepts of diversity and memory into PSO. The first learning strategy, QBL quantum parameter adaptation (QBLQPA), is used to apply the concept of diversity to the multi-population based algorithm. This is different from typical diversity-based PSO approaches, which passively maintain the diversity of particles in the solution space. We actively adapt the ratio of quantum particles and neutral particles to achieve diversity without analyzing the distribution of optima in the solution space. The second learning strategy is query-based learning optima prediction (QBLOP). Although QBLOP exploits the concept of memory, we do not need to analyze the history of all particles. We select the $k$ nearest particles to the current best solution and use a minimum encompassing circle as the possible prediction region. Our experimental results are based on the generalized dynamic benchmark generator (GDBG), which is adopted as a benchmark for the DOP. The proposed method outperforms two state-of-the-art multi-population-based PSO methods with the average improvements of 11.37% and 8% using QBLQPA. In particular, for the recurrent problems in GDBG, our method improves performance by 35.06%.

[1]  Xiaodong Li,et al.  Particle swarm with speciation and adaptation in a dynamic environment , 2006, GECCO.

[2]  David A. Pelta,et al.  An algorithm comparison for dynamic optimization problems , 2012, Appl. Soft Comput..

[3]  Jürgen Branke,et al.  Multiswarms, exclusion, and anti-convergence in dynamic environments , 2006, IEEE Transactions on Evolutionary Computation.

[4]  Xiaodong Li,et al.  Enhancing the robustness of a speciation-based PSO , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  M. R. Meybodi,et al.  A multi-role cellular PSO for dynamic environments , 2009, 2009 14th International CSI Computer Conference.

[6]  Robert Sabourin,et al.  Gaussian mixture modeling for dynamic particle swarm optimization of recurrent problems , 2012, GECCO '12.

[7]  Andries Petrus Engelbrecht,et al.  A radius-free quantum particle swarm optimization technique for dynamic optimization problems , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[8]  Ray-I Chang,et al.  INTRUSION DETECTION BY BACKPROPAGATION NEURAL NETWORKS WITH SAMPLE-QUERY AND ATTRIBUTE-QUERY , 2007 .

[9]  Changhe Li,et al.  Benchmark generator for the IEEE WCCI-2012 competition on evolutionary computation for dynamic optimization problems. Technical Report 2011. , 2011 .

[10]  Changhe Li,et al.  A Generalized Approach to Construct Benchmark Problems for Dynamic Optimization , 2008, SEAL.

[11]  Carlos Cruz Corona,et al.  Efficient multi-swarm PSO algorithms for dynamic environments , 2011, Memetic Comput..

[12]  Tim M. Blackwell,et al.  Swarms in Dynamic Environments , 2003, GECCO.

[13]  Tim Blackwell,et al.  Particle Swarm Optimization in Dynamic Environments , 2007, Evolutionary Computation in Dynamic and Uncertain Environments.

[14]  Pei-Yung Hsiao,et al.  Unsupervised query-based learning of neural networks using selective-attention and self-regulation , 1997, IEEE Trans. Neural Networks.

[15]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[16]  Anabela Simões,et al.  Evolutionary Algorithms for Dynamic Environments: Prediction Using Linear Regression and Markov Chains , 2008, PPSN.

[17]  Ray-I Chang,et al.  Particle swarm optimization with query-based learning for multi-objective power contract problem , 2012, Expert Syst. Appl..

[18]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[19]  Raymond Chiong,et al.  Dynamic Function Optimization: The Moving Peaks Benchmark , 2013, Metaheuristics for Dynamic Optimization.

[20]  Ray-I Chang,et al.  Gene clustering by using query-based self-organizing maps , 2010, Expert Syst. Appl..

[21]  R. Eberhart,et al.  Fuzzy adaptive particle swarm optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[22]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[23]  Bin Li,et al.  Multi-strategy ensemble particle swarm optimization for dynamic optimization , 2008, Inf. Sci..

[24]  Jürgen Branke,et al.  Multi-swarm Optimization in Dynamic Environments , 2004, EvoWorkshops.

[25]  Ray-I Chang,et al.  Particle Swarm Optimization Combined with Query-Based Learning Using MapReduce , 2014 .

[26]  Martin Middendorf,et al.  A Hierarchical Particle Swarm Optimizer for Dynamic Optimization Problems , 2004, EvoWorkshops.

[27]  Enrique Alba,et al.  Best practices in measuring algorithm performance for dynamic optimization problems , 2013, Soft Comput..

[28]  Carlos Cruz,et al.  Optimization in dynamic environments: a survey on problems, methods and measures , 2011, Soft Comput..

[29]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[30]  Zhiwen Yu,et al.  Orthogonal learning particle swarm optimization with variable relocation for dynamic optimization , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[31]  Xin Yao,et al.  Benchmark Generator for the IEEE WCCI-2014 Competition on Evolutionary Computation for Dynamic Optimization Problems: Dynamic Rotation Peak Benchmark Generator (DRPBG) and Dynamic Composition Benchmark Generator (DCBG) , 2013 .

[32]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[33]  Ming Yang,et al.  Maintaining diversity by clustering in dynamic environments , 2012, 2012 IEEE Congress on Evolutionary Computation.