A quantum-behaved particle swarm optimization with memetic algorithm and memory for continuous non-linear large scale problems

Abstract Quantum-behaved particle swarm optimization (QPSO), a novel variant of PSO inspired by quantum mechanics, is a global convergence guaranteed algorithm, which outperforms the original PSO in search ability and has fewer parameters to control. But as many other PSOs, it is easy to fall into local optimum in solving high-dimensional complex optimization problems. This paper proposes an improved QPSO algorithm for continuous non-linear large scale problems based on memetic algorithm and memory mechanism. The memetic algorithm is used to make all particles (each particle corresponding to a memetic) gain some experience through a local search before being involved in the evolutionary process, and the memory mechanism is used to introduce a so-called ‘bird kingdom’ with memory capacity, both of which can improve the global search ability of the algorithm. Another difference compared to the previous QPSOs is that we let each dimension of a particle update with the same random number, thus increasing the speed of convergence and enhancing the ability of local search. Numerical experiments are conducted to compare the proposed algorithm with different variants of PSO and other swarm intelligence algorithms. The experimental results show the superiority of the proposed approach on benchmark test functions.

[1]  Dan Simon,et al.  Analysis of migration models of biogeography-based optimization using Markov theory , 2011, Eng. Appl. Artif. Intell..

[2]  Mehmet Fatih Tasgetiren,et al.  A discrete artificial bee colony algorithm for the total flowtime minimization in permutation flow shops , 2011, Inf. Sci..

[3]  Dan Simon,et al.  A dynamic system model of biogeography-based optimization , 2011, Appl. Soft Comput..

[4]  Oscar Castillo,et al.  Fuzzy Logic for Parameter Tuning in Evolutionary Computation and Bio-inspired Methods , 2010, MICAI.

[5]  Debao Chen,et al.  An improved group search optimizer with operation of quantum-behaved swarm and its application , 2012, Appl. Soft Comput..

[6]  F. Khoshahval,et al.  Quantum behaved Particle Swarm Optimization with Differential Mutation operator applied to WWER-1000 in-core fuel management optimization , 2013 .

[7]  Xiaojun Wu,et al.  Convergence analysis and improvements of quantum-behaved particle swarm optimization , 2012, Inf. Sci..

[8]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[9]  L. Coelho A quantum particle swarm optimizer with chaotic mutation operator , 2008 .

[10]  Wenbo Xu,et al.  An improved quantum-behaved particle swarm optimization algorithm with weighted mean best position , 2008, Appl. Math. Comput..

[11]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[12]  Jing Liu,et al.  Quantum-behaved particle swarm optimization with mutation operator , 2005, 17th IEEE International Conference on Tools with Artificial Intelligence (ICTAI'05).

[13]  Andries Petrus Engelbrecht,et al.  Locating multiple optima using particle swarm optimization , 2007, Appl. Math. Comput..

[14]  Chen Fang,et al.  An effective shuffled frog-leaping algorithm for multi-mode resource-constrained project scheduling problem , 2011, Inf. Sci..

[15]  Dong Hwa Kim,et al.  A hybrid genetic algorithm and bacterial foraging approach for global optimization , 2007, Inf. Sci..

[16]  Mark Johnston,et al.  A novel particle swarm optimisation approach to detecting continuous, thin and smooth edges in noisy images , 2013, Inf. Sci..

[17]  Liang Gao,et al.  Cellular particle swarm optimization , 2011, Inf. Sci..

[18]  Yangyang Li,et al.  An improved cooperative quantum-behaved particle swarm optimization , 2012, Soft Computing.

[19]  K. Vivekanandan,et al.  Bacteria foraging optimization for protein sequence analysis on the grid , 2012, Future Gener. Comput. Syst..

[20]  Xiaojun Wu,et al.  Quantum-behaved particle swarm optimization with Gaussian distributed local attractor point , 2011, Appl. Math. Comput..

[21]  Dervis Karaboga,et al.  A modified Artificial Bee Colony algorithm for real-parameter optimization , 2012, Inf. Sci..

[22]  Wenbo Xu,et al.  Particle swarm optimization with particles having quantum behavior , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[23]  Hsing-Chih Tsai,et al.  Integrating the artificial bee colony and bees algorithm to face constrained optimization problems , 2014, Inf. Sci..

[24]  Ali Husseinzadeh Kashan,et al.  A particle swarm optimizer for grouping problems , 2013, Inf. Sci..

[25]  R. Venkata Rao,et al.  Teaching-Learning-Based Optimization: An optimization method for continuous non-linear large scale problems , 2012, Inf. Sci..

[26]  Jun Sun,et al.  A global search strategy of quantum-behaved particle swarm optimization , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[27]  R. Rao,et al.  Multi-objective optimization of heat exchangers using a modified teaching-learning-based optimization algorithm , 2013 .

[28]  Wan-li Xiang,et al.  An efficient and robust artificial bee colony algorithm for numerical optimization , 2013, Comput. Oper. Res..

[29]  Shiu Yin Yuen,et al.  An Evolutionary Algorithm That Makes Decision Based on the Entire Previous Search History , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Adam P. Piotrowski,et al.  Adaptive Memetic Differential Evolution with Global and Local neighborhood-based mutation operators , 2013, Inf. Sci..

[31]  Xia Li,et al.  An improved shuffled frog-leaping algorithm with extremal optimisation for continuous optimisation , 2012, Inf. Sci..

[32]  Christian Blum,et al.  Ant colony optimization: Introduction and recent trends , 2005 .

[33]  Shujiang Li,et al.  Improved quantum behaved particle swarm optimization algorithm , 2016, CCDC 2016.

[34]  Gexiang Zhang,et al.  Enhancing distributed differential evolution with multicultural migration for global numerical optimization , 2013, Inf. Sci..

[35]  Mitsuo Gen,et al.  Evolution program for nonlinear goal programming , 1996 .

[36]  Wei Chu,et al.  A new evolutionary search strategy for global optimization of high-dimensional problems , 2011, Inf. Sci..

[37]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[38]  Dervis Karaboga,et al.  Artificial bee colony programming for symbolic regression , 2012, Inf. Sci..

[39]  S. Sorooshian,et al.  Shuffled complex evolution approach for effective and efficient global minimization , 1993 .

[40]  Giovanni Iacca,et al.  Compact Particle Swarm Optimization , 2013, Inf. Sci..

[41]  Mengjie Zhang,et al.  Parent Selection Pressure Auto-Tuning for Tournament Selection in Genetic Programming , 2013, IEEE Transactions on Evolutionary Computation.

[42]  Andrew Lim,et al.  Example-based learning particle swarm optimization for continuous optimization , 2012, Information Sciences.

[43]  Xiaojun Wu,et al.  Multiple sequence alignment using the Hidden Markov Model trained by an improved quantum-behaved particle swarm optimization , 2012, Inf. Sci..

[44]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[45]  Junjie Li,et al.  Rosenbrock artificial bee colony algorithm for accurate global optimization of numerical functions , 2011, Inf. Sci..

[46]  H. Lin,et al.  An improved Quantum-behaved Particle Swarm Optimization with Random Selection of the Optimal Individual , 2010, 2010 WASE International Conference on Information Engineering.

[47]  Garrison W. Greenwood Chaotic behavior in evolution strategies , 1997 .

[48]  Oscar Castillo,et al.  Evolutionary Computing for Topology Optimization of Type-2 Fuzzy Controllers , 2007, Hybrid Intelligent Systems.

[49]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[50]  Yang Tang,et al.  Adaptive population tuning scheme for differential evolution , 2013, Inf. Sci..

[51]  Oscar Castillo,et al.  Evolutionary method combining particle swarm optimization and genetic algorithms using fuzzy logic for decision making , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[52]  Lixin Tang,et al.  A modified genetic algorithm for single machine scheduling , 1999 .

[53]  Fuzhen Zhuang,et al.  Particle swarm optimization using dimension selection methods , 2013, Appl. Math. Comput..

[54]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[55]  Jing Liu,et al.  Quantum-Behaved Particle Swarm Optimization with Adaptive Mutation Operator , 2006, ICNC.

[56]  Dan Simon,et al.  Variations of biogeography-based optimization and Markov analysis , 2013, Inf. Sci..

[57]  Jingan Yang,et al.  An improved ant colony optimization algorithm for solving a complex combinatorial optimization problem , 2010, Appl. Soft Comput..