Memes Evolution in a Memetic Variant of Particle Swarm Optimization

In this work, a coevolving memetic particle swarm optimization (CoMPSO) algorithm is presented. CoMPSO introduces the memetic evolution of local search operators in particle swarm optimization (PSO) continuous/discrete hybrid search spaces. The proposed solution allows one to overcome the rigidity of uniform local search strategies when applied to PSO. The key contribution is that memes provides each particle of a PSO scheme with the ability to adapt its exploration dynamics to the local characteristics of the search space landscape. The objective is obtained by an original hybrid continuous/discrete meme representation and a probabilistic co-evolving PSO scheme for discrete, continuous, or hybrid spaces. The coevolving memetic PSO evolves both the solutions and their associated memes, i.e. the local search operators. The proposed CoMPSO approach has been experimented on a standard suite of numerical optimization benchmark problems. Preliminary experimental results show that CoMPSO is competitive with respect to standard PSO and other memetic PSO schemes in literature, and its a promising starting point for further research in adaptive PSO local search operators.

[1]  Aldo de Luca,et al.  Harmonic and gold Sturmian words , 2004, Eur. J. Comb..

[2]  Kay Chen Tan,et al.  A Multiobjective Memetic Algorithm Based on Particle Swarm Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[3]  Carlos Cotta,et al.  Memetic algorithms and memetic computing optimization: A literature review , 2012, Swarm Evol. Comput..

[4]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[5]  Flavio D'Alessandro,et al.  Independent sets of words and the synchronization problem , 2013, Adv. Appl. Math..

[6]  Aldo de Luca,et al.  Central Sturmian Words: Recent Developments , 2005, Developments in Language Theory.

[7]  Alfredo Milani,et al.  Automatic Algebraic Evolutionary Algorithms , 2017, WIVACE.

[8]  Shengxiang Yang,et al.  A memetic particle swarm optimization algorithm for multimodal optimization problems , 2011, 2011 Chinese Control and Decision Conference (CCDC).

[9]  Yew-Soon Ong,et al.  Canonical Memetic Algorithms , 2019 .

[10]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[11]  Alfredo Milani,et al.  An Extension of Algebraic Differential Evolution for the Linear Ordering Problem with Cumulative Costs , 2016, PPSN.

[12]  Alfredo Milani,et al.  Algebraic Particle Swarm Optimization for the permutations search space , 2017, 2017 IEEE Congress on Evolutionary Computation (CEC).

[13]  Shafaatunnur Hasan,et al.  Memetic binary particle swarm optimization for discrete optimization problems , 2015, Inf. Sci..

[14]  Alfredo Milani,et al.  A New Precedence-Based Ant Colony Optimization for Permutation Problems , 2017, SEAL.

[15]  G. Weiss Aspects and Applications of the Random Walk , 1994 .

[16]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[17]  William E. Hart,et al.  Recent Advances in Memetic Algorithms , 2008 .

[18]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[19]  Michael N. Vrahatis,et al.  Memetic particle swarm optimization , 2007, Ann. Oper. Res..

[20]  Aldo de Luca,et al.  Uniform words , 2004, Adv. Appl. Math..

[21]  Bo Liu,et al.  An Effective PSO-Based Memetic Algorithm for Flow Shop Scheduling , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[22]  Claudio Estevez,et al.  Adaptive Multiswarm Comprehensive Learning Particle Swarm Optimization , 2018, Inf..

[23]  Alfredo Milani,et al.  Particle Swarm Optimization in the EDAs Framework , 2011 .

[24]  Alfredo Milani,et al.  Learning Bayesian Networks with Algebraic Differential Evolution , 2018, PPSN.

[25]  MengChu Zhou,et al.  Comprehensive Learning Particle Swarm Optimization Algorithm With Local Search for Multimodal Functions , 2019, IEEE Transactions on Evolutionary Computation.

[26]  Nikola K. Kasabov,et al.  String Pattern Recognition Using Evolving Spiking Neural Networks and Quantum Inspired Particle Swarm Optimization , 2009, ICONIP.

[27]  Alfredo Milani,et al.  A Differential Evolution Algorithm for the Permutation Flowshop Scheduling Problem with Total Flow Time Criterion , 2014, PPSN.

[28]  Justin Salez,et al.  Random walk on sparse random digraphs , 2015, Probability Theory and Related Fields.

[29]  Andrew Lim,et al.  Example-based learning particle swarm optimization for continuous optimization , 2012, Information Sciences.

[30]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[31]  Hou-Ping Dai,et al.  Effects of Random Values for Particle Swarm Optimization Algorithm , 2018, Algorithms.

[32]  Muzaffar Eusuff,et al.  Shuffled frog-leaping algorithm: a memetic meta-heuristic for discrete optimization , 2006 .

[33]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[34]  R. Tavakkoli-Moghaddam,et al.  A hybrid particle swarm optimization algorithm for a no-wait flow shop scheduling problem with the total flow time , 2013, The International Journal of Advanced Manufacturing Technology.

[35]  Ji Ung Sun,et al.  Bilayer Local Search Enhanced Particle Swarm Optimization for the Capacitated Vehicle Routing Problem , 2018, Algorithms.

[36]  Yuanxi Li,et al.  Clustering Students Interactions in eLearning Systems for Group Elicitation , 2018, ICCSA.

[37]  Yang Liu,et al.  A Memetic Particle Swarm Optimization Algorithm to Solve Multi-objective Optimization Problems , 2017, 2017 13th International Conference on Computational Intelligence and Security (CIS).

[38]  Alfredo Milani,et al.  MOEA/DEP: An Algebraic Decomposition-Based Evolutionary Algorithm for the Multiobjective Permutation Flowshop Scheduling Problem , 2018, EvoCOP.

[39]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[40]  Pablo Moscato,et al.  Memetic Algorithms , 2018, Handbook of Heuristics.

[41]  Richard Alan Peters,et al.  Particle Swarm Optimization: A survey of historical and recent developments with hybridization perspectives , 2018, Mach. Learn. Knowl. Extr..

[42]  Rajdeep Niyogi,et al.  Social Cooperation in Autonomous Agents to Avoid the Tragedy of the Commons , 2017, Int. J. Agric. Environ. Inf. Syst..

[43]  Andries Petrus Engelbrecht,et al.  Boundary Constraint Handling Techniques for Particle Swarm Optimization in High Dimensional Problem Spaces , 2018, ANTS Conference.

[44]  Adnan M. Abu-Mahfouz,et al.  Estimation of Water Demand in Water Distribution Systems Using Particle Swarm Optimization , 2017 .

[45]  Jing Tang,et al.  Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems , 2006, Soft Comput..

[46]  Jim E. Smith,et al.  Coevolving Memetic Algorithms: A Review and Progress Report , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  Arturo Carpi,et al.  On the Repetition Threshold for Large Alphabets , 2006, MFCS.

[48]  Ada Che,et al.  A memetic differential evolution algorithm for energy-efficient parallel machine scheduling , 2019, Omega.