Towards finding an effective way of discrete problems solving: The Particle Swarm Optimization, Genetic Algorithm and linkage learning techniques hybrydization

Particle Swarm Optimization (PSO) and Genetic Algorithms (GA) are well known optimization tools. PSO advantage is its capability for fast convergence to the promising solutions. On the other hand GAs are able to process schemata thanks to the use of crossover operator. However, both methods have also their drawbacks - PSO may fall into the trap of preconvergence, while GA capability of fast finding locally optimal (or close to optimal) solutions seems low when compared to PSO. Relatively new, important research direction in the field of Evolutionary Algorithms is linkage learning. The linkage learning methods gather the information about possible gene dependencies and use it to improve their effectiveness. Recently, the linkage learning evolutionary methods were shown to be effective tools to solve both: theoretical and practical problems. Therefore, this paper proposes a PSO and GA hybrid, improved by the linkage learning mechanisms, dedicated to solve binary problems. The proposed method tries to combine the GA schema processing ability, linkage information processing and uses fast PSO convergence to quickly improve the quality of already known solutions.

[1]  Chilukuri K. Mohan,et al.  Particle swarm optimization with adaptive linkage learning , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[2]  Kalyanmoy Deb,et al.  Sufficient conditions for deceptive and easy binary functions , 1994, Annals of Mathematics and Artificial Intelligence.

[3]  Jonathan L. Shapiro,et al.  Model Complexity vs. Performance in the Bayesian Optimization Algorithm , 2006, PPSN.

[4]  J. Pollack,et al.  Hierarchical Building-Block Problems for GA Evaluation 3 , 2007 .

[5]  Kanchan Rani,et al.  SOLVING TRAVELLING SALESMAN PROBLEM USING GENETIC A LGORITHM BASED ON HEURISTIC CROSSOVER AND MUTATION OPERATOR , 2014 .

[6]  Marco Laumanns,et al.  Bayesian Optimization Algorithms for Multi-objective Optimization , 2002, PPSN.

[7]  Yang Yan,et al.  Parallel multi-population Particle Swarm Optimization Algorithm for the Uncapacitated Facility Location problem using OpenMP , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[8]  Nor Ashidi Mat Isa,et al.  Teaching and peer-learning particle swarm optimization , 2014, Appl. Soft Comput..

[9]  Qunfeng Liu,et al.  Order-2 Stability Analysis of Particle Swarm Optimization , 2015, Evolutionary Computation.

[10]  Dirk Thierens,et al.  Scalability Problems of Simple Genetic Algorithms , 1999, Evolutionary Computation.

[11]  Krzysztof Walkowiak,et al.  HEURISTIC ALGORITHMS FOR SURVIVABLE P2P MULTICASTING , 2013, Appl. Artif. Intell..

[12]  Halina Kwasnicka,et al.  Multi Population Pattern Searching Algorithm: A New Evolutionary Method Based on the Idea of Messy Genetic Algorithm , 2011, IEEE Transactions on Evolutionary Computation.

[13]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[14]  Yu Wang,et al.  Adaptive Inertia Weight Particle Swarm Optimization , 2006, ICAISC.

[15]  Martin V. Butz,et al.  Hierarchical BOA on random decomposable problems , 2006, GECCO '06.

[16]  Krzysztof Walkowiak,et al.  Towards solving practical problems of large solution space using a novel pattern searching hybrid evolutionary algorithm - An elastic optical network optimization case study , 2015, Expert Syst. Appl..

[17]  Kalyanmoy Deb,et al.  RapidAccurate Optimization of Difficult Problems Using Fast Messy Genetic Algorithms , 1993, ICGA.

[18]  Wen-Chih Peng,et al.  Particle Swarm Optimization With Recombination and Dynamic Linkage Discovery , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[20]  Wei-Der Chang,et al.  A modified particle swarm optimization with multiple subpopulations for multimodal function optimization problems , 2015, Appl. Soft Comput..

[21]  Yiqiao Cai,et al.  Differential evolution with hybrid linkage crossover , 2015, Inf. Sci..

[22]  Jun Wang,et al.  Resource allocation algorithm based on hybrid particle swarm optimization for multiuser cognitive OFDM network , 2015, Expert Syst. Appl..

[23]  Amreen Khan,et al.  An Analysis of Particle Swarm Optimization with Data Clustering-Technique for Optimization in Data Mining. , 2010 .

[24]  Tian-Li Yu,et al.  Linkage learning by number of function evaluations estimation: Practical view of building blocks , 2013, Inf. Sci..

[25]  Qinghai Bai,et al.  Analysis of Particle Swarm Optimization Algorithm , 2010, Comput. Inf. Sci..

[26]  Rui Mendes,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2006 .

[27]  Q. Henry Wu,et al.  MCPSO: A multi-swarm cooperative particle swarm optimizer , 2007, Appl. Math. Comput..

[28]  Flávio Keidi Miyazawa,et al.  Biased Random-Key Genetic Algorithms for the Winner Determination Problem in Combinatorial Auctions , 2015, Evolutionary Computation.

[29]  John A. W. McCall,et al.  D2MOPSO: MOPSO Based on Decomposition and Dominance with Archiving Using Crowding Distance in Objective and Solution Spaces , 2014, Evolutionary Computation.

[30]  M. A. Khanesar,et al.  A novel binary particle swarm optimization , 2007, 2007 Mediterranean Conference on Control & Automation.

[31]  Wang Jiaying,et al.  A modified particle swarm optimization algorithm , 2005 .

[32]  Jeill Oh,et al.  Optimal design of multi-storage network for combined sewer overflow management using a diversity-guided, cyclic-networking particle swarm optimizer - A case study in the Gunja subcatchment area, Korea , 2015, Expert Syst. Appl..

[33]  D. Goldberg,et al.  A Survey of Linkage Learning Techniques in Genetic and Evolutionary Algorithms , 2007 .

[34]  Thomas Kiel Rasmussen,et al.  Hybrid Particle Swarm Optimiser with breeding and subpopulations , 2001 .

[35]  J. Kennedy,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2003, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).