Dynamic island model based on spectral clustering in genetic algorithm

How to maintain relative high diversity is important to avoid premature convergence in population-based optimization methods. Island model is widely considered as a major approach to achieve this because of its flexibility and high efficiency. The model maintains a group of sub-populations on different islands and allows sub-populations to interact with each other via predefined migration policies. However, current island model has some drawbacks. One is that after a certain number of generations, different islands may retain quite similar, converged sub-populations thereby losing diversity and decreasing efficiency. Another drawback is that determining the number of islands to maintain is also very challenging. Meanwhile initializing many sub-populations increases the randomness of island model. To address these issues, we proposed a dynamic island model (DIM-SP) which can force each island to maintain different sub-populations, control the number of islands dynamically and starts with one sub-population. The proposed island model outperforms the other three state-of-the-art island models in three baseline optimization problems including job shop scheduler, travelling salesmen, and quadratic multiple knapsack.

[1]  W. Martin,et al.  Population Structures C 6 . 3 Island ( migration ) models : evolutionary algorithms based on punctuated equilibria , 1997 .

[2]  Mohammad Reza Meybodi,et al.  Improved Speciation-Based Firefly Algorithm in Dynamic and Uncertain Environments , 2016, J. Inf. Sci. Eng..

[3]  Gregory Gutin,et al.  The traveling salesman problem , 2006, Discret. Optim..

[4]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[5]  Xiang Wang,et al.  Chaotic Differential Evolution Algorithm for Solving Constrained Optimization Problems , 2011 .

[6]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[7]  Wenhua Zeng,et al.  A New Local Search-Based Multiobjective Optimization Algorithm , 2015, IEEE Transactions on Evolutionary Computation.

[8]  Filomena Ferrucci,et al.  elephant56: Design and Implementation of a Parallel Genetic Algorithms Framework on Hadoop MapReduce , 2016, GECCO.

[9]  Michel Gendreau,et al.  Handbook of Metaheuristics , 2010 .

[10]  Janez Brest,et al.  Self-adaptive control parameters' randomization frequency and propagations in differential evolution , 2015, Swarm Evol. Comput..

[11]  Adil Baykasoglu,et al.  A multi-population firefly algorithm for dynamic optimization problems , 2015, 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[12]  JiaDongli,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011 .

[13]  Nachol Chaiyaratana,et al.  Thalassaemia classification by neural networks and genetic programming , 2007, Inf. Sci..

[14]  Enrique Alba,et al.  Heterogeneous Computing and Parallel Genetic Algorithms , 2002, J. Parallel Distributed Comput..

[15]  Martin Middendorf,et al.  Simple Probabilistic Population-Based Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[16]  Enrique Alba,et al.  A survey of parallel distributed genetic algorithms , 1999, Complex..

[17]  Michael L. Mauldin,et al.  Maintaining Diversity in Genetic Search , 1984, AAAI.

[18]  L. Darrell Whitley,et al.  Cellular Genetic Algorithms , 1993, ICGA.

[19]  Zhihua Cai,et al.  Dynamic K-Nearest-Neighbor with Distance and attribute weighted for classification , 2010, 2010 International Conference on Electronics and Information Engineering.

[20]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[21]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[22]  Miguel A. Vega-Rodríguez,et al.  A Hybrid Multiobjective Memetic Metaheuristic for Multiple Sequence Alignment , 2016, IEEE Transactions on Evolutionary Computation.

[23]  Yilong Yin,et al.  A Hybrid Evolutionary Immune Algorithm for Multiobjective Optimization Problems , 2016, IEEE Transactions on Evolutionary Computation.

[24]  Jia Wu,et al.  Artificial immune system for attribute weighted Naive Bayes classification , 2013, The 2013 International Joint Conference on Neural Networks (IJCNN).

[25]  A. E. Eiben,et al.  On Evolutionary Exploration and Exploitation , 1998, Fundam. Informaticae.

[26]  Zhihua Cai,et al.  Hybrid dynamic k-nearest-neighbour and distance and attribute weighted method for classification , 2012, Int. J. Comput. Appl. Technol..

[27]  Adil Baykasoglu,et al.  A constructive search algorithm for combinatorial dynamic optimization problems , 2015, 2015 IEEE International Conference on Evolving and Adaptive Intelligent Systems (EAIS).

[28]  Penousal Machado,et al.  Island models for cluster geometry optimization: how design options impact effectiveness and diversity , 2015, Journal of Global Optimization.

[29]  Philip S. Yu,et al.  Multiple Structure-View Learning for Graph Classification , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Enrique Alba,et al.  Cellular genetic algorithms , 2014, GECCO.

[31]  Rasmus K. Ursem,et al.  Multinational GAs: Multimodal Optimization Techniques in Dynamic Environments , 2000, GECCO.

[32]  David R. Jefferson,et al.  Selection in Massively Parallel Genetic Algorithms , 1991, ICGA.

[33]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[34]  Gang Chen,et al.  Preserving and Exploiting Genetic Diversity in Evolutionary Programming Algorithms , 2009, IEEE Transactions on Evolutionary Computation.

[35]  Chengqi Zhang,et al.  Multi-graph-view Learning for Graph Classification , 2014, 2014 IEEE International Conference on Data Mining.

[36]  Ke Tang,et al.  History-Based Topological Speciation for Multimodal Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[37]  Muhammad Khurram Khan,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011, Inf. Sci..

[38]  Dietmar Fey,et al.  Comparison of common parallel architectures for the execution of the island model and the global parallelization of evolutionary algorithms , 2017, Concurr. Comput. Pract. Exp..

[39]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[40]  Peng Zhang,et al.  SODE: Self-Adaptive One-Dependence Estimators for classification , 2016, Pattern Recognit..