Parallel transfer evolution algorithm

Abstract Parallelization of an evolutionary algorithm takes the advantage of modular population division and information exchange among multiple processors. However, existing parallel evolutionary algorithms are rather ad hoc and lack a capability of adapting to diverse problems. To accommodate a wider range of problems and to reduce algorithm design costs, this paper develops a parallel transfer evolution algorithm. It is based on the island-model of parallel evolutionary algorithm and, for improving performance, transfers both the connections and the evolutionary operators from one sub-population pair to another adaptively. Needing no extra upper selection strategy, each sub-population is able to select autonomously evolutionary operators and local search operators as subroutines according to both the sub-population’s own and the connected neighbor’s ranking boards. The parallel transfer evolution is tested on two typical combinatorial optimization problems in comparison with six existing ad-hoc evolutionary algorithms, and is also applied to a real-world case study in comparison with five typical parallel evolutionary algorithms. The tests show that the proposed scheme and the resultant PEA offer high flexibility in dealing with a wider range of combinatorial optimization problems without algorithmic modification or redesign. Both the topological transfer and the algorithmic transfer are seen applicable not only to combinatorial optimization problems, but also to non-permutated complex problems.

[1]  Yang Yu,et al.  Parallel Pareto Optimization for Subset Selection , 2016, IJCAI.

[2]  Zbigniew Skolicki,et al.  The influence of migration sizes and intervals on island models , 2005, GECCO '05.

[3]  Patrick M. Reed,et al.  Borg: An Auto-Adaptive Many-Objective Evolutionary Computing Framework , 2013, Evolutionary Computation.

[4]  Chunguo Wu,et al.  Solving traveling salesman problems using generalized chromosome genetic algorithm , 2008 .

[5]  El-Ghazali Talbi,et al.  A Taxonomy of Hybrid Metaheuristics , 2002, J. Heuristics.

[6]  Kenji Onaga,et al.  A Parallel and Distributed Genetic Algorithm on Loosely-Coupled Multiprocessor Systems , 1998 .

[7]  Fei Tao,et al.  Multi operators-based partial connected parallel evolutionary algorithm , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[8]  Hui Li,et al.  Enhanced Differential Evolution With Adaptive Strategies for Numerical Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[9]  Pierre Hansen,et al.  Variable Neighborhood Search , 2018, Handbook of Heuristics.

[10]  Mohammad Sohel Rahman,et al.  Mapping stream programs onto multicore platforms by local search and genetic algorithm , 2016, Comput. Lang. Syst. Struct..

[11]  Mauricio G. C. Resende,et al.  Discrete Optimization A hybrid genetic algorithm for the job shop scheduling problem , 2005 .

[12]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[13]  Jing Tang,et al.  Diversity-adaptive parallel memetic algorithm for solving large scale combinatorial optimization problems , 2006, Soft Comput..

[14]  Kenji Onaga,et al.  A Parallel and Distributed Genetic Algorithm on Loosely-Coupled Multiprocessor Systems(Special Section on Concurrent Systems Technology) , 1998 .

[15]  E. Nowicki,et al.  A Fast Taboo Search Algorithm for the Job Shop Problem , 1996 .

[16]  Enrique Alba,et al.  Parallel evolutionary algorithms can achieve super-linear performance , 2002, Inf. Process. Lett..

[17]  Bruce A. Robinson,et al.  Self-Adaptive Multimethod Search for Global Optimization in Real-Parameter Spaces , 2009, IEEE Transactions on Evolutionary Computation.

[18]  Antoni Wibowo,et al.  Effective local evolutionary searches distributed on an island model solving bi-objective optimization problems , 2012, Applied Intelligence.

[19]  Andries Petrus Engelbrecht,et al.  Alternative hyper-heuristic strategies for multi-method global optimization , 2010, IEEE Congress on Evolutionary Computation.

[20]  Qining Wang,et al.  Concept, Principle and Application of Dynamic Configuration for Intelligent Algorithms , 2014, IEEE Systems Journal.

[21]  Fred W. Glover,et al.  A cooperative parallel tabu search algorithm for the quadratic assignment problem , 2009, Eur. J. Oper. Res..

[22]  Eduardo Segredo,et al.  Scalability and robustness of parallel hyperheuristics applied to a multiobjectivised frequency assignment problem , 2013, Soft Comput..

[23]  Carlos A. Coello Coello,et al.  MRMOGA: a new parallel multi‐objective evolutionary algorithm based on the use of multiple resolutions , 2007, Concurr. Comput. Pract. Exp..

[24]  Jing Tang,et al.  Adaptation for parallel memetic algorithm based on population entropy , 2006, GECCO '06.

[25]  Yoshikazu Fukuyama,et al.  Parallel genetic algorithm for generation expansion planning , 1996 .

[26]  Jonathan M. Garibaldi,et al.  CHAC, A MOACO algorithm for computation of bi-criteria military unit path in the battlefield: Presentation and first results , 2009 .

[27]  Juan Julián Merelo Guervós,et al.  Diversity Through Multiculturality: Assessing Migrant Choice Policies in an Island Model , 2011, IEEE Transactions on Evolutionary Computation.

[28]  Shengxiang Yang,et al.  A hybrid immigrants scheme for genetic algorithms in dynamic environments , 2007, Int. J. Autom. Comput..

[29]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[30]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[31]  Dirk Sudholt,et al.  Design and analysis of migration in parallel evolutionary algorithms , 2013, Soft Comput..

[32]  Marjan Mernik,et al.  Parameter tuning with Chess Rating System (CRS-Tuning) for meta-heuristic algorithms , 2016, Inf. Sci..

[33]  Teodor Gabriel Crainic,et al.  A cooperative parallel metaheuristic for the capacitated vehicle routing problem , 2014, Comput. Oper. Res..

[34]  Erick Cantú-Paz,et al.  Migration Policies, Selection Pressure, and Parallel Evolutionary Algorithms , 2001, J. Heuristics.

[35]  Zhi-hui Zhan,et al.  Topology selection for particle swarm optimization , 2016, Inf. Sci..

[36]  Enrique Alba,et al.  Parallel Metaheuristics: A New Class of Algorithms , 2005 .

[37]  Adrien Goëffon,et al.  A Dynamic Island-Based Genetic Algorithms Framework , 2010, SEAL.

[38]  Zhi-Hua Zhou,et al.  Selection Hyper-heuristics Can Provably Be Helpful in Evolutionary Multi-objective Optimization , 2016, PPSN.

[39]  Fei Tao,et al.  FC-PACO-RM: A Parallel Method for Service Composition Optimal-Selection in Cloud Manufacturing System , 2013, IEEE Transactions on Industrial Informatics.

[40]  Enrique Alba,et al.  Heterogeneous Computing and Parallel Genetic Algorithms , 2002, J. Parallel Distributed Comput..

[41]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[42]  Cheng Wu,et al.  A hybrid artificial bee colony algorithm for the job shop scheduling problem , 2013 .

[43]  Zhi-hui Zhan,et al.  Kuhn–Munkres Parallel Genetic Algorithm for the Set Cover Problem and Its Application to Large-Scale Wireless Sensor Networks , 2016, IEEE Transactions on Evolutionary Computation.

[44]  Jose Miguel Puerta,et al.  Initial approaches to the application of islands-based parallel EDAs in continuous domains , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[45]  Rong Chen,et al.  A novel parallel hybrid intelligence optimization algorithm for a function approximation problem , 2012, Comput. Math. Appl..

[46]  Mingyuan Chen,et al.  A parallel genetic algorithm for dynamic cell formation in cellular manufacturing systems , 2008 .

[47]  Konstantinos E. Parsopoulos,et al.  Parallel cooperative micro-particle swarm optimization: A master-slave model , 2012, Appl. Soft Comput..

[48]  Hui Wang,et al.  A Hybrid Particle Swarm Algorithm with Cauchy Mutation , 2007, 2007 IEEE Swarm Intelligence Symposium.

[49]  Panos M. Pardalos,et al.  A Hybrid Genetic—GRASP Algorithm Using Lagrangean Relaxation for the Traveling Salesman Problem , 2005, J. Comb. Optim..

[50]  Mingyuan Chen,et al.  A parallel genetic algorithm for a flexible job-shop scheduling problem with sequence dependent setups , 2010 .

[51]  D. Y. Sha,et al.  A hybrid particle swarm optimization for job shop scheduling problem , 2006, Comput. Ind. Eng..

[52]  Ruhul A. Sarker,et al.  The Self-Organization of Interaction Networks for Nature-Inspired Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[53]  Lutgarde M. C. Buydens,et al.  Parallel Processing of Chemical Information in a Local Area Network - III. Using Genetic Algorithms for Conformational Analysis of Biomacromolecules , 1996, Comput. Chem..

[54]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[55]  Fred W. Glover,et al.  Multistart Tabu Search and Diversification Strategies for the Quadratic Assignment Problem , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[56]  David W. Corne,et al.  An Investigation Of Topologies and migration schemes for asynchronous distributed evolutionary algorithms , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[57]  Renata M. Aiex,et al.  Parallel GRASP with path-relinking for job shop scheduling , 2003, Parallel Comput..

[58]  Klaus Mueller,et al.  Coding Ants: Optimization of GPU code using ant colony optimization , 2018, Comput. Lang. Syst. Struct..

[59]  Gary B. Lamont,et al.  Considerations in engineering parallel multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[60]  Enrique Alba,et al.  Influence of the Migration Policy in Parallel Distributed GAs with Structured and Panmictic Populations , 2000, Applied Intelligence.

[61]  David Millán-Ruiz,et al.  Matching island topologies to problem structure in parallel evolutionary algorithms , 2013, Soft Computing.