Hybrid biogeography-based evolutionary algorithms

Hybrid evolutionary algorithms (EAs) are effective optimization methods that combine multiple EAs. We propose several hybrid EAs by combining some recently-developed EAs with a biogeography-based hybridization strategy. We test our hybrid EAs on the continuous optimization benchmarks from the 2013 Congress on Evolutionary Computation (CEC) and on some real-world traveling salesman problems. The new hybrid EAs include two approaches to hybridization: (1) iteration-level hybridization, in which various EAs and BBO are executed in sequence; and (2) algorithm-level hybridization, which runs various EAs independently and then exchanges information between them using ideas from biogeography. Our empirical study shows that the new hybrid EAs significantly outperforms their constituent algorithms with the selected tuning parameters and generation limits, and algorithm-level hybridization is generally better than iteration-level hybridization. Results also show that the best new hybrid algorithm in this paper is competitive with the algorithms from the 2013 CEC competition. In addition, we show that the new hybrid EAs are generally robust to tuning parameters. In summary, the contribution of this paper is the introduction of biogeography-based hybridization strategies to the EA community.

[1]  Edmund K. Burke,et al.  Parallel Problem Solving from Nature - PPSN IX: 9th International Conference, Reykjavik, Iceland, September 9-13, 2006, Proceedings , 2006, PPSN.

[2]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[3]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[4]  Christian Blum,et al.  Hybrid metaheuristics in combinatorial optimization: A survey , 2011, Appl. Soft Comput..

[5]  Taher Niknam,et al.  A hybrid self-adaptive particle swarm optimization and modified shuffled frog leaping algorithm for distribution feeder reconfiguration , 2010, Eng. Appl. Artif. Intell..

[6]  Dan Simon,et al.  Analysis of migration models of biogeography-based optimization using Markov theory , 2011, Eng. Appl. Artif. Intell..

[7]  Carlos García-Martínez,et al.  Hybrid metaheuristics with evolutionary algorithms specializing in intensification and diversification: Overview and progress report , 2010, Comput. Oper. Res..

[8]  Edward Sazonov,et al.  Hybrid evolutionary algorithm for microscrew thread parameter estimation , 2010, Eng. Appl. Artif. Intell..

[9]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[10]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[11]  Amitava Chatterjee,et al.  Hybrid BBO-DE Algorithms for Fuzzy Entropy-Based Thresholding , 2013 .

[12]  Haiping Ma,et al.  An analysis of the equilibrium of migration models for biogeography-based optimization , 2010, Inf. Sci..

[13]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[14]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[15]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[16]  Dan Simon,et al.  A dynamic system model of biogeography-based optimization , 2011, Appl. Soft Comput..

[17]  Ying Tan,et al.  Advances in Swarm Intelligence , 2016, Lecture Notes in Computer Science.

[18]  Dan Simon,et al.  Blended biogeography-based optimization for constrained optimization , 2011, Eng. Appl. Artif. Intell..

[19]  Domen Mongus,et al.  A hybrid evolutionary algorithm for tuning a cloth-simulation model , 2012, Appl. Soft Comput..

[20]  István Erlich,et al.  Hybrid Mean-Variance Mapping Optimization for solving the IEEE-CEC 2013 competition problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[21]  Amir Nakib,et al.  An improved biogeography based optimization approach for segmentation of human head CT-scan images employing fuzzy entropy , 2012, Eng. Appl. Artif. Intell..

[22]  Ye Xu,et al.  An effective hybrid biogeography-based optimization algorithm for parameter estimation of chaotic systems , 2011, Expert Syst. Appl..

[23]  H. Keselman,et al.  Multiple Comparison Procedures , 2005 .

[24]  Alex S. Fukunaga,et al.  Evaluating the performance of SHADE on CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[26]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[27]  Peter J. Fleming,et al.  The Stud GA: A Mini Revolution? , 1998, PPSN.

[28]  Ilya Loshchilov,et al.  CMA-ES with restarts for solving CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[29]  Chang Wook Ahn,et al.  Advances in Evolutionary Algorithms: Theory, Design and Practice , 2006, Studies in Computational Intelligence.

[30]  Bernhard Sendhoff,et al.  Covariance Matrix Adaptation Revisited - The CMSA Evolution Strategy - , 2008, PPSN.

[31]  Taher Niknam,et al.  An efficient hybrid evolutionary algorithm based on PSO and HBMO algorithms for multi-objective Distribution Feeder Reconfiguration , 2009 .

[32]  Junyan Wang,et al.  Nonlinear Inertia Weight Variation for Dynamic Adaptation in Particle Swarm Optimization , 2011, ICSI.

[33]  Dan Simon,et al.  Analytical and numerical comparisons of biogeography-based optimization and genetic algorithms , 2011, Inf. Sci..

[34]  P. K. Chattopadhyay,et al.  Hybrid Differential Evolution With Biogeography-Based Optimization for Solution of Economic Load Dispatch , 2010, IEEE Transactions on Power Systems.

[35]  Francisco Herrera,et al.  Dynamically updated region based memetic algorithm for the 2013 CEC Special Session and Competition on Real Parameter Single Objective Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[36]  Ponnuthurai N. Suganthan,et al.  Self-adaptive differential evolution with multi-trajectory search for large-scale optimization , 2011, Soft Comput..

[37]  O. J. Dunn Multiple Comparisons among Means , 1961 .

[38]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Comparing Review , 2006, Towards a New Evolutionary Computation.

[39]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[40]  Lifang Xu,et al.  Biogeography migration algorithm for traveling salesman problem , 2010, Int. J. Intell. Comput. Cybern..

[41]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[42]  Zhun Fan,et al.  Constrained optimization based on hybrid evolutionary algorithm and adaptive constraint-handling technique , 2009 .

[43]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[44]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[45]  Lin Lin,et al.  Multiobjective evolutionary algorithm for manufacturing scheduling problems: state-of-the-art survey , 2014, J. Intell. Manuf..

[46]  Patrick Siarry,et al.  Hybridizing Biogeography-Based Optimization With Differential Evolution for Optimal Power Allocation in Wireless Sensor Networks , 2011, IEEE Transactions on Vehicular Technology.

[47]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[48]  Stephanie Forrest,et al.  Architecture for an Artificial Immune System , 2000, Evolutionary Computation.

[49]  Hans-Georg Beyer,et al.  Toward a Theory of Evolution Strategies: The (, )-Theory , 1994, Evolutionary Computation.

[50]  Patrick Siarry,et al.  Biogeography-based optimization for constrained optimization problems , 2012, Comput. Oper. Res..

[51]  Caroline Prodhon,et al.  A hybrid evolutionary algorithm for the periodic location-routing problem , 2011, Eur. J. Oper. Res..

[52]  Ponnuthurai N. Suganthan,et al.  Real-parameter evolutionary multimodal optimization - A survey of the state-of-the-art , 2011, Swarm Evol. Comput..

[53]  Josef Tvrdík,et al.  Competitive differential evolution applied to CEC 2013 problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[54]  Amitava Chatterjee,et al.  Advances in Heuristic Signal Processing and Applications , 2013, Springer Berlin Heidelberg.

[55]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[56]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[57]  BeyerHans-Georg Toward a theory of evolution strategies , 1993 .

[58]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[59]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[60]  In Schoenauer,et al.  Parallel Problem Solving from Nature , 1990, Lecture Notes in Computer Science.

[61]  K. S. Swarup,et al.  Multi-objective biogeography based optimization for optimal PMU placement , 2012, Appl. Soft Comput..

[62]  Thomas Stützle,et al.  Benchmark results for a simple hybrid algorithm on the CEC 2013 benchmark set for real-parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[63]  Youfang Huang,et al.  A quay crane dynamic scheduling problem by hybrid evolutionary algorithm for berth allocation planning , 2009, Comput. Ind. Eng..

[64]  Luigi Fortuna,et al.  Evolutionary Optimization Algorithms , 2001 .

[65]  Mostafa Zandieh,et al.  A new biogeography-based optimization (BBO) algorithm for the flexible job shop scheduling problem , 2012 .

[66]  Patrick Siarry,et al.  Two-stage update biogeography-based optimization using differential evolution algorithm (DBBO) , 2011, Comput. Oper. Res..

[67]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[68]  Mitsuo Gen,et al.  Integrated multistage logistics network design by using hybrid evolutionary algorithm , 2009, Comput. Ind. Eng..

[69]  Carlos Cotta,et al.  Memetic algorithms and memetic computing optimization: A literature review , 2012, Swarm Evol. Comput..

[70]  Amitava Chatterjee,et al.  A Comparative Study of Modified BBO Variants and Other Metaheuristics for Optimal Power Allocation in Wireless Sensor Networks , 2013, Advances in Heuristic Signal Processing and Applications.

[71]  Janez Brest,et al.  Structured Population Size Reduction Differential Evolution with Multiple Mutation Strategies on CEC 2013 real parameter optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[72]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[73]  Carlos A. Coello Coello,et al.  MRMOGA: parallel evolutionary multiobjective optimization using multiple resolutions , 2005, 2005 IEEE Congress on Evolutionary Computation.

[74]  Dirk Sudholt,et al.  The benefit of migration in parallel evolutionary algorithms , 2010, GECCO '10.

[75]  Patrick Siarry,et al.  Computational Intelligence in Image Processing , 2012 .

[76]  Urvinder Singh,et al.  Design of Yagi-Uda Antenna Using Biogeography Based Optimization , 2010, IEEE Transactions on Antennas and Propagation.

[77]  Moritoshi Yasunaga,et al.  Implementation of an Effective Hybrid GA for Large-Scale Traveling Salesman Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[78]  Zbigniew Michalewicz,et al.  Inver-over Operator for the TSP , 1998, PPSN.

[79]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .