Power law-based local search in differential evolution

Differential evolution DE, like other probabilistic optimisation algorithms, sometimes exhibits premature convergence and stagnation. It is analysed by researchers that the DE is better in exploration of the search space compared to exploitation. In the solution search process of DE, there is enough chance to skip the true solution due to large step size. In order to balance the exploration and exploitation capability of the DE, a power law-based local search strategy is proposed and integrated with DE. In the proposed strategy, new solutions are generated around the best solution and it helps to enhance the exploitation capability of DE. The experiments on 14 un-biased test problems of different complexities show that the proposed strategy outperforms the basic DE and recent variants of DE namely, self-adaptive DE SaDE and scale factor local search DE SFLSDE in most of the experiments.

[1]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms: Second Edition , 2010 .

[2]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[3]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[4]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[5]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[6]  Alice E. Smith,et al.  A Seeded Memetic Algorithm for Large Unit Commitment Problems , 2002, J. Heuristics.

[7]  Feng-Sheng Wang,et al.  Inverse problems of biological systems using multi-objective optimization , 2008 .

[8]  D. Dasgupta,et al.  Advances in artificial immune systems , 2006, IEEE Computational Intelligence Magazine.

[9]  Alberto Suárez,et al.  Hybrid Approaches and Dimensionality Reduction for Portfolio Selection with Cardinality Constraints , 2010, IEEE Computational Intelligence Magazine.

[10]  Mark Sumner,et al.  A Fast Adaptive Memetic Algorithm for Online and Offline Control Design of PMSM Drives , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[11]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[12]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[13]  Hitoshi Iba,et al.  Enhancing differential evolution performance with local search for high dimensional function optimization , 2005, GECCO '05.

[14]  Yew-Soon Ong,et al.  Memetic Computation—Past, Present & Future [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[15]  Harish Sharma,et al.  Cognitive learning in differential evolution and its application to model order reduction problem for single-input single-output systems , 2012, Memetic Comput..

[16]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[17]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[18]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[19]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[20]  Ville Tirronen,et al.  Scale factor local search in differential evolution , 2009, Memetic Comput..

[21]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[22]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[23]  Andries Petrus Engelbrecht,et al.  Differential evolution methods for unsupervised image classification , 2005, 2005 IEEE Congress on Evolutionary Computation.

[24]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[25]  Kay Chen Tan,et al.  Multi-Objective Memetic Algorithms , 2009 .

[26]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[28]  D. Williamson,et al.  The box plot: a simple visual method to interpret data. , 1989, Annals of internal medicine.

[29]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.

[30]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[31]  Xin Yao,et al.  Memetic Algorithm With Extended Neighborhood Search for Capacitated Arc Routing Problems , 2009, IEEE Transactions on Evolutionary Computation.

[32]  Pablo Moscato,et al.  Handbook of Memetic Algorithms , 2011, Studies in Computational Intelligence.

[33]  Shengxiang Yang,et al.  A memetic algorithm with adaptive hill climbing strategy for dynamic optimization problems , 2009, Soft Comput..

[34]  Ferrante Neri,et al.  A memetic Differential Evolution approach in noisy optimization , 2010, Memetic Comput..

[35]  Kalyanmoy Deb,et al.  Multiobjective Problem Solving from Nature: From Concepts to Applications (Natural Computing Series) , 2008 .

[36]  Zbigniew Michalewicz,et al.  Handbook of Evolutionary Computation , 1997 .

[37]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[38]  Christos D. Tarantilis,et al.  Arc-Guided Evolutionary Algorithm for the Vehicle Routing Problem With Time Windows , 2009, IEEE Transactions on Evolutionary Computation.

[39]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[40]  K. V. Price,et al.  Differential evolution: a fast and simple numerical optimizer , 1996, Proceedings of North American Fuzzy Information Processing.

[41]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[42]  Hisao Ishibuchi,et al.  Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining , 2004, Fuzzy Sets Syst..

[43]  Zelda B. Zabinsky,et al.  A Numerical Evaluation of Several Stochastic Algorithms on Selected Continuous Global Optimization Test Problems , 2005, J. Glob. Optim..

[44]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[45]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[46]  Janez Brest,et al.  Self-Adaptive Differential Evolution Algorithm in Constrained Real-Parameter Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[47]  Jessica Andrea Carballido,et al.  BiHEA: A Hybrid Evolutionary Approach for Microarray Biclustering , 2009, BSB.

[48]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[49]  Amit Konar,et al.  Two-Dimensional IIR Filter Design with Modern Search Heuristics: a Comparative Study , 2006, Int. J. Comput. Intell. Appl..

[50]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[51]  Jin-Kao Hao,et al.  A Memetic Algorithm for Phylogenetic Reconstruction with Maximum Parsimony , 2009, EvoBIO.

[52]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[53]  Danushka Bollegala,et al.  Differential evolution with self adaptive local search , 2011, GECCO '11.

[54]  Thomas Stützle,et al.  Stochastic Local Search: Foundations & Applications , 2004 .

[55]  S. Blackmore The Meme Machine , 1999 .