Multiple solution search based on hybridization of real-coded evolutionary algorithm and quasi-newton method

Many evolutionary computation methods have been proposed and applied to real-world problems; however, gradient methods are regarded as promising for their capacity to solve problems involving real-coded parameters. Addressing real-world problems should not only involve the search for a single optimal solution, but also a set of several quasi-optimal solutions. Although some methods aiming the search for multiple solutions have been proposed (e.g. genetic algorithm with sharing and immune algorithm), these could not render highly optimized solutions to real-coded problems. This paper proposes hybrid algorithms combining real-coded evolutionary computation algorithms and gradient search methods for multiple-solution search in multimodal optimization problems. Furthermore, a new evaluation function of solution candidates with gradient is presented and discussed in order to find quasi-optimal solutions. Two hybrid algorithms are proposed - a hybridization between immune algorithm and quasi-Newton method (IA+QN) and a hybridization between genetic algorithm with sharing and quasi-Newton method (GAs+QN). Experimental results have shown that the proposed methods can find optimal and quasi-optimal solutions with high accuracy and efficiency even in high-dimensional multimodal benchmark functions. The results have also shown that GAs+QN has better performance and higher robustness in terms of parameter configuration than IA+QN.

[1]  Satoshi Endo,et al.  An immune optimization inspired by biological immune cell-cooperation for division-and-labor problem , 2001, Proceedings Fourth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2001.

[2]  Samir W. Mahfoud.  Crowding and Preselection Revisited , 1992, PPSN.

[3]  Ralph R. Martin,et al.  A Sequential Niche Technique for Multimodal Function Optimization , 1993, Evolutionary Computation.

[4]  Shigenobu Kobayashi,et al.  A robust real-coded genetic algorithm using Unimodal Normal Distribution Crossover augmented by Uniform Crossover: effects of self-adaptation of crossover probabilities , 1999 .

[5]  D. Dasgupta.  Artificial Immune Systems and Their Applications , 1998, Springer Berlin Heidelberg.

[6]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[7]  Kazuyuki Mori,et al.  Application of an immune algorithm to multi-optimization problems , 1998 .

[8]  Masao Fukushima,et al.  Minimizing multimodal functions by simplex coding genetic algorithm , 2003, Optim. Methods Softw..

[9]  Shigeyoshi Tsutsui,et al.  A study on the effect of multi-parent recombination in real coded genetic algorithms , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[10]  Carlos A. Coello Coello,et al.  Use of Emulations of the Immune System to Handle Constraints in Evolutionary Algorithms , 2001 .

[11]  小林 重信,et al.  An Adaptive Neighboring Search Using Crossover-like Mutation for Deceptive Multimodel Function Optimization , 2001 .

[12]  Jeff Finckenor.  Genetic Algorithms, With Inheritance, VersusGradient Optimizers, And GA/Gradient Hybrids , 1970 .

[13]  Xin Yao,et al.  Solving equations by hybrid evolutionary computation techniques , 2000, IEEE Trans. Evol. Comput..

[14]  Alden H. Wright,et al.  Genetic Algorithms for Real Parameter Optimization , 1990, FOGA.

[15]  Dipankar Dasgupta,et al.  Parallel Search for Multi-Modal FunctionOptimization with Diversity and Learningof Immune Algorithm , 1999 .

[16]  Kalyanmoy Deb,et al.  An Investigation of Niche and Species Formation in Genetic Function Optimization , 1989, ICGA.

[17]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[18]  Keiichiro Yasuda,et al.  A Study of the Similarity between Immune Algorithms and Genetic Algorithms from the Viewpoint of Optimization Methods. , 2003 .

[19]  Ryutaro Himeno,et al.  The niching method for obtaining global optima and local optima in multimodal functions , 2002, Systems and Computers in Japan.

[20]  Haiyan Lu,et al.  Hybrid Real-Coded Genetic Algorithm with Quasi-Simplex Technique , 2006 .