Adaptive fuzzy fitness granulation for evolutionary optimization

Nature may have been the original inspiration for evolutionary algorithms, but unlike artificially designed systems, nature has an abundance of resources and time. For man-made systems, computational complexity is a prohibitive factor in sufficiently large and complex problems of today. Much of this computational complexity is due to the fitness function evaluation that may either not exist or be computationally very expensive. But, an exact computation of fitness may not be really necessary as long as a proper rank is approximately preserved in the evolution's scheme of the survival of the fittest. Here, we aim to exploit this feature of evolution and to investigate the use of fitness granulation via an adaptive fuzzy similarity analysis in order to reduce the number of fitness evaluations. In the proposed algorithm, an individual's fitness is only computed if it has insufficient similarity to a pool of fuzzy granules whose fitness has already been computed. If an individual is sufficiently similar to a known fuzzy granule, then that granule's fitness is used instead as a crude estimate. Otherwise, that individual is added to the pool as the core of a new fuzzy granule. Each granule's radius of influence is adaptive and will grow/shrink depending on the population fitness. The proposed technique is applied to two sets of problems. First is a set of several numerical benchmark problems with various optimization characteristics. Second is a set of four hardware design problems that are evaluated via finite element analysis. Performance of the proposed algorithm is compared with several other competing algorithms, i.e. a fast evolutionary strategy (FES), a GA-NN, as well as a simple GA, in terms of both computational efficiency and accuracy. Statistical analysis reveals that the proposed method significantly decreases the number of fitness function evaluations while finding equally good or better solutions. Moreover, application to the hardware design problems reveals better structural designs more consistently with better computational efficiency.

[1]  A. Keane,et al.  Evolutionary Optimization of Computationally Expensive Problems via Surrogate Modeling , 2003 .

[2]  Lotfi A. Zadeh,et al.  Toward a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic , 1997, Fuzzy Sets Syst..

[3]  Natalia Alexandrov,et al.  Multidisciplinary design optimization : state of the art , 1997 .

[4]  R. H. Myers,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[5]  Bernhard Sendhoff,et al.  Comparing neural networks and Kriging for fitness approximation in evolutionary optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[6]  Andreas Zell,et al.  Evolution strategies assisted by Gaussian processes with improved preselection criterion , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[7]  Carlos A. Coello Coello,et al.  Fitness inheritance in multi-objective particle swarm optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[8]  D. Goldberg,et al.  Don't evaluate, inherit , 2001 .

[9]  António Gaspar-Cunha,et al.  A Multi-Objective Evolutionary Algorithm Using Neural Networks to Approximate Fitness Evaluations , 2005, Int. J. Comput. Syst. Signals.

[10]  Mehrdad Salami,et al.  The Fast Evaluation Strategy for Evolvable Hardware , 2005, Genetic Programming and Evolvable Machines.

[11]  Guojun Lu,et al.  DAFHEA: a dynamic approximate fitness-based hybrid EA for optimisation problems , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  Maumita Bhattacharya,et al.  Meta Model Based EA for Complex Optimization , 2008 .

[13]  David E. Goldberg,et al.  Fitness Inheritance In Multi-objective Optimization , 2002, GECCO.

[14]  Thomas J. Santner,et al.  The Design and Analysis of Computer Experiments , 2003, Springer Series in Statistics.

[15]  Yaochu Jin,et al.  Managing approximate models in evolutionary aerodynamic design optimization , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[16]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[17]  Bernhard Sendhoff,et al.  On Evolutionary Optimization with Approximate Fitness Functions , 2000, GECCO.

[18]  J. Dias Rodrigues,et al.  The application of genetic algorithms for shape control with piezoelectric patches—an experimental comparison , 2004 .

[19]  Andy J. Keane,et al.  Combining Global and Local Surrogate Models to Accelerate Evolutionary Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Sung-Bae Cho,et al.  An efficient genetic algorithm with less fitness evaluation by clustering , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[21]  Francisco Herrera,et al.  Fuzzy adaptive genetic algorithms: design, taxonomy, and future directions , 2003, Soft Comput..

[22]  B. K. Natarajan,et al.  Genetic Evolution of Radial Basis Function Coverage Using Orthogonal Niches , 1996 .

[23]  Francisco Herrera,et al.  Adaptive genetic operators based on coevolution with fuzzy behaviors , 2001, IEEE Trans. Evol. Comput..

[24]  K. Giannakoglou,et al.  Aerodynamic shape design using evolutionary algorithms and new gradient-assisted metamodels , 2006 .

[25]  T. Ray,et al.  A framework for optimization using approximate functions , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[26]  Mehrdad Salami,et al.  A fast evaluation strategy for evolutionary algorithms , 2003, Appl. Soft Comput..

[27]  Mohammad-R. Akbarzadeh-T,et al.  Multi-objective meta level soft computing-based evolutionary structural design , 2007, J. Frankl. Inst..

[28]  Andreas Zell,et al.  Evolution strategies with controlled model assistance , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[29]  Douglas C. Montgomery,et al.  Response Surface Methodology: Process and Product Optimization Using Designed Experiments , 1995 .

[30]  B. Julstrom,et al.  Design of vector quantization codebooks using a genetic algorithm , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[31]  Naser Pariz,et al.  Adaptive Fuzzy Fitness Granulation in Structural Optimization Problems , 2007, 2007 IEEE 22nd International Symposium on Intelligent Control.

[32]  Min-Jea Tahk,et al.  Acceleration of the convergence speed of evolutionary algorithms using multi-layer neural networks , 2003 .

[33]  Bernard De Baets,et al.  Is Fitness Inheritance Useful for Real-World Applications? , 2003, EMO.

[34]  Bernhard Sendhoff,et al.  Reducing Fitness Evaluations Using Clustering Techniques and Neural Network Ensembles , 2004, GECCO.

[35]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[36]  Sonja Kuhnt,et al.  Design and analysis of computer experiments , 2010 .

[37]  Carlos A. Coello Coello,et al.  A study of fitness inheritance and approximation techniques for multi-objective particle swarm optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[38]  S. Abbasi,et al.  Friendship modeling for cooperative co-evolutionary fuzzy systems: a hybrid GA-GP algorithm , 2003, 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS 2003.

[39]  Naser Pariz,et al.  A novel general framework for evolutionary optimization: Adaptive fuzzy fitness granulation , 2007, 2007 IEEE Congress on Evolutionary Computation.

[40]  Vijay K. Rohatgi,et al.  Advances in Fuzzy Set Theory and Applications , 1980 .

[41]  Lotfi A. Zadeh,et al.  Fuzzy sets and information granularity , 1996 .

[42]  Bernhard Sendhoff,et al.  Structure optimization of neural networks for evolutionary design optimization , 2005, Soft Comput..