Constrained Optimization Based on Quadratic Approximations in Genetic Algorithms

An aspect that often causes difficulties when using Genetic Algorithms for optimization is that these algorithms operate as unconstrained search procedures and most of the real-world problems have constraints of different types. There is a lack of efficient constraint handling technique to bias the search in constrained search spaces toward the feasible regions. We propose a novel methodology to be coupled with a Genetic Algorithm to solve optimization problems with inequality constraints. This methodology can be seen as a local search operator that uses quadratic and linear approximations for both objective function and constraints. In the local search phase, these approximations define an associated problem with a quadratic objective function and quadratic and/or linear constraints that is solved using an LMI (linear matrix inequality) formulation. The solution of this associated problems is then re-introduced in the GA population.We test the proposed methodology with a set of analytical function and the results show that the hybrid algorithm has a better performancewhen compared to the same Genetic Algorithmwithout the proposed local search operator. The tests also suggest that the proposed methodology is at least equivalent, and sometimes better than other methods that have been reported recently in literature.

[1]  Francisco Herrera,et al.  Real-Coded Memetic Algorithms with Crossover Hill-Climbing , 2004, Evolutionary Computation.

[2]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[3]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[4]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[5]  Joshua D. Knowles Local-search and hybrid evolutionary algorithms for Pareto optimization , 2002 .

[6]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[7]  Peter J. Fleming,et al.  Multiobjective optimization and multiple constraint handling with evolutionary algorithms. I. A unified formulation , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[8]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[9]  Ricardo H. C. Takahashi,et al.  A multiobjective methodology for evaluating genetic operators , 2003 .

[10]  D. E. Goldberg,et al.  Optimization and Machine Learning , 2022 .

[11]  Stephen P. Boyd,et al.  Linear Matrix Inequalities in Systems and Control Theory , 1994 .

[12]  K. Preis,et al.  Computation of 3-D Magnetostatic fields using a reduced scalar potential , 1992, Digest of the Fifth Biennial IEEE Conference on Electromagnetic Field Computation.

[13]  Riccardo Poli,et al.  New ideas in optimization , 1999 .

[14]  William E. Hart,et al.  Recent Advances in Memetic Algorithms , 2008 .

[15]  E. Yaz Linear Matrix Inequalities In System And Control Theory , 1998, Proceedings of the IEEE.

[16]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[17]  Gunar E. Liepins,et al.  Some Guidelines for Genetic Algorithms with Penalty Functions , 1989, ICGA.

[18]  M. Repetto,et al.  Multiobjective optimization in magnetostatics: a proposal for benchmark problems , 1996 .

[19]  Mitsuo Gen,et al.  Genetic algorithms and engineering design , 1997 .

[20]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[21]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[22]  Pablo Moscato,et al.  Memetic algorithms: a short introduction , 1999 .

[23]  Kees Roos,et al.  On convex quadratic approximation , 2000 .

[24]  Frederico G. Guimarães,et al.  Constraint quadratic approximation operator for treating equality constraints with genetic algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[25]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[26]  Joshua D. Knowles,et al.  Memetic Algorithms for Multiobjective Optimization: Issues, Methods and Prospects , 2004 .

[27]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[28]  Ricardo H. C. Takahashi,et al.  The real-biased multiobjective genetic algorithm and its application to the design of wire antennas , 2003 .

[29]  David Mautner Himmelblau,et al.  Applied Nonlinear Programming , 1972 .

[30]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[31]  Frederico G. Guimarães,et al.  Local Search with Quadratic Approximations into Memetic Algorithms for Optimization with Multiple Criteria , 2008, Evolutionary Computation.

[32]  Hisao Ishibuchi,et al.  Multi-objective genetic local search algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.