An adaptive penalty based covariance matrix adaptation-evolution strategy

Abstract Although most of unconstrained optimization problems with moderate to high dimensions can be easily handled with Evolutionary Computation (EC) techniques, constraint optimization problems (COPs) with inequality and equality constraints are very hard to deal with. Despite the fact that only equality constraints can be used to eliminate a certain variable, both types of constraints implicitly enforce a relation between problem variables. Most conventional constraint handling methods in EC do not consider the correlations between problem variables imposed by the problem constraints. This paper relies on the idea that a proper genetic operator, which captures mentioned implicit correlations, can improve performance of evolutionary constrained optimization algorithms. With this in mind, we employ a (μ+λ)-Evolution Strategy with a simplified variant of Covariance Matrix Adaptation based mutation operator along an adaptive weight adjustment scheme. The proposed algorithm is tested on two test sets. The outperformance of the algorithm is significant on the first benchmark when compared with five conventional methods. The results on the second test set show that algorithm is highly competitive when benchmarked with three state-of-art algorithms. The main drawback of the algorithm is its slightly lower speed of convergence for problems with high dimension and/or large search domain.

[1]  Sana Ben Hamida,et al.  The need for improving the exploration operators for constrained optimization problems , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[2]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[3]  Zhigang Shang,et al.  Differential evolution with dynamic constraint-handling mechanism , 2010, IEEE Congress on Evolutionary Computation.

[4]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[5]  Tetsuyuki Takahama,et al.  Constrained Optimization by the epsilon Constrained Hybrid Algorithm of Particle Swarm Optimization and Genetic Algorithm , 2005, Australian Conference on Artificial Intelligence.

[6]  Tetsuyuki Takahama,et al.  Constrained optimization by the ε constrained differential evolution with an archive and gradient-based mutation , 2010, IEEE Congress on Evolutionary Computation.

[7]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[8]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[9]  Janez Brest,et al.  An improved self-adaptive differential evolution algorithm in single objective constrained real-parameter optimization , 2010, IEEE Congress on Evolutionary Computation.

[10]  Julian F. Miller,et al.  Genetic and Evolutionary Computation — GECCO 2003 , 2003, Lecture Notes in Computer Science.

[11]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[12]  Dirk V. Arnold,et al.  A (1+1)-CMA-ES for constrained optimisation , 2012, GECCO '12.

[13]  James C. Bean,et al.  A Genetic Algorithm for the Multiple-Choice Integer Program , 1997, Oper. Res..

[14]  Efrén Mezura-Montes,et al.  Differential evolution in constrained numerical optimization: An empirical study , 2010, Inf. Sci..

[15]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1996, Springer Berlin Heidelberg.

[16]  Frank Hoffmeister,et al.  Problem-Independent Handling of Constraints by Use of Metric Penalty Functions , 1996, Evolutionary Programming.

[17]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[18]  Pei Yee Ho,et al.  Evolutionary constrained optimization using an addition of ranking method and a percentage-based tolerance value adjustment scheme , 2007, Inf. Sci..

[19]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[20]  Anne Auger,et al.  Empirical comparisons of several derivative free optimization algorithms , 2009 .

[21]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[22]  Xin Yao,et al.  Search biases in constrained evolutionary optimization , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Carlos A. Coello Coello,et al.  THEORETICAL AND NUMERICAL CONSTRAINT-HANDLING TECHNIQUES USED WITH EVOLUTIONARY ALGORITHMS: A SURVEY OF THE STATE OF THE ART , 2002 .

[24]  Xiang Li,et al.  Inequality constraint handling in genetic algorithms using a boundary simulation method , 2012, Comput. Oper. Res..

[25]  M. J. D. Powell,et al.  A fast algorithm for nonlinearly constrained optimization calculations , 1978 .

[26]  Jonathan A. Wright,et al.  Self-adaptive fitness formulation for constrained optimization , 2003, IEEE Trans. Evol. Comput..

[27]  Giovanni Iacca,et al.  Ockham's Razor in memetic computing: Three stage optimal memetic exploration , 2012, Inf. Sci..

[28]  Chee Kiong Soh,et al.  An evolutionary programming algorithm for continuous global optimization , 2006, Eur. J. Oper. Res..

[29]  Tapabrata Ray,et al.  Performance of infeasibility empowered memetic algorithm for CEC 2010 constrained optimization problems , 2010, IEEE Congress on Evolutionary Computation.

[30]  Francisco Herrera,et al.  A study of statistical techniques and performance measures for genetics-based machine learning: accuracy and interpretability , 2009, Soft Comput..

[31]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[32]  Kalyanmoy Deb,et al.  A Computationally Efficient Evolutionary Algorithm for Real-Parameter Optimization , 2002, Evolutionary Computation.

[33]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[34]  Xinjie Yu,et al.  Introduction to evolutionary algorithms , 2010, The 40th International Conference on Computers & Indutrial Engineering.

[35]  Oliver Kramer,et al.  A Review of Constraint-Handling Techniques for Evolution Strategies , 2010, Appl. Comput. Intell. Soft Comput..

[36]  R. Hinterding,et al.  Constrained parameter optimisation: equality constraints , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[37]  Kalyanmoy Deb,et al.  Hybrid gradient projection based Genetic Algorithms for constrained optimization , 2010, IEEE Congress on Evolutionary Computation.

[38]  Stefan Roth,et al.  Covariance Matrix Adaptation for Multi-objective Optimization , 2007, Evolutionary Computation.

[39]  Abdolhamid Eshraghniaye Jahromi,et al.  A particle swarm-BFGS algorithm for nonlinear programming problems , 2013, Comput. Oper. Res..

[40]  Xavier Blasco Ferragud,et al.  Multiobjective optimization algorithm for solving constrained single objective problems , 2010, IEEE Congress on Evolutionary Computation.

[41]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[42]  Anthony Chen,et al.  Constraint handling in genetic algorithms using a gradient-based repair method , 2006, Comput. Oper. Res..

[43]  Ponnuthurai N. Suganthan,et al.  Differential evolution with ensemble of constraint handling techniques for solving CEC 2010 benchmark problems , 2010, IEEE Congress on Evolutionary Computation.

[44]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[45]  Ruhul A. Sarker,et al.  Integrated strategies differential evolution algorithm with a local search for constrained optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[46]  Michèle Sebag,et al.  Not All Parents Are Equal for MO-CMA-ES , 2011, EMO.

[47]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[48]  Marc Schoenauer,et al.  ASCHEA: new results using adaptive segregational constraint handling , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[49]  Tapabrata Ray,et al.  Performance of infeasibility driven evolutionary algorithm (IDEA) on constrained dynamic single objective optimization problems , 2009, 2009 IEEE Congress on Evolutionary Computation.

[50]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[51]  John W. Pepper,et al.  Efficient Use of Variation in Evolutionary Optimization , 2010, Appl. Comput. Intell. Soft Comput..

[52]  Ali Osman Kusakci,et al.  Constrained Optimization with Evolutionary Algorithms: A Comprehensive Review , 2012, SOCO 2012.

[53]  Josef Tvrdík,et al.  Competitive differential evolution for constrained problems , 2010, IEEE Congress on Evolutionary Computation.

[54]  Mehmet Fatih Tasgetiren,et al.  An ensemble of differential evolution algorithms for constrained function optimization , 2010, IEEE Congress on Evolutionary Computation.