Training and testing a self-adaptive multi-operator evolutionary algorithm for constrained optimization

Measure the performance of SAMO-GA on a diverse set of constrained problems.Extend the idea of training and testing with EAs for solving COPs.The mean square error measure is used to quantify the results.The results provide interesting insights and a new way of choosing parameters. Over the last two decades, many different evolutionary algorithms (EAs) have been introduced for solving constrained optimization problems (COPs). Due to the variability of the characteristics in different COPs, no single algorithm performs consistently over a range of practical problems. To design and refine an algorithm, numerous trial-and-error runs are often performed in order to choose a suitable search operator and the parameters. However, even by trial-and-error, one may not find an appropriate search operator and parameters. In this paper, we have applied the concept of training and testing with a self-adaptive multi-operator based evolutionary algorithm to find suitable parameters. The training and testing sets are decided based on the mathematical properties of 60 problems from two well-known specialized benchmark test sets. The experimental results provide interesting insights and a new way of choosing parameters.

[1]  Ruhul A. Sarker,et al.  Self-adaptive differential evolution incorporating a heuristic mixing of operators , 2013, Comput. Optim. Appl..

[2]  Mehmet Fatih Tasgetiren,et al.  An ensemble of discrete differential evolution algorithms for solving the generalized traveling salesman problem , 2010, Appl. Math. Comput..

[3]  Tadahiko MURATA,et al.  Positive and negative combination effects of crossover and mutation operators in sequencing problems , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[4]  A.E. Eiben,et al.  Competing crossovers in an adaptive GA framework , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[5]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[6]  Yoshua Bengio,et al.  No Unbiased Estimator of the Variance of K-Fold Cross-Validation , 2003, J. Mach. Learn. Res..

[7]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[8]  Ruhul A. Sarker,et al.  On an evolutionary approach for constrained optimization problem solving , 2012, Appl. Soft Comput..

[9]  William M. Spears,et al.  Adapting Crossover in Evolutionary Algorithms , 1995, Evolutionary Programming.

[10]  B. Efron.  Estimating the Error Rate of a Prediction Rule: Improvement on Cross-Validation , 1983 .

[11]  Xiaoli Li,et al.  Fast Covariance Matching With Fuzzy Genetic Algorithm , 2012, IEEE Transactions on Industrial Informatics.

[12]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[13]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[14]  Ponnuthurai N. Suganthan,et al.  Ensemble differential evolution algorithm for CEC2011 problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[15]  Ponnuthurai N. Suganthan,et al.  Differential evolution with ensemble of constraint handling techniques for solving CEC 2010 benchmark problems , 2010, IEEE Congress on Evolutionary Computation.

[16]  Tomasz Bartczak,et al.  Comparative Study of Derivative Free Optimization Algorithms , 2011, IEEE Transactions on Industrial Informatics.

[17]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[18]  D. M. Allen.  Mean Square Error of Prediction as a Criterion for Selecting Variables , 1971 .

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[21]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[22]  Ruhul A. Sarker,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013, IEEE Transactions on Industrial Informatics.

[23]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[24]  Byung Ro Moon,et al.  An empirical study on the synergy of multiple crossover operators , 2002, IEEE Trans. Evol. Comput..

[25]  John Langford,et al.  Beating the hold-out: bounds for K-fold and progressive cross-validation , 1999, COLT '99.

[26]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[27]  W. Vent,et al.  Rechenberg, Ingo, Evolutionsstrategie — Optimierung technischer Systeme nach Prinzipien der biologischen Evolution. 170 S. mit 36 Abb. Frommann‐Holzboog‐Verlag. Stuttgart 1973. Broschiert , 1975 .

[28]  Lawrence J. Fogel,et al.  Artificial Intelligence through Simulated Evolution , 1966 .

[29]  Ponnuthurai N. Suganthan,et al.  Ensemble strategies with adaptive evolutionary programming , 2010, Inf. Sci..

[30]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.