Using performance profiles to analyze the results of the 2006 CEC constrained optimization competition

Performance profiles are an analytical tool for the visualization and interpretation of the results of benchmark experiments. In this paper we discuss their explanatory power, and argue that they should be more widely used by the evolutionary computation community. We also introduce some novel performance measures which can be extracted from the performance profiles. In order to illustrate their potential, we apply the referred profiles to the analysis of the results of the CEC 2006 constrained optimization competition. While some of the results are corroborated, some new facts are pointed out and additional conclusions are drawn.

[1]  Patrick D. Surry,et al.  The COMOGA Method: Constrained Optimisation by Multi-Objective Genetic Algorithms , 1997 .

[2]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[3]  Tetsuyuki Takahama,et al.  Constrained Optimization by the ε Constrained Differential Evolution with Gradient-Based Mutation and Feasible Elites , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[4]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[5]  Lawrence Davis,et al.  Using a genetic algorithm to optimize problems with feasibility constraints , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[6]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[7]  Helio J. C. Barbosa,et al.  An Adaptive Penalty Scheme In Genetic Algorithms For Constrained Optimiazation Problems , 2002, GECCO.

[8]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[9]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[10]  David W. Coit,et al.  Adaptive Penalty Methods for Genetic Optimization of Constrained Combinatorial Problems , 1996, INFORMS J. Comput..

[11]  Zbigniew Michalewicz,et al.  Evolutionary Computation at the Edge of Feasibility , 1996, PPSN.

[12]  Jonathan A. Wright,et al.  Genetic algorithms: a fitness formulation for constrained minimization , 2001 .

[13]  Hyun Myung,et al.  Evolutionary programming techniques for constrained optimization problems , 1997, IEEE Trans. Evol. Comput..

[14]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms, Homomorphous Mappings, and Constrained Parameter Optimization , 1999, Evolutionary Computation.

[15]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[16]  Carlos A. Coello Coello,et al.  Identifying on-line behavior and some sources of difficulty in two competitive approaches for constrained optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[17]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[18]  Sana Ben Hamida,et al.  An Adaptive Algorithm for Constrained Optimization Problems , 2000, PPSN.

[19]  Thomas Bartz-Beielstein,et al.  Experimental Research in Evolutionary Computation - The New Experimentalism , 2010, Natural Computing Series.

[20]  H. Barbosa.  A coevolutionary genetic algorithm for constrained optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[21]  Jorge J. Moré,et al.  Digital Object Identifier (DOI) 10.1007/s101070100263 , 2001 .

[22]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[23]  Helio J. C. Barbosa,et al.  An adaptive penalty scheme for genetic algorithms in structural optimization , 2004 .