A bi-objective constrained optimization algorithm using a hybrid evolutionary and penalty function approach

Constrained optimization is a computationally difficult task, particularly if the constraint functions are nonlinear and non-convex. As a generic classical approach, the penalty function approach is a popular methodology which degrades the objective function value by adding a penalty proportional to the constraint violation. However, the penalty function approach has been criticized for its sensitivity to the associated penalty parameters. Since its inception, evolutionary algorithms have been modified in various ways to solve constrained optimization problems. Of them, the recent use of a bi-objective evolutionary algorithm in which the minimization of the constraint violation is included as an additional objective has received significant attention. In this article, a combination of a bi-objective evolutionary approach with the classical penalty function methodology is proposed, in a manner complementary to each other. The evolutionary approach provides an appropriate estimate of the penalty parameter, while the solution of an unconstrained penalized function by a classical method induces a convergence property to the overall hybrid algorithm. The working of the procedure on a number of standard numerical test problems and an engineering design problem is demonstrated. In most cases, the proposed hybrid methodology is observed to take one or more orders of magnitude fewer function evaluations to find the constrained minimum solution accurately than some of the best reported existing methodologies.

[1]  Naim Dahnoun,et al.  Studies in Computational Intelligence , 2013 .

[2]  Yong Wang,et al.  Combining Multiobjective Optimization With Differential Evolution to Solve Constrained Optimization Problems , 2012, IEEE Transactions on Evolutionary Computation.

[3]  Jacek M. Zurada,et al.  Swarm and Evolutionary Computation , 2012, Lecture Notes in Computer Science.

[4]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[5]  Carlos A. Coello Coello,et al.  Constraint-handling in nature-inspired numerical optimization: Past, present and future , 2011, Swarm Evol. Comput..

[6]  Li Zhang,et al.  Hybrid differential evolution with a simplified quadratic approximation for constrained optimization problems , 2011 .

[7]  P. Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2010 Competition on Constrained Real- Parameter Optimization , 2010 .

[8]  Efrn Mezura-Montes,et al.  Constraint-Handling in Evolutionary Optimization , 2009 .

[9]  Tetsuyuki Takahama,et al.  Solving Difficult Constrained Optimization Problems by the ε Constrained Differential Evolution with Gradient-Based Mutation , 2009 .

[10]  Angel Eduardo Muñoz Zavala,et al.  Continuous Constrained Optimization with Dynamic Tolerance Using the COPSO Algorithm , 2009 .

[11]  Janez Brest,et al.  Constrained Real-Parameter Optimization with ε -Self-Adaptive Differential Evolution , 2009 .

[12]  Elizabeth F. Wanner,et al.  Constrained Optimization Based on Quadratic Approximations in Genetic Algorithms , 2009 .

[13]  R. K. Ursem Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[14]  Erwie Zahara,et al.  Solving constrained optimization problems with hybrid particle swarm optimization , 2008 .

[15]  Jürgen Branke,et al.  Consideration of Partial User Preferences in Evolutionary Multiobjective Optimization , 2008, Multiobjective Optimization.

[16]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[17]  Kalyanmoy Deb,et al.  A Hybrid Evolutionary Multi-objective and SQP Based Procedure for Constrained Optimization , 2007, ISICA.

[18]  Yong Wang,et al.  A Multiobjective Optimization-Based Evolutionary Algorithm for Constrained Optimization , 2006, IEEE Transactions on Evolutionary Computation.

[19]  Elmer P. Dadios,et al.  Genetic algorithm with adaptive and dynamic penalty functions for the selection of cleaner production measures: a constrained optimization problem , 2006 .

[20]  A. Ravindran,et al.  Engineering Optimization: Methods and Applications , 2006 .

[21]  M. Roma,et al.  Large-Scale Nonlinear Optimization , 2006 .

[22]  Tarek A. El-Mihoub,et al.  Hybrid Genetic Algorithms: A Review , 2006, Eng. Lett..

[23]  Jorge Nocedal,et al.  Knitro: An Integrated Package for Nonlinear Optimization , 2006 .

[24]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[25]  Gary E. Birch,et al.  A hybrid genetic algorithm approach for improving the performance of the LF-ASD brain computer interface , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[26]  Kalyanmoy Deb,et al.  Integrating User Preferences into Evolutionary Multi-Objective Optimization , 2005 .

[27]  Yaochu Jin,et al.  Knowledge incorporation in evolutionary computation , 2005 .

[28]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[29]  Yuren Zhou,et al.  Multi-objective and MGG evolutionary algorithm for constrained optimization , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[30]  Andres Angantyr,et al.  Constrained optimization based on a multiobjective evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[31]  Tapabrata Ray,et al.  Society and civilization: An optimization algorithm based on the simulation of social behavior , 2003, IEEE Trans. Evol. Comput..

[32]  Masao Fukushima,et al.  Simplex Coding Genetic Algorithm for the Global Optimization of Nonlinear Functions , 2003 .

[33]  Xavier Gandibleux,et al.  MultiObjective Programming and Goal Programming , 2003 .

[34]  Ángel Fernando Kuri Morales,et al.  Penalty Function Methods for Constrained Optimization with Genetic Algorithms: A Statistical Analysis , 2002, MICAI.

[35]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[36]  Pruettha Nanakorn,et al.  An adaptive penalty function in genetic algorithms for structural design optimization , 2001 .

[37]  K. Deb An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[38]  C. Coello TREATING CONSTRAINTS AS OBJECTIVES FOR SINGLE-OBJECTIVE EVOLUTIONARY OPTIMIZATION , 2000 .

[39]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[40]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[41]  Hyun Myung,et al.  Hybrid Interior-Langrangian Penalty Based Evolutionary Optimization , 1998, Evolutionary Programming.

[42]  Thomas E. Potok,et al.  Evolutionary Computing , 2019, Encyclopedia of Machine Learning and Data Mining.

[43]  Mitsuo Gen,et al.  A survey of penalty techniques in genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[44]  David W. Coit,et al.  Adaptive Penalty Methods for Genetic Optimization of Constrained Combinatorial Problems , 1996, INFORMS J. Comput..

[45]  Patrick D. Surry,et al.  A Multi-objective Approach to Constrained Optimisation of Gas Supply Networks: the COMOGA Method , 1995, Evolutionary Computing, AISB Workshop.

[46]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[47]  Kalyanmoy Deb,et al.  Optimal design of a welded beam via genetic algorithms , 1991 .

[48]  Zbigniew Michalewicz,et al.  Handling Constraints in Genetic Algorithms , 1991, ICGA.

[49]  Gunar E. Liepins,et al.  Some Guidelines for Genetic Algorithms with Penalty Functions , 1989, ICGA.

[50]  Yacov Y. Haimes,et al.  Multiobjective Decision Making: Theory and Methodology , 1983 .

[51]  F. Grund Forsythe, G. E. / Malcolm, M. A. / Moler, C. B., Computer Methods for Mathematical Computations. Englewood Cliffs, New Jersey 07632. Prentice Hall, Inc., 1977. XI, 259 S , 1979 .

[52]  Michael A. Malcolm,et al.  Computer methods for mathematical computations , 1977 .