Constrained optimization by improved particle swarm optimization with the equivalent penalty coefficient method

The penalty function method has been widely used to solve constrained optimization problems. In the method, an extended objective function, which is the sum of the objective value and the constraint violation weighted by the penalty coefficient, is optimized. However, it is difficult to control the coefficient properly because the proper control depends on each problem. Recently, the equivalent penalty coefficient (EPC) method, which is a new adaptive penalty method for population-based optimization algorithms (POAs), has been proposed. The EPC method can be applied to POAs where a new solution is compared with the old solution. The EPC value, which makes the two extended objective values of the solutions the same, is used to control the coefficient. In this study, we propose to apply the EPC method to particle swarm optimization (PSO) where a new solution is compared with the best solution found so far. To improve the performance of constrained optimization, a mutation operation is also proposed. The proposed method is examined using two topologies of PSO. The advantage of the proposed method is shown by solving well-known constrained optimization problems and comparing the results with those obtained by PSO with a standard constraint-handling technique.

[1]  Yongzhong Lu,et al.  Recent Advances in Particle Swarm Optimization for Large Scale Problems , 2018, Journal of Autonomous Intelligence.

[2]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Yuren Zhou,et al.  Multiobjective Optimization and Hybrid Evolutionary Algorithm to Solve Constrained Optimization Problems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[5]  Carlos A. Coello Coello,et al.  Use of a self-adaptive penalty approach for engineering optimization problems , 2000 .

[6]  Zbigniew Michalewicz,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[7]  C. Coello,et al.  CONSTRAINT-HANDLING USING AN EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION TECHNIQUE , 2000 .

[8]  Tetsuyuki Takahama,et al.  Constrained Optimization by epsilon Constrained Particle Swarm Optimizer with epsilon-level Control , 2005, WSTST.

[9]  Carlos Artemio Coello-Coello,et al.  Theoretical and numerical constraint-handling techniques used with evolutionary algorithms: a survey of the state of the art , 2002 .

[10]  S. Halgamuge,et al.  A comparison of constraint-handling methods for the application of particle swarm optimization to constrained nonlinear optimization problems , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[11]  Tetsuyuki Takahama,et al.  Tuning fuzzy control rules by the ? constrained method which solves constrained nonlinear optimization problems , 2000 .

[12]  Patrick D. Surry,et al.  The COMOGA Method: Constrained Optimisation by Multi-Objective Genetic Algorithms , 1997 .

[13]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[14]  Carlos A. Coello Coello,et al.  Handling constraints using multiobjective optimization concepts , 2004 .

[15]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[16]  Tetsuyuki Takahama,et al.  Constrained optimization by applying the /spl alpha/ constrained method to the nonlinear simplex method with mutations , 2005, IEEE Transactions on Evolutionary Computation.

[17]  Tapabrata Ray,et al.  An intelligent information sharing strategy within a swarm for unconstrained and constrained optimization problems , 2002, Soft Comput..

[18]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[19]  Xin Yao,et al.  Stochastic ranking for constrained evolutionary optimization , 2000, IEEE Trans. Evol. Comput..

[20]  Gary G. Yen,et al.  An Adaptive Penalty Formulation for Constrained Evolutionary Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[21]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[22]  Zbigniew Michalewicz,et al.  Evolutionary optimization of constrained problems , 1994 .

[23]  Anne Auger,et al.  Markov Chain Analysis of Cumulative Step-Size Adaptation on a Linear Constrained Problem , 2015, Evolutionary Computation.

[24]  Jonathan A. Wright,et al.  Self-adaptive fitness formulation for constrained optimization , 2003, IEEE Trans. Evol. Comput..

[25]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[26]  Tetsuyuki Takahama,et al.  An Equivalent Penalty Coefficient Method: An Adaptive Penalty Approach for Population-Based Constrained Optimization , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[27]  Gary G. Yen,et al.  A Self Adaptive Penalty Function Based Algorithm for Constrained Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[28]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[29]  Gary G. Yen,et al.  A generic framework for constrained optimization using genetic algorithms , 2005, IEEE Transactions on Evolutionary Computation.

[30]  Helio J. C. Barbosa,et al.  An Adaptive Penalty Scheme In Genetic Algorithms For Constrained Optimiazation Problems , 2002, GECCO.

[31]  Carlos A. Coello Coello,et al.  A simple multimembered evolution strategy to solve constrained optimization problems , 2005, IEEE Transactions on Evolutionary Computation.

[32]  X. Yao,et al.  Evolutionary search and constraint violations , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[33]  Christopher R. Houck,et al.  On the use of non-stationary penalty functions to solve nonlinear constrained optimization problems with GA's , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[34]  Yuren Zhou,et al.  An Adaptive Tradeoff Model for Constrained Evolutionary Optimization , 2008, IEEE Transactions on Evolutionary Computation.

[35]  A. P. Engelbrecht,et al.  Particle Swarm Optimization: Global Best or Local Best? , 2013, 2013 BRICS Congress on Computational Intelligence and 11th Brazilian Congress on Computational Intelligence.

[36]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..