Cooperative coevolutionary differential evolution with improved augmented Lagrangian to solve constrained optimisation problems

Propose the improved augmented Lagrangian method (iALF) to deal with constraints in a more efficient way.Propose cooperative coevolutionary method using improved augmented Lagrangian (CCiALF) approach for solving constrained optimisation problems.Solve the CEC'2006 constrained optimisation test suite with proposed CCiALF algorithm with higher solution quality compared to the state-of-the-art algorithms.Solve practical engineering problems by proposed CCiALF algorithm and improve the best known objective function value that exists in the literature. In constrained optimisation, the augmented Lagrangian method is considered as one of the most effective and efficient methods. This paper studies the behaviour of augmented Lagrangian function (ALF) in the solution space and then proposes an improved augmented Lagrangian method. We have shown that our proposed method can overcome some of the drawbacks of the conventional augmented Lagrangian method. With the improved augmented Lagrangian approach, this paper then proposes a cooperative coevolutionary differential evolution algorithm for solving constrained optimisation problems. The proposed algorithm is evaluated on a set of 24 well-known benchmark functions and five practical engineering problems. Experimental results demonstrate that the proposed algorithm outperforms the state-of-the-art algorithms with respect to solution quality as well as efficiency.

[1]  R. Tyrrell Rockafellar,et al.  A dual approach to solving nonlinear programming problems by unconstrained optimization , 1973, Math. Program..

[2]  Ana Maria A. C. Rocha,et al.  An augmented Lagrangian fish swarm based method for global optimization , 2011, J. Comput. Appl. Math..

[3]  M. Fernanda P. Costa,et al.  An artificial fish swarm algorithm based hyperbolic augmented Lagrangian method , 2014, J. Comput. Appl. Math..

[4]  Ivona Brajevic,et al.  Crossover-based artificial bee colony algorithm for constrained optimization problems , 2015, Neural Computing and Applications.

[5]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[6]  Zbigniew Michalewicz,et al.  Evolutionary Algorithms for Constrained Parameter Optimization Problems , 1996, Evolutionary Computation.

[7]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[8]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[9]  Kamal C. Sarma,et al.  FUZZY GENETIC ALGORITHM FOR OPTIMIZATION OF STEEL STRUCTURES , 2000 .

[10]  Sung Nam Jung,et al.  Advanced particle swarm assisted genetic algorithm for constrained optimization problems , 2014, Computational Optimization and Applications.

[11]  R. Rockafellar.  The multiplier method of Hestenes and Powell applied to convex programming , 1973 .

[12]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[13]  Ponnuthurai N. Suganthan,et al.  A Differential Evolution Framework with Ensemble of Parameters and Strategies and Pool of Local Search Algorithms , 2014, EvoApplications.

[14]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[15]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[16]  Dervis Karaboga,et al.  Artificial bee colony algorithm for large-scale problems and engineering design optimization , 2012, J. Intell. Manuf..

[17]  E. Sandgren,et al.  Nonlinear Integer and Discrete Programming in Mechanical Design Optimization , 1990 .

[18]  J. Golinski,et al.  An adaptive optimization system applied to machine synthesis , 1973 .

[19]  Gary G. Yen,et al.  An Adaptive Penalty Formulation for Constrained Evolutionary Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Gexiang Zhang,et al.  Multicriteria adaptive differential evolution for global numerical optimization , 2015, Integr. Comput. Aided Eng..

[21]  Carlos A. Coello Coello,et al.  Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , 2002, Adv. Eng. Informatics.

[22]  Tapabrata Ray,et al.  Society and civilization: An optimization algorithm based on the simulation of social behavior , 2003, IEEE Trans. Evol. Comput..

[23]  M. J. D. Powell,et al.  A method for nonlinear constraints in minimization problems , 1969 .

[24]  Paul Helman,et al.  A hybrid cooperative search algorithm for constrained optimization , 2011 .

[25]  K. Deb.  An Efficient Constraint Handling Method for Genetic Algorithms , 2000 .

[26]  Efrén Mezura-Montes,et al.  Self-adaptive and Deterministic Parameter Control in Differential Evolution for Constrained Optimization , 2009 .

[27]  Efrén Mezura-Montes,et al.  Empirical analysis of a modified Artificial Bee Colony for constrained numerical optimization , 2012, Appl. Math. Comput..

[28]  P. N. Suganthan,et al.  Ensemble of Constraint Handling Techniques , 2010, IEEE Transactions on Evolutionary Computation.

[29]  S. Nash,et al.  Linear and Nonlinear Programming , 1987 .

[30]  Kalyanmoy Deb,et al.  A genetic algorithm based augmented Lagrangian method for constrained optimization , 2012, Comput. Optim. Appl..

[31]  Leandro dos Santos Coelho,et al.  Coevolutionary Particle Swarm Optimization Using Gaussian Distribution for Solving Constrained Optimization Problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[32]  Min-Jea Tahk,et al.  Coevolutionary augmented Lagrangian methods for constrained optimization , 2000, IEEE Trans. Evol. Comput..

[33]  Vinicius Veloso de Melo,et al.  Investigating Multi-View Differential Evolution for solving constrained engineering design problems , 2013, Expert Syst. Appl..

[34]  M. Fernanda P. Costa,et al.  A filter-based artificial fish swarm algorithm for constrained global optimization: theoretical and practical issues , 2014, Journal of Global Optimization.

[35]  Ashok Dhondu Belegundu,et al.  A Study of Mathematical Programming Methods for Structural Optimization , 1985 .

[36]  Sancho Salcedo-Sanz,et al.  A survey of repair methods used as constraint handling techniques in evolutionary algorithms , 2009, Comput. Sci. Rev..

[37]  K. M. Ragsdell,et al.  Optimal Design of a Class of Welded Structures Using Geometric Programming , 1976 .

[38]  H. Barbosa.  A coevolutionary genetic algorithm for constrained optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[39]  Giovanni Iacca,et al.  Continuous Parameter Pools in Ensemble Differential Evolution , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[40]  Mohammad Ebrahim Shiri,et al.  An augmented Lagrangian ant colony based method for constrained optimization , 2014, Computational Optimization and Applications.

[41]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[42]  R. Courant.  Variational methods for the solution of problems of equilibrium and vibrations , 1943 .

[43]  Ali Wagdy Mohamed,et al.  Constrained optimization based on modified differential evolution algorithm , 2012, Inf. Sci..

[44]  M. Hestenes.  Multiplier and gradient methods , 1969 .

[45]  H. Adeli,et al.  Augmented Lagrangian genetic algorithm for structural optimization , 1994 .