An efficient hybrid technique for numerical optimization and applications

The hybridization of two heuristics namely DE and PSO for constrained optimization problems.The population is broken into 3 sub-populations with inferior, mid and superior groups.DE-PSO-DE (abbreviated as DPD) is employed respectively on the above groups.DPD is tested over CEC2006 and CEC2010 test functions, engineering problems and CEC2011 Problems.The greater robustness of DPD is confirmed over the state-of-the-art algorithms. Real World Optimization Problems is one of the major concerns to show the potential and effectiveness of an optimization algorithm. In this context, a hybrid algorithm of two popular heuristics namely Differential Evolution (DE) and Particle Swarm Optimization (PSO) engaged on a 'tri-population' environment. Initially, the whole population (in increasing order of fitness) is divided into three groups - Inferior Group, Mid Group and Superior Group. DE is employed in the inferior and superior groups, whereas PSO is used in the mid-group. The proposed method is abbreviated as DPD as it uses DE-PSO-DE on a population. Two strategies namely Elitism (to retain the best obtained values so far) and Non-redundant search (to improve the solution quality) have been additionally employed in DPD cycle. Moreover, the robustness of the mutation strategies of DE have been well studied and suitable mutation strategies for both DEs (for DPD) are investigated over a set of existing 8 popular mutation strategies which results 64 variants of DPD. The top DPD is further tested through the test functions of CEC2006, CEC2010 and 5 Engineering Design Problems. Also it is used to solve CEC2011 Real World Optimization problems. An excellent efficiency of the recommended DPD is confirmed over the state-of-the-art algorithms.

[1]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[2]  Gregory W. Corder,et al.  Nonparametric Statistics for Non-Statisticians: A Step-by-Step Approach , 2009 .

[3]  Ajith Abraham,et al.  DE-PSO: A NEW HYBRID META-HEURISTIC FOR SOLVING GLOBAL OPTIMIZATION PROBLEMS , 2011 .

[4]  Kalyanmoy Deb,et al.  Optimization for Engineering Design: Algorithms and Examples , 2004 .

[5]  Carlos A. Coello Coello,et al.  A bi-population PSO with a shake-mechanism for solving constrained numerical optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[6]  Dantong Ouyang,et al.  A novel hybrid differential evolution and particle swarm optimization algorithm for unconstrained optimization , 2009, Oper. Res. Lett..

[7]  Michael N. Vrahatis,et al.  Unified Particle Swarm Optimization for Solving Constrained Engineering Optimization Problems , 2005, ICNC.

[8]  Wenjian Luo,et al.  Differential evolution with dynamic stochastic selection for constrained optimization , 2008, Inf. Sci..

[9]  Han Huang,et al.  A Particle Swarm Optimization Algorithm with Differential Evolution , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[10]  Kusum Deep,et al.  Performance improvement of real coded genetic algorithm with Quadratic Approximation based hybridisation , 2009, Int. J. Intell. Def. Support Syst..

[11]  Tim Hendtlass,et al.  A Combined Swarm Differential Evolution Algorithm for Optimization Problems , 2001, IEA/AIE.

[12]  Yong Wang,et al.  Hybridizing particle swarm optimization with differential evolution for constrained numerical and engineering optimization , 2010, Appl. Soft Comput..

[13]  Amit Konar,et al.  Particle Swarm Optimization and Differential Evolution Algorithms: Technical Analysis, Applications and Hybridization Perspectives , 2008, Advances of Computational Intelligence in Industrial Systems.

[14]  Qi Meng,et al.  A hybrid approach based on differential evolution and tissue membrane systems for solving constrained manufacturing parameter optimization problems , 2013, Appl. Soft Comput..

[15]  Anupam Yadav,et al.  An efficient co-swarm particle swarm optimization for non-linear constrained optimization , 2014, J. Comput. Sci..

[16]  Efrén Mezura-Montes,et al.  Differential evolution in constrained numerical optimization: An empirical study , 2010, Inf. Sci..

[17]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[18]  Efrén Mezura-Montes,et al.  Parameter control in Differential Evolution for constrained optimization , 2009, 2009 IEEE Congress on Evolutionary Computation.

[19]  Wenyin Gong,et al.  Differential Evolution With Ranking-Based Mutation Operators , 2013, IEEE Transactions on Cybernetics.

[20]  Tapabrata Ray,et al.  Performance of infeasibility empowered memetic algorithm for CEC 2010 constrained optimization problems , 2010, IEEE Congress on Evolutionary Computation.

[21]  Tapabrata Ray,et al.  An adaptive differential evolution algorithm and its performance on real world optimization problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[22]  Dervis Karaboga,et al.  Artificial bee colony algorithm for large-scale problems and engineering design optimization , 2012, J. Intell. Manuf..

[23]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[24]  Wei-Ping Lee,et al.  Modified the Performance of Differential Evolution Algorithm with Dual Evolution Strategy , 2009 .

[25]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[26]  Gary G. Yen,et al.  An Adaptive Penalty Formulation for Constrained Evolutionary Optimization , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[27]  Vinaya Babu,et al.  Integrated PSO and DE for Data Clustering , 2012 .

[28]  M. Batouche,et al.  Hybrid particle swarm with differential evolution for multimodal image registration , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[29]  Taher Niknam,et al.  A novel hybrid particle swarm optimization for economic dispatch with valve-point loading effects , 2011 .

[30]  A. Abraham,et al.  Simplex Differential Evolution , 2009 .

[31]  Carlos A. Coello Coello,et al.  Solving constrained optimization problems with a hybrid particle swarm optimization algorithm , 2011 .

[32]  Mitsuo Gen,et al.  A survey of penalty techniques in genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[33]  Maurice Clerc,et al.  Hybridization of Differential Evolution and Particle Swarm Optimization in a New Algorithm: DEPSO-2S , 2012, ICAISC.

[34]  Zhigang Shang,et al.  Coevolutionary Comprehensive Learning Particle Swarm Optimizer , 2010, IEEE Congress on Evolutionary Computation.

[35]  Andries Petrus Engelbrecht,et al.  Bare bones differential evolution , 2009, Eur. J. Oper. Res..

[36]  Tharam S. Dillon,et al.  Experimental study of a new hybrid PSO with mutation for economic dispatch with non-smooth cost function , 2010 .

[37]  Shengxiang Yang,et al.  Triggered Memory-Based Swarm Optimization in Dynamic Environments , 2007, EvoWorkshops.

[38]  Pascal Bouvry,et al.  Particle swarm optimization: Hybridization perspectives and experimental illustrations , 2011, Appl. Math. Comput..

[39]  Carlos A. Coello Coello,et al.  Useful Infeasible Solutions in Engineering Optimization with Evolutionary Algorithms , 2005, MICAI.

[40]  Zbigniew Michalewicz,et al.  A Survey of Constraint Handling Techniques in Evolutionary Computation Methods , 1995 .

[41]  Chin-Teng Lin,et al.  Dynamic group-based differential evolution using a self-adaptive strategy for global optimization problems , 2012, Applied Intelligence.

[42]  Mitsuo Gen,et al.  Genetic algorithms and engineering optimization , 1999 .

[43]  Á. Nemcsics,et al.  Investigation of electrochemically etched GaAs (001) surface with the help of image processing , 2009 .

[44]  Atulya K. Nagar,et al.  Hybrid differential evolution and particle swarm optimization for optimal well placement , 2013, Computational Geosciences.

[45]  Samir Sayah,et al.  A hybrid differential evolution algorithm based on particle swarm optimization for nonconvex economic dispatch problems , 2013, Appl. Soft Comput..

[46]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[47]  Ponnuthurai N. Suganthan,et al.  Ensemble differential evolution algorithm for CEC2011 problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[48]  Mohammad Reza Meybodi,et al.  CDEPSO: a bi-population hybrid approach for dynamic optimization problems , 2014, Applied Intelligence.

[49]  Quan Yang,et al.  Research on Hybrid PSODE with Triple Populations Based on Multiple Differential Evolutionary Models , 2010, 2010 International Conference on Electrical and Control Engineering.

[50]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[51]  Mitsuo Gen,et al.  Genetic Algorithms , 1999, Wiley Encyclopedia of Computer Science and Engineering.

[52]  Jing J. Liang,et al.  Problem Deflnitions and Evaluation Criteria for the CEC 2006 Special Session on Constrained Real-Parameter Optimization , 2006 .

[53]  Ganesh K. Venayagamoorthy,et al.  Evolving Digital Circuits Using Hybrid Particle Swarm Optimization and Differential Evolution , 2006, Int. J. Neural Syst..

[54]  Patrick Siarry,et al.  A multi-swarm PSO using charged particles in a partitioned search space for continuous optimization , 2012, Comput. Optim. Appl..

[55]  S. Khamsawang,et al.  Hybrid PSO-DE for solving the economic dispatch problem with generator constraints , 2010, 2010 The 2nd International Conference on Computer and Automation Engineering (ICCAE).

[56]  Ling Wang,et al.  An effective co-evolutionary particle swarm optimization for constrained engineering design problems , 2007, Eng. Appl. Artif. Intell..

[57]  Wadaed Uturbey,et al.  Performance assessment of PSO, DE and hybrid PSO–DE algorithms when applied to the dispatch of generation and demand , 2013 .

[58]  Jie Chen,et al.  Hybridizing Differential Evolution and Particle Swarm Optimization to Design Powerful Optimizers: A Review and Taxonomy , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[59]  Amit Konar,et al.  Improving particle swarm optimization with differentially perturbed velocity , 2005, GECCO '05.

[60]  Ling Wang,et al.  An effective co-evolutionary differential evolution for constrained optimization , 2007, Appl. Math. Comput..

[61]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.