Opposition-based learning in the shuffled differential evolution algorithm

This paper proposes using the opposition-based learning (OBL) strategy in the shuffled differential evolution (SDE). In the SDE, population is divided into several memeplexes and each memeplex is improved by the differential evolution (DE) algorithm. The OBL by comparing the fitness of an individual to its opposite and retaining the fitter one in the population accelerates search process. The objective of this paper is to introduce new versions of the DE which, on one hand, use the partitioning and shuffling concepts of SDE to compensate for the limited amount of search moves of the original DE and, on the other hand, employ the OBL to accelerate the DE without making premature convergence. Four versions of DE algorithm are proposed based on the OBL and SDE strategies. All algorithms similarly use the opposition-based population initialization to achieve fitter initial individuals and their difference is in applying opposition-based generation jumping. Experiments on 25 benchmark functions designed for the special session on real-parameter optimization of CEC2005 and non-parametric analysis of obtained results demonstrate that the performances of the proposed algorithms are better than the SDE. The fourth version of proposed algorithm has a significant difference compared to the SDE in terms of all considered aspects. The emphasis of comparison results is to obtain some successful performances on unsolved functions for the first time, which so far have not been reported any successful runs on them. In a later part of the comparative experiments, performance comparisons of the proposed algorithm with some modern DE algorithms reported in the literature confirm a significantly better performance of our proposed algorithm, especially on high-dimensional functions.

[1]  Vitaliy Feoktistov,et al.  Differential Evolution: In Search of Solutions (Springer Optimization and Its Applications) , 2006 .

[2]  Miroljub Kljajić,et al.  Application of genetic algorithms and visual simulation in a real-case production optimization , 2008 .

[3]  Muhammad Rashid,et al.  Improved Opposition-Based PSO for Feedforward Neural Network Training , 2010, 2010 International Conference on Information Science and Applications.

[4]  Sancho Salcedo-Sanz,et al.  A comparison of memetic algorithms for the spread spectrum radar polyphase codes design problem , 2008, Eng. Appl. Artif. Intell..

[5]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[6]  Bidyadhar Subudhi,et al.  Nonlinear System Identification using Opposition Based Learning Differential Evolution and Neural Network Techniques , 2009 .

[7]  Hamid R. Tizhoosh,et al.  Applying Opposition-Based Ideas to the Ant Colony System , 2007, 2007 IEEE Swarm Intelligence Symposium.

[8]  Mario Ventresca,et al.  Simulated Annealing with Opposite Neighbors , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[9]  Vitaliy Feoktistov Differential Evolution: In Search of Solutions , 2006 .

[10]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[11]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[12]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[13]  H.R. Tizhoosh,et al.  Opposition-Based Q(λ) Algorithm , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[14]  Dimitris K. Tasoulis,et al.  A Review of Major Application Areas of Differential Evolution , 2008 .

[15]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[16]  Janez Brest,et al.  History mechanism supported differential evolution for chess evaluation function tuning , 2010, Soft Comput..

[17]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[18]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[19]  Morteza Alinia Ahandani,et al.  Three modified versions of differential evolution algorithm for continuous optimization , 2010, Soft Comput..

[20]  Shahryar Rahnamayan,et al.  Investigating in scalability of opposition-based differential evolution , 2008 .

[21]  Janez Brest,et al.  Performance comparison of self-adaptive and adaptive differential evolution algorithms , 2007, Soft Comput..

[22]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[23]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[24]  R. Balamurugan,et al.  Emission-constrained Dynamic Economic Dispatch using Opposition-based Self-adaptive Differential Evolution Algorithm , 2009 .

[25]  Mahamed G.H. Omran Using Opposition-based Learning with Particle Swarm Optimization and Barebones Differential Evolution , 2009 .

[26]  Mario Ventresca,et al.  Improving the Convergence of Backpropagation by Opposite Transfer Functions , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[27]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[28]  Hui Wang,et al.  Opposition-based particle swarm algorithm with cauchy mutation , 2007, 2007 IEEE Congress on Evolutionary Computation.

[29]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[30]  Ville Tirronen,et al.  Super-fit control adaptation in memetic differential evolution frameworks , 2009, Soft Comput..

[31]  P. K. Chattopadhyay,et al.  Solution of Economic Power Dispatch Problems Using Oppositional Biogeography-based Optimization , 2010 .

[32]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[33]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[34]  Kevin E Lansey,et al.  Optimization of Water Distribution Network Design Using the Shuffled Frog Leaping Algorithm , 2003 .

[35]  Ville Tirronen,et al.  Scale factor local search in differential evolution , 2009, Memetic Comput..

[36]  Lin Han,et al.  A Novel Opposition-Based Particle Swarm Optimization for Noisy Problems , 2007, Third International Conference on Natural Computation (ICNC 2007).

[37]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[38]  Luca Maria Gambardella,et al.  Ant colony system: a cooperative learning approach to the traveling salesman problem , 1997, IEEE Trans. Evol. Comput..

[39]  Dan Simon,et al.  Oppositional biogeography-based optimization , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[40]  Dexian Huang,et al.  Control and synchronization of chaotic systems by differential evolution algorithm , 2007 .

[41]  Jason Teo,et al.  Self-adaptive population sizing for a tune-free differential evolution , 2009, Soft Comput..

[42]  Hamid R. Tizhoosh,et al.  Opposition-Based Reinforcement Learning , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[43]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[44]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..