Stochastic Opposition-Based Learning Using a Beta Distribution in Differential Evolution

Since it first appeared, differential evolution (DE), one of the most successful evolutionary algorithms, has been studied by many researchers. Theoretical and empirical studies of the parameters and strategies have been conducted, and numerous variants have been proposed. Opposition-based DE (ODE), one of such variants, combines DE with opposition-based learning (OBL) to obtain a high-quality solution with low-computational effort. In this paper, we propose a novel OBL using a beta distribution with partial dimensional change and selection switching and combine it with DE to enhance the convergence speed and searchability. Our proposed algorithm is tested on various test functions and compared with standard DE and other ODE variants. The results indicate that the proposed algorithm outperforms the comparison group, especially in terms of solution accuracy.

[1]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[2]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[3]  Jinglei Guo,et al.  A Fast Opposition-Based Differential Evolution with Cauchy Mutation , 2012, 2012 Third Global Congress on Intelligent Systems.

[4]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[5]  Darren Robinson,et al.  A hybrid CMA-ES and HDE optimisation algorithm with application to solar energy potential , 2009, Appl. Soft Comput..

[6]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[7]  Shahryar Rahnamayan,et al.  Opposition versus randomness in soft computing techniques , 2008, Appl. Soft Comput..

[8]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[9]  Shahryar Rahnamayan,et al.  Opposition-based Differential Evolution with protective generation jumping , 2011, 2011 IEEE Symposium on Differential Evolution (SDE).

[10]  Hui Zhang,et al.  Image segmentation using evolutionary computation , 1999, IEEE Trans. Evol. Comput..

[11]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[12]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[13]  Dejun Mu,et al.  A Hybrid Differential Evolution for Numerical Optimization , 2009, 2009 2nd International Conference on Biomedical Engineering and Informatics.

[14]  Francisco Herrera,et al.  IPADE: Iterative Prototype Adjustment for Nearest Neighbor Classification , 2010, IEEE Transactions on Neural Networks.

[15]  Daniela Zaharie,et al.  Influence of crossover on the behavior of Differential Evolution Algorithms , 2009, Appl. Soft Comput..

[16]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[17]  Morteza Alinia Ahandani,et al.  Opposition-based learning in the shuffled differential evolution algorithm , 2012, Soft Comput..

[18]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[19]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[20]  Giovanni Iacca,et al.  Opposition-Based Learning in Compact Differential Evolution , 2011, EvoApplications.

[21]  Zhijian Wu,et al.  Elite Opposition-Based Differential Evolution for Solving Large-Scale Optimization Problems and Its Implementation on GPU , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[22]  Carlos A. Coello Coello,et al.  A comparative study of differential evolution variants for global optimization , 2006, GECCO.

[23]  Amir Hossein Gandomi,et al.  Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems , 2011, Engineering with Computers.

[24]  Kwong-Sak Leung,et al.  A Memetic Algorithm for Multiple-Drug Cancer Chemotherapy Schedule Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[26]  Qingzheng Xu,et al.  Influence of Jumping Rate on Opposition-based Differential Evolution Using the Current Optimum , 2013 .

[27]  Li Zhao,et al.  A review of opposition-based learning from 2005 to 2012 , 2014, Eng. Appl. Artif. Intell..

[28]  Sushil J. Louis,et al.  Playing to learn: case-injected genetic algorithms for learning to play computer games , 2005, IEEE Transactions on Evolutionary Computation.

[29]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[30]  Janez Brest,et al.  Population size reduction for the differential evolution algorithm , 2008, Applied Intelligence.

[31]  Kimon P. Valavanis,et al.  Evolutionary algorithm based offline/online path planner for UAV navigation , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[32]  Kwong-Sak Leung,et al.  Memetic Algorithms for De Novo Motif Discovery , 2012, IEEE Transactions on Evolutionary Computation.

[33]  Jianghua Li.  A Hybrid Differential Evolution Algorithm with Opposition-based Learning , 2012, 2012 4th International Conference on Intelligent Human-Machine Systems and Cybernetics.

[34]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[35]  D. Rajan.  Probability, Random Variables, and Stochastic Processes , 2017 .

[36]  Xiaoyan Sun,et al.  A New Surrogate-Assisted Interactive Genetic Algorithm With Weighted Semisupervised Learning , 2013, IEEE Transactions on Cybernetics.

[37]  M. Narasimha Murty,et al.  Genetic K-means algorithm , 1999, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Ivan Zelinka,et al.  ON STAGNATION OF THE DIFFERENTIAL EVOLUTION ALGORITHM , 2000 .

[39]  Ju-Jang Lee,et al.  An efficient differential evolution using speeded-up k-nearest neighbor estimator , 2014, Soft Comput..

[40]  María José del Jesús,et al.  KEEL: a software tool to assess evolutionary algorithms for data mining problems , 2008, Soft Comput..

[41]  D. Zaharie.  Statistical Properties of Differential Evolution and Related Random Search Algorithms , 2008 .

[42]  Abdullah Al Mamun,et al.  Balancing exploration and exploitation with adaptive variation for evolutionary multi-objective optimization , 2009, Eur. J. Oper. Res..

[43]  Ferrante Neri,et al.  Memetic Compact Differential Evolution for Cartesian Robot Control , 2010, IEEE Computational Intelligence Magazine.

[44]  Shahryar Rahnamayan,et al.  Quasi-oppositional Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[45]  Kay Chen Tan,et al.  Multimodal Optimization Using a Biobjective Differential Evolution Algorithm Enhanced With Mean Distance-Based Selection , 2013, IEEE Transactions on Evolutionary Computation.

[46]  Mark Johnston,et al.  Low-Level Feature Extraction for Edge Detection Using Genetic Programming , 2014, IEEE Transactions on Cybernetics.

[47]  Dan Simon,et al.  Oppositional biogeography-based optimization , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[48]  Kay Chen Tan,et al.  Adaptive Memetic Computing for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Cybernetics.

[49]  Marjan Mernik,et al.  Entropy-Driven Parameter Control for Evolutionary Algorithms , 2007, Informatica.

[50]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[51]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[52]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.

[53]  Zhijian Wu,et al.  Parallel differential evolution with self-adapting control parameters and generalized opposition-based learning for solving high-dimensional optimization problems , 2013, J. Parallel Distributed Comput..

[54]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[55]  Anyong Qing.  A study on base vector for differential evolution , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[56]  T. Back.  Selective pressure in evolutionary algorithms: a characterization of selection mechanisms , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[57]  Shahryar Rahnamayan,et al.  Enhanced Differential Evolution using center-based sampling , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[58]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[59]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution (ODE) with Variable Jumping Rate , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[60]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[61]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[62]  Ajith Abraham,et al.  On stability and convergence of the population-dynamics in differential evolution , 2009, AI Commun..

[63]  Francisco Herrera,et al.  Replacement strategies to preserve useful diversity in steady-state genetic algorithms , 2008, Inf. Sci..

[64]  Swagatam Das,et al.  An Improved Parent-Centric Mutation With Normalized Neighborhoods for Inducing Niching Behavior in Differential Evolution , 2014, IEEE Transactions on Cybernetics.

[65]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.