Opposition-Based Hybrid Strategy for Particle Swarm Optimization in Noisy Environments

Particle swarm optimization (PSO) is a population-based algorithm designed to tackle various optimization problems. However, its performance deteriorates significantly when optimization problems are subjected to noise. PSO is strongly influenced by its previous best particles and global best one, which may lead to premature convergence and fall into local optima. This also holds true for various PSO variants dealing with optimization problems in noisy environments. Opposition-based learning (OBL) is well-known for its ability to increase population diversity. In this paper, we propose hybrid PSO algorithms that introduce OBL into PSO variants for improving the latter’s performance. The proposed hybrid algorithms employ probabilistic OBL for a swarm. In contrast to other integrations of PSO and OBL, we select the top fittest particles from the current swarm and its opposite swarm to improve the entire swarm’s fitness. Experiments on 20 benchmark functions subject to different levels of noise show that the proposed hybrid PSO algorithms outperform their counterpart PSO variants as well as composite differential evolution in most cases.

[1]  MengChu Zhou,et al.  Integrating Particle Swarm Optimization with Learning Automata to solve optimization problems in noisy environment , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  MengChu Zhou,et al.  A learning automata-based particle swarm optimization algorithm for noisy environment , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[3]  Wei Hu,et al.  Artificial bee colony algorithmbased parameter estimation of fractional-order chaotic system with time delay , 2017, IEEE/CAA Journal of Automatica Sinica.

[4]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[5]  Anthony Di Pietro Optimising evolutionary strategies for problems with varying noise strength , 2007 .

[6]  MengChu Zhou,et al.  Optimal Load Scheduling of Plug-In Hybrid Electric Vehicles via Weight-Aggregation Multi-Objective Evolutionary Algorithms , 2017, IEEE Transactions on Intelligent Transportation Systems.

[7]  Jing Zhang,et al.  Coevolutionary Particle Swarm Optimization Using AIS and its Application in Multiparameter Estimation of PMSM , 2013, IEEE Transactions on Cybernetics.

[8]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[9]  MengChu Zhou,et al.  Composite Particle Swarm Optimizer With Historical Memory for Function Optimization , 2015, IEEE Transactions on Cybernetics.

[10]  Ju-Jang Lee,et al.  Stochastic Opposition-Based Learning Using a Beta Distribution in Differential Evolution , 2016, IEEE Transactions on Cybernetics.

[11]  Mark Johnston,et al.  Optimal computing budget allocation in particle swarm optimization , 2013, GECCO '13.

[12]  Mengjie Zhang,et al.  Population statistics for particle swarm optimization: Resampling methods in noisy optimization problems , 2014, Swarm Evol. Comput..

[13]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Zuren Feng,et al.  A Scatter Learning Particle Swarm Optimization Algorithm for Multimodal Problems , 2014, IEEE Transactions on Cybernetics.

[15]  Jürgen Branke,et al.  Evolutionary optimization in uncertain environments-a survey , 2005, IEEE Transactions on Evolutionary Computation.

[16]  Thomas Bartz-Beielstein,et al.  Particle Swarm Optimization and Sequential Sampling in Noisy Environments , 2007, Metaheuristics.

[17]  Franco Romerio,et al.  A parametric genetic algorithm approach to assess complementary options of large scale windsolar coupling , 2017, IEEE/CAA Journal of Automatica Sinica.

[18]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[19]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[20]  Winston Khoon Guan Seah,et al.  A performance study on the effects of noise and evaporation in Particle Swarm Optimization , 2012, 2012 IEEE Congress on Evolutionary Computation.

[21]  Jun Zhang,et al.  Genetic Learning Particle Swarm Optimization , 2016, IEEE Transactions on Cybernetics.

[22]  Jürgen Branke,et al.  Integrating Techniques from Statistical Ranking into Evolutionary Algorithms , 2006, EvoWorkshops.

[23]  Hui Wang,et al.  Opposition-based particle swarm algorithm with cauchy mutation , 2007, 2007 IEEE Congress on Evolutionary Computation.

[24]  Tao Li,et al.  Bad-scenario-set robust optimization framework with two objectives for uncertain scheduling systems , 2017, IEEE/CAA Journal of Automatica Sinica.

[25]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[26]  Yongguang Yu,et al.  Artificial Bee Colony Algorithm-based Parameter Estimation of Fractional-order Chaotic System with Time Delay , 2017 .

[27]  Mark Johnston,et al.  Resampling in Particle Swarm Optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[28]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[29]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[30]  Alexander G. Loukianov,et al.  Particle Swarm Optimization for Discrete-Time Inverse Optimal Control of a Doubly Fed Induction Generator , 2013, IEEE Transactions on Cybernetics.

[31]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[32]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[33]  Konstantinos E. Parsopoulos,et al.  PARTICLE SWARM OPTIMIZER IN NOISY AND CONTINUOUSLY CHANGING ENVIRONMENTS , 2001 .

[34]  Michael N. Vrahatis,et al.  PARTICLE SWARM OPTIMIZATION FOR IMPRECISE PROBLEMS , 2002 .

[35]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[36]  Hamid R. Tizhoosh,et al.  Opposition-Based Reinforcement Learning , 2006, J. Adv. Comput. Intell. Intell. Informatics.

[37]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[38]  Mark Johnston,et al.  Population statistics for particle swarm optimization: Single-evaluation methods in noisy optimization problems , 2015, Soft Comput..

[39]  Chun-Hung Chen,et al.  Simulation Budget Allocation for Further Enhancing the Efficiency of Ordinal Optimization , 2000, Discret. Event Dyn. Syst..

[40]  Thomas E. Potok,et al.  Distributed Adaptive Particle Swarm Optimizer in Dynamic Environment , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[41]  Chrysostomos D. Stylios,et al.  Integrating particle swarm optimization with reinforcement learning in noisy problems , 2012, GECCO '12.

[42]  Mario Ventresca,et al.  Improving the Convergence of Backpropagation by Opposite Transfer Functions , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[43]  MengChu Zhou,et al.  Swarm Intelligence Approaches to Optimal Power Flow Problem With Distributed Generator Failures in Power Networks , 2013, IEEE Transactions on Automation Science and Engineering.

[44]  Junqi Zhang,et al.  Group Decision-Making Inspired Particle Swarm Optimization in Noisy Environment , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[45]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[46]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[47]  Renato A. Krohling,et al.  Bare Bones Particle Swarm Optimization With Scale Matrix Adaptation , 2014, IEEE Transactions on Cybernetics.

[48]  B. John Oommen,et al.  Continuous and discretized pursuit learning schemes: various algorithms and their comparison , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[49]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[50]  Carlos García-Martínez,et al.  Global and local real-coded genetic algorithms based on parent-centric crossover operators , 2008, Eur. J. Oper. Res..