Multiple strategies based orthogonal design particle swarm optimizer for numerical optimization

In the canonical particle swarm optimization (PSO), each particle updates its velocity and position by taking its historical best experience and its neighbors? best experience as exemplars and adding them together. Its performance is largely dependent on the employed exemplars. However, this learning strategy in the canonical PSO is inefficient when complex problems are being optimized. In this paper, Multiple Strategies based Orthogonal Design PSO (MSODPSO) is presented, in which the social-only model or the cognition-only model is utilized in each particle?s velocity update, and an orthogonal design (OD) method is used with a small probability to construct a new exemplar in each iteration. In order to enhance the efficiency of OD method and obtain more efficient exemplar, four auxiliary vector generating strategies are designed. In addition, a global best mutation operator including non-uniform mutation and Gaussian mutation is employed to improve its global search ability. The MSODPSO can be applied to PSO with the global or local structure, yielding MSODPSO-G and MSODPSO-L algorithms, respectively. To verify the effectiveness of the proposed algorithms, a set of 24 benchmark functions in 30 and 100 dimensions are utilized in experimental studies. The proposed algorithm is also tested on a real-world economic load dispatch (ELD) problem, which is modelled as a non-convex minimization problem with constraints. The experimental results on the benchmark functions and ELD problems demonstrate that the proposed MSODPSO-G and MSODPSO-L can offer high-quality solutions.

[1]  Dongyuan Shi,et al.  Enhancing the performance of biogeography-based optimization using polyphyletic migration operator and orthogonal learning , 2014, Comput. Oper. Res..

[2]  Hong-Chan Chang,et al.  Large-scale economic dispatch by genetic algorithm , 1995 .

[3]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[4]  T.O. Ting,et al.  A novel approach for unit commitment problem via an effective hybrid particle swarm optimization , 2006, IEEE Transactions on Power Systems.

[5]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[6]  Xiao-Feng Xie,et al.  DEPSO: hybrid particle swarm with differential evolution operator , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[7]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[8]  M. Pandit,et al.  Self-Organizing Hierarchical Particle Swarm Optimization for Nonconvex Economic Dispatch , 2008, IEEE Transactions on Power Systems.

[9]  Manjaree Pandit,et al.  Particle swarm optimization with time varying acceleration coefficients for non-convex economic power dispatch , 2009 .

[10]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[11]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[12]  Thomas Bäck,et al.  An Overview of Evolutionary Algorithms for Parameter Optimization , 1993, Evolutionary Computation.

[13]  P. J. Angeline,et al.  Using selection to improve particle swarm optimization , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[14]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[15]  Mohammad Mehdi Ebadzadeh,et al.  A novel particle swarm optimization algorithm with adaptive inertia weight , 2011, Appl. Soft Comput..

[16]  Arnold J. Stromberg,et al.  Number-theoretic Methods in Statistics , 1996 .

[17]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[18]  Hui Wang,et al.  A Hybrid Particle Swarm Algorithm with Cauchy Mutation , 2007, 2007 IEEE Swarm Intelligence Symposium.

[19]  Bijaya Ketan Panigrahi,et al.  Adaptive particle swarm optimization approach for static and dynamic economic load dispatch , 2008 .

[20]  Sanyang Liu,et al.  A Novel Artificial Bee Colony Algorithm Based on Modified Search Equation and Orthogonal Learning , 2013, IEEE Transactions on Cybernetics.

[21]  Francisco Herrera,et al.  Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power , 2010, Inf. Sci..

[22]  Chia-Nan Ko,et al.  An orthogonal-array-based particle swarm optimizer with nonlinear time-varying evolution , 2007, Appl. Math. Comput..

[23]  Junyan Wang,et al.  Nonlinear Inertia Weight Variation for Dynamic Adaptation in Particle Swarm Optimization , 2011, ICSI.

[24]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[25]  Yuhui Shi,et al.  Diversity control in particle swarm optimization , 2011, 2011 IEEE Symposium on Swarm Intelligence.

[26]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[27]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[28]  L. Coelho,et al.  Combining of chaotic differential evolution and quadratic programming for economic dispatch optimization with valve-point effect , 2006, IEEE Transactions on Power Systems.

[29]  R. W. Dobbins,et al.  Computational intelligence PC tools , 1996 .

[30]  James Kennedy,et al.  Defining a Standard for Particle Swarm Optimization , 2007, 2007 IEEE Swarm Intelligence Symposium.

[31]  MendesR.,et al.  The fully informed particle swarm , 2004 .

[32]  Zbigniew Michalewicz,et al.  Genetic Algorithms + Data Structures = Evolution Programs , 1992, Artificial Intelligence.

[33]  Qingfu Zhang,et al.  An orthogonal genetic algorithm for multimedia multicast routing , 1999, IEEE Trans. Evol. Comput..

[34]  Zhao Xinchao A perturbed particle swarm algorithm for numerical optimization , 2010 .

[35]  ChunXia Zhao,et al.  Particle swarm optimization with adaptive population size and its application , 2009, Appl. Soft Comput..

[36]  Mohammed El-Abd,et al.  Opposition-based artificial bee colony algorithm , 2011, GECCO '11.

[37]  Ling Wang,et al.  An effective hybrid PSO-based algorithm for flow shop scheduling with limited buffers , 2008, Comput. Oper. Res..

[38]  S. Khamsawang,et al.  DSPSO–TSA for economic dispatch problem with nonsmooth and noncontinuous cost functions , 2010 .

[39]  Tung-Kuan Liu,et al.  Hybrid Taguchi-genetic algorithm for global numerical optimization , 2004, IEEE Transactions on Evolutionary Computation.

[40]  Zwe-Lee Gaing,et al.  Particle swarm optimization to solving the economic dispatch considering the generator constraints , 2003 .

[41]  P. K. Chattopadhyay,et al.  Evolutionary programming techniques for economic load dispatch , 2003, IEEE Trans. Evol. Comput..

[42]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[43]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[45]  A. Ebenezer Jeyakumar,et al.  Hybrid PSO–SQP for economic dispatch with valve-point effect , 2004 .

[46]  Jong-Bae Park,et al.  An Improved Particle Swarm Optimization for Nonconvex Economic Dispatch Problems , 2010, IEEE Transactions on Power Systems.

[47]  Chih-Wen Liu,et al.  Non-smooth/non-convex economic dispatch by a novel hybrid differential evolution algorithm , 2007 .

[48]  Yun Shang,et al.  A Note on the Extended Rosenbrock Function , 2006 .

[49]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[50]  Z. Dong,et al.  Quantum-Inspired Particle Swarm Optimization for Valve-Point Economic Load Dispatch , 2010, IEEE Transactions on Power Systems.

[51]  Amir Hossein Gandomi,et al.  Firefly Algorithm for solving non-convex economic dispatch problems with valve loading effect , 2012, Appl. Soft Comput..

[52]  Andrew Lim,et al.  Example-based learning particle swarm optimization for continuous optimization , 2012, Information Sciences.

[53]  Zhijian Wu,et al.  Enhancing particle swarm optimization using generalized opposition-based learning , 2011, Inf. Sci..

[54]  Bin Li,et al.  Hybrid of comprehensive learning particle swarm optimization and SQP algorithm for large scale economic load dispatch optimization of power system , 2010, Science China Information Sciences.

[55]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[56]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[57]  Sishaj P. Simon,et al.  Artificial Bee Colony Algorithm for Economic Load Dispatch Problem with Non-smooth Cost Functions , 2010 .

[58]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[59]  Yuping Wang,et al.  An orthogonal genetic algorithm with quantization for global numerical optimization , 2001, IEEE Trans. Evol. Comput..

[60]  Yu Wang,et al.  Self-adaptive learning based particle swarm optimization , 2011, Inf. Sci..

[61]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[62]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[63]  Gary G. Yen,et al.  Diversity-based Information Exchange among Multiple Swarms in Particle Swarm Optimization , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[64]  Kalyan Veeramachaneni,et al.  Fitness-distance-ratio based particle swarm optimization , 2003, Proceedings of the 2003 IEEE Swarm Intelligence Symposium. SIS'03 (Cat. No.03EX706).