A Hierarchical Sorting Swarm Optimizer for Large-Scale Optimization

Large-scale optimization is a challenging problem because it involves a large number of decision variables. In this paper, a simple but effective method, called hierarchical sorting swarm optimizer (HSSO), is proposed for large-scale optimization. As a variant of representative particle swarm optimizer (PSO), HSSO first sorts the initial particles according to their fitness values, and then partitions the sorted particles into two groups, namely, the good group corresponding to better fitness values, and the bad group with worse fitness values. The bad group is then updated by learning from the good one. After that, we take the good group as a new swarm and conduct the sorting and learning procedures. The aforementioned operations are repeated several times until only one particle left to form a hierarchical structure. In the experiments, HSSO is applied to optimize 39 benchmark test functions. The comparative results with several existing algorithms demonstrate that, despite its simplicity, HSSO shows improved performance in terms of both exploration and exploitation.

[1]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[2]  Huimin Lu,et al.  CONet: A Cognitive Ocean Network , 2019, IEEE Wireless Communications.

[3]  Huimin Lu,et al.  Motor Anomaly Detection for Unmanned Aerial Vehicles Using Reinforcement Learning , 2018, IEEE Internet of Things Journal.

[4]  Shiming Ge,et al.  Detecting Masked Faces in the Wild with LLE-CNNs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Yuan Sun,et al.  Extended Differential Grouping for Large Scale Global Optimization with Direct and Indirect Variable Interactions , 2015, GECCO.

[6]  Huimin Lu,et al.  Underwater image dehazing using joint trilateral filter , 2014, Comput. Electr. Eng..

[7]  Yaochu Jin,et al.  A multi-swarm evolutionary framework based on a feedback mechanism , 2013, 2013 IEEE Congress on Evolutionary Computation.

[8]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[9]  Shang-Jeng Tsai,et al.  Efficient Population Utilization Strategy for Particle Swarm Optimizer , 2009, IEEE Trans. Syst. Man Cybern. Part B.

[10]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[11]  James Kennedy,et al.  The particle swarm: social adaptation of knowledge , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[12]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[13]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[15]  Bernhard Sendhoff,et al.  Fitness Approximation In Evolutionary Computation - a Survey , 2002, GECCO.

[16]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[17]  R. Manivannan,et al.  TOPSIS based parametric optimization of laser micro-drilling of TBC coated nickel based superalloy , 2018, Optics & Laser Technology.

[18]  Yuhui Shi,et al.  Particle Swarm Optimization With Interswarm Interactive Learning Strategy , 2016, IEEE Transactions on Cybernetics.

[19]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[20]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[21]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[22]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[23]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[24]  Michael G. Epitropakis,et al.  Evolving cognitive and social experience in Particle Swarm Optimization through Differential Evolution: A hybrid approach , 2012, Inf. Sci..

[25]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[26]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[27]  Stephen Chen,et al.  An Analysis of Locust Swarms on Large Scale Global Optimization Problems , 2009, ACAL.

[28]  Huimin Lu,et al.  Brain Intelligence: Go beyond Artificial Intelligence , 2017, Mobile Networks and Applications.

[29]  Zhiqiang Li,et al.  Fast optimization method of designing a wideband metasurface without using the Pancharatnam-Berry phase. , 2018, Optics express.

[30]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[31]  Owen L. Astrachan,et al.  Bubble sort: an archaeological algorithmic analysis , 2003, SIGCSE.

[32]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[33]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[34]  Y. Volkan Pehlivanoglu,et al.  A New Particle Swarm Optimization Method Enhanced With a Periodic Mutation Strategy and Neural Networks , 2013, IEEE Transactions on Evolutionary Computation.

[35]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[36]  Maurice Clerc,et al.  Beyond Standard Particle Swarm Optimisation , 2010, Int. J. Swarm Intell. Res..

[37]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[38]  Shang-Jeng Tsai,et al.  Solving large scale global optimization using improved Particle Swarm Optimizer , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[39]  Shengxiang Yang,et al.  Adaptive neighborhood selection for many-objective optimization problems , 2018, Appl. Soft Comput..

[40]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[41]  Jun Zhang,et al.  A Level-Based Learning Swarm Optimizer for Large-Scale Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[42]  Jinhua Zheng,et al.  Binary search based boundary elimination selection in many-objective evolutionary optimization , 2017, Appl. Soft Comput..

[43]  Li Xing-liang.  A Sorting Algorithm Based on Selection Sort Strategy , 2007 .

[44]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[45]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[46]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..