Analysis and improvement of GSA's optimization process

Abstract Gravitational search algorithm (GSA) is one of the heuristic algorithms proposed in recent years, which is inspired by the law of universal gravitation between masses. However, many practical applications and researches show that when the region affected by global optimum occupies less search space, GSA is prone to fall into local optimum, especially when the optimal value is close to the boundary of the search space and there are sub-optimal solutions in the center of the space. By microscopic analysis of the particle motion process of GSA in the above optimization situation, we find that the Kbest mechanism and the characteristic of central convergence are the two main factors affecting the GSA optimization performance. In this paper, an improved algorithm called Balanced Gravitational Search Algorithm is proposed, in which the balance operator is designed to solve two inherent problems in GSA. Then the proposed method is firstly tested on 10 benchmark functions provided by CEC 2020 compared with the state-of-the-art variant algorithms of the GSA and other typical meta-heuristics. Further, the algorithms are tested and compared on the real-world optimization problems including CEC 2011 real-world optimization problems and the Multi-Layer Neural Network (MLNN) training problem based on wine dataset. The simulation results show that BGSA can significantly improve the optimization performance of GSA and it can be a good choice for solving real-world optimization problems.

[1]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[2]  Venkata Reddy Kota,et al.  Optimal setting of FACTS devices for voltage stability improvement using PSO adaptive GSA hybrid algorithm , 2016 .

[3]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[4]  Hang Yu,et al.  Self-Adaptive Gravitational Search Algorithm With a Modified Chaotic Local Search , 2017, IEEE Access.

[5]  Seyed Jalaleddin Mousavirad,et al.  A benchmark of recent population-based metaheuristic algorithms for multi-layer neural network training , 2020, GECCO Companion.

[6]  Zexuan Zhu,et al.  A novel differential evolution algorithm with a self-adaptation parameter control method by differential evolution , 2018, Soft Comput..

[7]  Cheng Tang,et al.  A Self-adaptive Mechanism Embedded Gravitational Search Algorithm , 2019, 2019 12th International Symposium on Computational Intelligence and Design (ISCID).

[8]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[9]  Liang Ma,et al.  Improved gravitational search algorithm based on free search differential evolution , 2013 .

[10]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[11]  Dinesh Grover,et al.  GA GSA-based Energy Efficient Pegasis Protocol for WSN , 2018 .

[12]  Zhaolu Guo,et al.  Improved gravitational search algorithm with crossover , 2017, Comput. Electr. Eng..

[13]  Minghao Yin,et al.  Hybrid differential evolution and gravitation search algorithm for unconstrained optimization , 2011 .

[14]  S. Mirjalili,et al.  A new hybrid PSOGSA algorithm for function optimization , 2010, 2010 International Conference on Computer and Information Application.

[15]  Hossein Nezamabadi-pour,et al.  Black Hole: A New Operator for Gravitational Search Algorithm , 2014, Int. J. Comput. Intell. Syst..

[16]  Chunguo Wu,et al.  Surprisingly Popular Algorithm-Based Comprehensive Adaptive Topology Learning PSO , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[17]  Omid Bozorg Haddad,et al.  Gradient-based optimizer: A new metaheuristic optimization algorithm , 2020, Inf. Sci..

[18]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[19]  Mansour Sheikhan,et al.  Intelligent control of photovoltaic system using BPSO-GSA-optimized neural network and fuzzy-based PID for maximum power point tracking , 2015, Applied Intelligence.

[20]  Rabindra Kumar Sahu,et al.  A novel hybrid many optimizing liaisons gravitational search algorithm approach for AGC of power systems , 2019, Automatika.

[21]  Dexuan Zou,et al.  A Simplified and Efficient Gravitational Search Algorithm for Unconstrained Optimization Problems , 2017, 2017 International Conference on Vision, Image and Signal Processing (ICVISP).

[22]  Escape velocity: a new operator for gravitational search algorithm , 2017, Neural Computing and Applications.

[23]  M. Friedman A Comparison of Alternative Tests of Significance for the Problem of $m$ Rankings , 1940 .

[24]  Tansel Dökeroglu,et al.  A survey on new generation metaheuristic algorithms , 2019, Comput. Ind. Eng..

[25]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[26]  Hossein Nezamabadi-pour,et al.  Disruption: A new operator in gravitational search algorithm , 2011, Sci. Iran..

[27]  Zheng Zhao,et al.  A particle swarm optimization algorithm with random learning mechanism and Levy flight for optimization of atomic clusters , 2017, Comput. Phys. Commun..

[28]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[29]  Avishai Sintov,et al.  Manifold learning for efficient gravitational search algorithm , 2020, Inf. Sci..

[30]  Amir Hossein Alavi,et al.  Krill herd: A new bio-inspired optimization algorithm , 2012 .

[31]  Ruhul A. Sarker,et al.  GA with a new multi-parent crossover for solving IEEE-CEC2011 competition problems , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[32]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[33]  Xueli An,et al.  A chaos embedded GSA-SVM hybrid system for classification , 2014, Neural Computing and Applications.

[34]  M. Friedman The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[35]  Azlan Mohd Zain,et al.  Levy Flight Algorithm for Optimization Problems - A Literature Review , 2013, ICIT 2013.

[36]  Seyedali Mirjalili,et al.  Evaluating PSO and MOPSO Equipped with Evolutionary Population Dynamics , 2020 .

[37]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[38]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[39]  Imtiaz Ahmed Choudhury,et al.  Application of Taguchi method in the optimization of end milling parameters , 2004 .

[40]  Harun Uğuz,et al.  A novel particle swarm optimization algorithm with Levy flight , 2014, Appl. Soft Comput..

[41]  Fevrier Valdez,et al.  Fuzzy logic in the gravitational search algorithm for the optimization of modular neural networks in pattern recognition , 2015, Expert Syst. Appl..

[42]  Ping Chen,et al.  An improved gravitational search algorithm for green partner selection in virtual enterprises , 2016, Neurocomputing.

[43]  John H. Holland,et al.  Genetic Algorithms and the Optimal Allocation of Trials , 1973, SIAM J. Comput..

[44]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[45]  Jiujun Cheng,et al.  An aggregative learning gravitational search algorithm with self-adaptive gravitational constants , 2020, Expert Syst. Appl..

[46]  Yi Zhang,et al.  A hybrid algorithm based on self-adaptive gravitational search algorithm and differential evolution , 2018, Expert Syst. Appl..

[47]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[48]  Jamol Pender The truncated normal distribution: Applications to queues with impatient customers , 2015, Oper. Res. Lett..

[49]  Amir Hossein Gandomi,et al.  Chaotic gravitational constants for the gravitational search algorithm , 2017, Appl. Soft Comput..

[50]  K. V. Arya,et al.  An effective gbest-guided gravitational search algorithm for real-parameter optimization and its application in training of feedforward neural networks , 2017, Knowl. Based Syst..

[51]  Hossein Nezamabadi-pour,et al.  A quantum inspired gravitational search algorithm for numerical function optimization , 2014, Inf. Sci..

[52]  Julie Z. Zhang,et al.  Surface roughness optimization in an end-milling operation using the Taguchi design method , 2007 .

[53]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .