A Dynamic Neighborhood Learning-Based Gravitational Search Algorithm

Balancing exploration and exploitation according to evolutionary states is crucial to meta-heuristic search (M-HS) algorithms. Owing to its simplicity in theory and effectiveness in global optimization, gravitational search algorithm (GSA) has attracted increasing attention in recent years. However, the tradeoff between exploration and exploitation in GSA is achieved mainly by adjusting the size of an archive, named <inline-formula> <tex-math notation="LaTeX">$ {K_{\textrm {best}}}$ </tex-math></inline-formula>, which stores those superior agents after fitness sorting in each iteration. Since the global property of <inline-formula> <tex-math notation="LaTeX">$ {K_{\textrm {best}}}$ </tex-math></inline-formula> remains unchanged in the whole evolutionary process, GSA emphasizes exploitation over exploration and suffers from rapid loss of diversity and premature convergence. To address these problems, in this paper, we propose a dynamic neighborhood learning (DNL) strategy to replace the <inline-formula> <tex-math notation="LaTeX">$ {K_{\textrm {best}}}$ </tex-math></inline-formula> model and thereby present a DNL-based GSA (DNLGSA). The method incorporates the local and global neighborhood topologies for enhancing the exploration and obtaining adaptive balance between exploration and exploitation. The local neighborhoods are dynamically formed based on evolutionary states. To delineate the evolutionary states, two convergence criteria named limit value and population diversity, are introduced. Moreover, a mutation operator is designed for escaping from the local optima on the basis of evolutionary states. The proposed algorithm was evaluated on 27 benchmark problems with different characteristic and various difficulties. The results reveal that DNLGSA exhibits competitive performances when compared with a variety of state-of-the-art M-HS algorithms. Moreover, the incorporation of local neighborhood topology reduces the numbers of calculations of gravitational force and thus alleviates the high computational cost of GSA.

[1]  Xin-She Yang,et al.  Eagle strategy with flower algorithm , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[2]  Aizhu Zhang,et al.  Locally informed gravitational search algorithm , 2016, Knowl. Based Syst..

[3]  Pinar Civicioglu,et al.  Transforming geocentric cartesian coordinates to geodetic coordinates by using differential search algorithm , 2012, Comput. Geosci..

[4]  Oscar Castillo,et al.  A new gravitational search algorithm using fuzzy logic to parameter adaptation , 2013, 2013 IEEE Congress on Evolutionary Computation.

[5]  Siti Mariyam Hj. Shamsuddin,et al.  Non-parametric particle swarm optimization for global optimization , 2015, Appl. Soft Comput..

[6]  Binjie Gu,et al.  MODIFIED GRAVITATIONAL SEARCH ALGORITHM WITH PARTICLE MEMORY ABILITY AND ITS APPLICATION , 2013 .

[7]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[8]  Hossein Nezamabadi-pour,et al.  Disruption: A new operator in gravitational search algorithm , 2011, Sci. Iran..

[9]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[10]  Long Li,et al.  Differential evolution based on covariance matrix learning and bimodal distribution parameter setting , 2014, Appl. Soft Comput..

[11]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[12]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[13]  Hossein Nezamabadi-pour,et al.  Filter modeling using gravitational search algorithm , 2011, Eng. Appl. Artif. Intell..

[14]  Siti Mariyam Hj. Shamsuddin,et al.  CAPSO: Centripetal accelerated particle swarm optimization , 2014, Inf. Sci..

[15]  Siti Zaiton Mohd Hashim,et al.  Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm , 2012, Appl. Math. Comput..

[16]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[17]  J. Kennedy,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2003, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[19]  Wenbo Xu,et al.  Enhancing Global Search Ability of Quantum-Behaved Particle Swarm Optimization by Maintaining Diversity of the Swarm , 2006, RSCTC.

[20]  José Gabriel Ramírez-Torres,et al.  A Statistical Study of the Effects of Neighborhood Topologies in Particle Swarm Optimization , 2011 .

[21]  James Kennedy,et al.  Small worlds and mega-minds: effects of neighborhood topology on particle swarm performance , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[22]  P. N. Suganthan,et al.  A dynamic neighborhood learning based particle swarm optimizer for global numerical optimization , 2012, Inf. Sci..

[23]  Andrew Lewis,et al.  Autonomous Particles Groups for Particle Swarm Optimization , 2014 .

[24]  Yong Wang,et al.  Heterogeneous Redundancy Allocation for Series-Parallel Multi-State Systems Using Hybrid Particle Swarm Optimization and Local Search , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[26]  Hossein Nezamabadi-pour,et al.  Black Hole: A New Operator for Gravitational Search Algorithm , 2014, Int. J. Comput. Intell. Syst..

[27]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[28]  S. Mirjalili,et al.  A new hybrid PSOGSA algorithm for function optimization , 2010, 2010 International Conference on Computer and Information Application.

[29]  Stefan Preitl,et al.  Adaptive GSA-Based Optimal Tuning of PI Controlled Servo Systems With Reduced Process Parametric Sensitivity, Robust Stability and Controller Robustness , 2014, IEEE Transactions on Cybernetics.

[30]  Minghao Yin,et al.  Hybrid differential evolution and gravitation search algorithm for unconstrained optimization , 2011 .

[31]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[32]  Yan Wang,et al.  Convergence analysis and performance of an improved gravitational search algorithm , 2014, Appl. Soft Comput..

[33]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[34]  Pinar Çivicioglu,et al.  Artificial cooperative search algorithm for numerical optimization problems , 2013, Inf. Sci..

[35]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[36]  P. Suganthan Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[37]  Pinar Çivicioglu,et al.  Backtracking Search Optimization Algorithm for numerical optimization problems , 2013, Appl. Math. Comput..

[38]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[39]  Nikolaus Hansen,et al.  Completely Derandomized Self-Adaptation in Evolution Strategies , 2001, Evolutionary Computation.

[40]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[41]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[42]  Sakti Prasad Ghoshal,et al.  A novel opposition-based gravitational search algorithm for combined economic and emission dispatch problems of power systems , 2012 .

[43]  Aizhu Zhang,et al.  A Hybrid Genetic Algorithm and Gravitational Search Algorithm for Global Optimization , 2015 .

[44]  Angel Eduardo Muñoz Zavala,et al.  A Comparison Study of PSO Neighborhoods , 2012, EVOLVE.

[45]  Wenyin Gong,et al.  DE/BBO: a hybrid differential evolution with biogeography-based optimization for global numerical optimization , 2010, Soft Comput..

[46]  Jun Zhang,et al.  Genetic Learning Particle Swarm Optimization , 2016, IEEE Transactions on Cybernetics.

[47]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[48]  E. Rashedi,et al.  Fuzzy gravitational search algorithm , 2012, 2012 2nd International eConference on Computer and Knowledge Engineering (ICCKE).

[49]  Meie Shen,et al.  Differential Evolution With Two-Level Parameter Adaptation , 2014, IEEE Transactions on Cybernetics.