A Memetic Chaotic Gravitational Search Algorithm for unconstrained global optimization problems

Abstract Metaheuristic optimization algorithms address two main tasks in the process of problem solving: i) exploration (also called diversification) and ii) exploitation (also called intensification). Guaranteeing a trade-off between these operations is critical to good performance. However, although many methods have been proposed by which metaheuristics can achieve a balance between the exploration and exploitation stages, they are still worse than exact algorithms at exploitation tasks, where gradient-based mechanisms outperform metaheuristics when a local minimum is approximated. In this paper, a quasi-Newton method is introduced into a Chaotic Gravitational Search Algorithm as an exploitation method, with the purpose of improving the exploitation capabilities of this recent and promising population-based metaheuristic. The proposed approach, referred to as a Memetic Chaotic Gravitational Search Algorithm, is used to solve forty-five benchmark problems, both synthetic and real-world, to validate the method. The numerical results show that the adding of quasi-Newton search directions to the original (Chaotic) Gravitational Search Algorithm substantially improves its performance. Also, a comparison with the state-of-the-art algorithms: Particle Swarm Optimization, Genetic Algorithm, Rcr-JADE, COBIDE and RLMPSO, shows that the proposed approach is promising for certain real-world problems.

[1]  Hedieh Sajedi,et al.  DGSA: discrete gravitational search algorithm for solving knapsack problem , 2017, Oper. Res..

[2]  Stephen J. Wright,et al.  Numerical Optimization , 2018, Fundamental Statistical Inference.

[3]  Miguel A. Vega-Rodríguez,et al.  Comparing multiobjective swarm intelligence metaheuristics for DNA motif discovery , 2013, Eng. Appl. Artif. Intell..

[4]  Hossein Nezamabadi-pour,et al.  A quantum inspired gravitational search algorithm for numerical function optimization , 2014, Inf. Sci..

[5]  Pablo Moscato,et al.  Handbook of Memetic Algorithms , 2011, Studies in Computational Intelligence.

[6]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[7]  Daniel Barbosa,et al.  Particle Swarm Optimization-based approach for parameterization of power capacitor models fed by harmonic voltages , 2017, Appl. Soft Comput..

[8]  Michel Gendreau,et al.  Handbook of Metaheuristics , 2010 .

[9]  Kay Chen Tan,et al.  A Multi-Facet Survey on Memetic Computation , 2011, IEEE Transactions on Evolutionary Computation.

[10]  Hui Li,et al.  Adaptive strategy selection in differential evolution for numerical optimization: An empirical study , 2011, Inf. Sci..

[11]  Yang Wang,et al.  Repairing the crossover rate in adaptive differential evolution , 2014, Appl. Soft Comput..

[12]  Xin-She Yang,et al.  Hybrid Metaheuristic Algorithms: Past, Present, and Future , 2015, Recent Advances in Swarm Intelligence and Evolutionary Computation.

[13]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[14]  Mohsen Khatibinia,et al.  A hybrid approach based on an improved gravitational search algorithm and orthogonal crossover for optimal shape design of concrete gravity dams , 2014, Appl. Soft Comput..

[15]  Tao Gong,et al.  Graph planarization problem optimization based on triple-valued gravitational search algorithm , 2014 .

[16]  P. Toint,et al.  A globally convergent augmented Lagrangian algorithm for optimization with general constraints and simple bounds , 1991 .

[17]  Ville Tirronen,et al.  An Enhanced Memetic Differential Evolution in Filter Design for Defect Detection in Paper Production , 2008, Evolutionary Computation.

[18]  Li Pei,et al.  Path planning of unmanned aerial vehicle based on improved gravitational search algorithm , 2012 .

[19]  Escape velocity: a new operator for gravitational search algorithm , 2017, Neural Computing and Applications.

[20]  Hossein Nezamabadi-pour,et al.  A niche GSA method with nearest neighbor scheme for multimodal optimization , 2017, Swarm Evol. Comput..

[21]  Hossein Nezamabadi-pour,et al.  Disruption: A new operator in gravitational search algorithm , 2011, Sci. Iran..

[22]  Pablo Moscato,et al.  Memetic algorithms: a short introduction , 1999 .

[23]  Donald E. Grierson,et al.  Comparison among five evolutionary-based optimization algorithms , 2005, Adv. Eng. Informatics.

[24]  M. E. El-Hawary,et al.  Optimal Distributed Generation Allocation and Sizing in Distribution Systems via Artificial Bee Colony Algorithm , 2011, IEEE Transactions on Power Delivery.

[25]  Leandro dos Santos Coelho,et al.  Binary optimization using hybrid particle swarm optimization and gravitational search algorithm , 2014, Neural Computing and Applications.

[26]  Hossein Nezamabadi-pour,et al.  A stochastic gravitational approach to feature based color image segmentation , 2013, Eng. Appl. Artif. Intell..

[27]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[28]  Christian Blum,et al.  Hybrid metaheuristics in combinatorial optimization: A survey , 2011, Appl. Soft Comput..

[29]  Long Li,et al.  Differential evolution based on covariance matrix learning and bimodal distribution parameter setting , 2014, Appl. Soft Comput..

[30]  Binjie Gu,et al.  MODIFIED GRAVITATIONAL SEARCH ALGORITHM WITH PARTICLE MEMORY ABILITY AND ITS APPLICATION , 2013 .

[31]  Xiaoming Chang,et al.  A chaotic digital secure communication based on a modified gravitational search algorithm filter , 2012, Inf. Sci..

[32]  Hossein Nezamabadi-pour,et al.  A novel hybrid algorithm of GSA with Kepler algorithm for numerical optimization , 2015, J. King Saud Univ. Comput. Inf. Sci..

[33]  Mahdi Nikusokhan,et al.  A Multi-Objective Gravitational Search Algorithm Based on Non-Dominated Sorting , 2012, Int. J. Swarm Intell. Res..

[34]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[35]  Hossein Nezamabadi-pour,et al.  Black Hole: A New Operator for Gravitational Search Algorithm , 2014, Int. J. Comput. Intell. Syst..

[36]  Alireza Rezazadeh,et al.  Artificial bee swarm optimization algorithm for parameters identification of solar cell models , 2013 .

[37]  Ali Mahani,et al.  Gravitational search algorithm with both attractive and repulsive forces , 2017, Soft Computing.

[38]  Yan Wang,et al.  Gravitational search algorithm combined with chaos for unconstrained numerical optimization , 2014, Appl. Math. Comput..

[39]  Mansour Sheikhan,et al.  Intelligent control of photovoltaic system using BPSO-GSA-optimized neural network and fuzzy-based PID for maximum power point tracking , 2015, Applied Intelligence.

[40]  Ricardo García-Ródenas,et al.  Hybrid meta-heuristic optimization algorithms for time-domain-constrained data clustering , 2014, Appl. Soft Comput..

[41]  Sakti Prasad Ghoshal,et al.  Optimal IIR filter design using Gravitational Search Algorithm with Wavelet Mutation , 2015, J. King Saud Univ. Comput. Inf. Sci..

[42]  Anupam Yadav,et al.  A Niching Co-swarm Gravitational Search Algorithm for Multi-modal Optimization , 2014, SocProS.

[43]  Hossein Nezamabadi-pour,et al.  BGSA: binary gravitational search algorithm , 2010, Natural Computing.

[44]  Hossein Nezamabadi-pour,et al.  A discrete gravitational search algorithm for solving combinatorial optimization problems , 2014, Inf. Sci..

[45]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[46]  Hossein Nezamabadi-pour,et al.  A gravitational search algorithm for multimodal optimization , 2014, Swarm Evol. Comput..

[47]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[48]  Carlos Cotta,et al.  Memetic algorithms and memetic computing optimization: A literature review , 2012, Swarm Evol. Comput..

[49]  Chee Peng Lim,et al.  A new Reinforcement Learning-based Memetic Particle Swarm Optimizer , 2016, Appl. Soft Comput..

[50]  José A. Moreno-Pérez,et al.  An ACO hybrid metaheuristic for close-open vehicle routing problems with time windows and fuzzy constraints , 2015, Appl. Soft Comput..

[51]  Marc Gravel,et al.  Scheduling continuous casting of aluminum using a multiple objective ant colony optimization metaheuristic , 2002, Eur. J. Oper. Res..

[52]  Siti Zaiton Mohd Hashim,et al.  Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm , 2012, Appl. Math. Comput..

[53]  Hossein Nezamabadi-pour,et al.  Facing the classification of binary problems with a GSA-SVM hybrid system , 2013, Math. Comput. Model..

[54]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[55]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[56]  Hossein Nezamabadi-pour,et al.  A comprehensive survey on gravitational search algorithm , 2018, Swarm Evol. Comput..

[57]  Pablo Moscato,et al.  A Gentle Introduction to Memetic Algorithms , 2003, Handbook of Metaheuristics.

[58]  Zhicheng Ji,et al.  A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints , 2014 .

[59]  Junjie Li,et al.  Rosenbrock artificial bee colony algorithm for accurate global optimization of numerical functions , 2011, Inf. Sci..

[60]  J. A. Ghani,et al.  Optimization of cutting conditions for end milling of Ti6Al4V Alloy by using a Gravitational Search Algorithm (GSA) , 2013 .

[61]  Chee Yen Leow,et al.  PSOGSA-Explore: A new hybrid metaheuristic approach for beampattern optimization in collaborative beamforming , 2015, Appl. Soft Comput..

[62]  Amir Hossein Gandomi,et al.  Chaotic gravitational constants for the gravitational search algorithm , 2017, Appl. Soft Comput..

[63]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[64]  Fu Duan,et al.  A new method for image segmentation based on BP neural network and gravitational search algorithm enhanced by cat chaotic mapping , 2015, Applied Intelligence.

[65]  Leslie Pérez Cáceres,et al.  The irace package: Iterated racing for automatic algorithm configuration , 2016 .

[66]  Yazdan Jamshidi,et al.  gsaINknn: A GSA optimized, lattice computing knn classifier , 2014, Eng. Appl. Artif. Intell..

[67]  Anupam Yadav,et al.  Constrained Optimization Using Gravitational Search Algorithm , 2013 .

[68]  Adam P. Piotrowski,et al.  Swarm Intelligence and Evolutionary Algorithms: Performance versus speed , 2017, Inf. Sci..