RUN beyond the metaphor: An efficient optimization algorithm based on Runge Kutta method

Abstract The optimization field suffers from the metaphor-based “pseudo-novel” or “fancy” optimizers. Most of these cliche methods mimic animals' searching trends and possess a small contribution to the optimization process itself. Most of these cliche methods suffer from the locally efficient performance, biased verification methods on easy problems, and high similarity between their components' interactions. This study attempts to go beyond the traps of metaphors and introduce a novel metaphor-free population-based optimization based on the mathematical foundations and ideas of the Runge Kutta (RK) method widely well-known in mathematics. The proposed RUNge Kutta optimizer (RUN) was developed to deal with various types of optimization problems in the future. The RUN utilizes the logic of slope variations computed by the RK method as a promising and logical searching mechanism for global optimization. This search mechanism benefits from two active exploration and exploitation phases for exploring the promising regions in the feature space and constructive movement toward the global best solution. Furthermore, an enhanced solution quality (ESQ) mechanism is employed to avoid the local optimal solutions and increase convergence speed. The RUN algorithm's efficiency was evaluated by comparing with other metaheuristic algorithms in 50 mathematical test functions and four real-world engineering problems. The RUN provided very promising and competitive results, showing superior exploration and exploitation tendencies, fast convergence rate, and local optima avoidance. In optimizing the constrained engineering problems, the metaphor-free RUN demonstrated its suitable performance as well. The authors invite the community for extensive evaluations of this deep-rooted optimizer as a promising tool for real-world optimization. The source codes, supplementary materials, and guidance for the developed method will be publicly available at different hubs at and http://imanahmadianfar.com , http://aliasgharheidari.com/RUN.html , and http://mdm.wzu.edu.cn/RUN.html .

[1]  Bhim Singh,et al.  Single Sensor-Based MPPT of Partially Shaded PV System for Battery Charging by Using Cauchy and Gaussian Sine Cosine Optimization , 2017, IEEE Transactions on Energy Conversion.

[2]  Huiling Chen,et al.  Slime mould algorithm: A new method for stochastic optimization , 2020, Future Gener. Comput. Syst..

[3]  Una-May O'Reilly,et al.  Genetic Programming II: Automatic Discovery of Reusable Programs. , 1994, Artificial Life.

[4]  Yu Gu,et al.  Applying graph-based differential grouping for multiobjective large-scale optimization , 2020, Swarm Evol. Comput..

[5]  Seyed Mohammad Mirjalili,et al.  The Ant Lion Optimizer , 2015, Adv. Eng. Softw..

[6]  Giancarlo Fortino,et al.  Topology optimization against cascading failures on wireless sensor networks using a memetic algorithm , 2020, Comput. Networks.

[7]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..

[8]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[9]  R. England,et al.  Error estimates for Runge-Kutta type solutions to systems of ordinary differential equations , 1969, Comput. J..

[10]  Sen Liu,et al.  Decision making for the selection of cloud vendor: An improved approach under group decision-making with integrated weights and objective/subjective attributes , 2016, Expert Syst. Appl..

[11]  Min-Yuan Cheng,et al.  Symbiotic Organisms Search: A new metaheuristic optimization algorithm , 2014 .

[12]  Jun Wang,et al.  Critical review of data-driven decision-making in bridge operation and maintenance , 2020, Structure and Infrastructure Engineering.

[13]  Shenghua Zhou,et al.  Optimal Resource Allocation for Asynchronous Multiple Targets Tracking in Heterogeneous Radar Networks , 2020, IEEE Transactions on Signal Processing.

[14]  Zhong Wu,et al.  Consensus Modeling with Asymmetric Cost Based on Data-Driven Robust Optimization , 2020, Group Decision and Negotiation.

[15]  Joel J. P. C. Rodrigues,et al.  Multiobjective 3-D Topology Optimization of Next-Generation Wireless Data Center Network , 2020, IEEE Transactions on Industrial Informatics.

[16]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[17]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[18]  Vimal Savsani,et al.  Passing vehicle search (PVS): A novel metaheuristic algorithm , 2016 .

[19]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[20]  Carlos García-Martínez,et al.  Global and local real-coded genetic algorithms based on parent-centric crossover operators , 2008, Eur. J. Oper. Res..

[21]  Hossam Faris,et al.  Harris hawks optimization: Algorithm and applications , 2019, Future Gener. Comput. Syst..

[22]  Seyed Mohammad Mirjalili,et al.  Multi-Verse Optimizer: a nature-inspired algorithm for global optimization , 2015, Neural Computing and Applications.

[23]  Bai Yang,et al.  An adaptive differential evolution with combined strategy for global numerical optimization , 2020, Soft Comput..

[24]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[25]  Nan Liu,et al.  The defect of the Grey Wolf optimization algorithm and its verification method , 2019, Knowl. Based Syst..

[26]  Hae Chang Gea,et al.  STRUCTURAL OPTIMIZATION USING A NEW LOCAL APPROXIMATION METHOD , 1996 .

[27]  Hamed Shah-Hosseini,et al.  Problem solving by intelligent water drops , 2007, 2007 IEEE Congress on Evolutionary Computation.

[28]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[29]  Jinzhong Zhang,et al.  An improved sine cosine water wave optimization algorithm for global optimization , 2018, J. Intell. Fuzzy Syst..

[30]  Michael Adam Lones,et al.  Mitigating Metaphors: A Comprehensible Guide to Recent Nature-Inspired Algorithms , 2019, SN Computer Science.

[31]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[32]  John Holland,et al.  Adaptation in Natural and Artificial Sys-tems: An Introductory Analysis with Applications to Biology , 1975 .

[33]  Seyedali Mirjalili,et al.  Henry gas solubility optimization: A novel physics-based algorithm , 2019, Future Gener. Comput. Syst..

[34]  Li He,et al.  Life cycle assessment of greenhouse gas emissions and water-energy optimization for shale gas supply chain planning based on multi-level approach: Case study in Barnett, Marcellus, Fayetteville, and Haynesville shales , 2017 .

[35]  Zong Woo Geem,et al.  Metaheuristics in structural optimization and discussions on harmony search algorithm , 2016, Swarm Evol. Comput..

[36]  Qinyong Lin,et al.  A deep learning CNN architecture applied in smart near-infrared analysis of water pollution for agricultural irrigation resources , 2020 .

[37]  Wei Yu,et al.  A variable weight‐based hybrid approach for multi‐attribute group decision making under interval‐valued intuitionistic fuzzy sets , 2020, Int. J. Intell. Syst..

[38]  Xiangyu Wang,et al.  A novel differential search algorithm and applications for structure design , 2015, Appl. Math. Comput..

[39]  Yongfeng Li,et al.  Deep Learning: A Rapid and Efficient Route to Automatic Metasurface Design , 2019, Advanced science.

[40]  Omid Bozorg Haddad,et al.  Gradient-based optimizer: A new metaheuristic optimization algorithm , 2020, Inf. Sci..

[41]  Adil Baykasoglu,et al.  Evolutionary and population-based methods versus constructive search strategies in dynamic combinatorial optimization , 2017, Inf. Sci..

[42]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[43]  Amir Hossein Gandomi,et al.  Cuckoo search algorithm: a metaheuristic approach to solve structural optimization problems , 2011, Engineering with Computers.

[44]  C. Runge Ueber die numerische Auflösung von Differentialgleichungen , 1895 .

[45]  Tamer Ölmez,et al.  A new metaheuristic for numerical function optimization: Vortex Search algorithm , 2015, Inf. Sci..

[46]  Ravi Kumar Jatoth,et al.  Hybridizing sine cosine algorithm with differential evolution for global optimization and object tracking , 2018, Appl. Soft Comput..

[47]  Rajiv Tiwari,et al.  Multi-objective design optimisation of rolling bearings using genetic algorithms , 2007 .

[48]  Liu Yang,et al.  Fault diagnosis of gearbox based on RBF-PF and particle swarm optimization wavelet neural network , 2019, Neural Computing and Applications.

[49]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[50]  Khan Muhammad,et al.  Quantum-enhanced multiobjective large-scale optimization via parallelism , 2020, Swarm Evol. Comput..

[51]  Manuel Laguna,et al.  Tabu Search , 1997 .

[52]  Constantin F. Aliferis,et al.  The max-min hill-climbing Bayesian network structure learning algorithm , 2006, Machine Learning.

[53]  Bahram Gharabaghi,et al.  Optimizing operating rules for multi-reservoir hydropower generation systems: An adaptive hybrid differential evolution algorithm , 2020 .

[54]  Carlos A. Coello Coello,et al.  Useful Infeasible Solutions in Engineering Optimization with Evolutionary Algorithms , 2005, MICAI.

[55]  T. Stützle,et al.  Grey Wolf, Firefly and Bat Algorithms: Three Widespread Algorithms that Do Not Contain Any Novelty , 2020, ANTS Conference.

[56]  Bin Cao,et al.  Security-Aware Industrial Wireless Sensor Network Deployment Optimization , 2020, IEEE Transactions on Industrial Informatics.

[57]  Xin-She Yang,et al.  Engineering optimisation by cuckoo search , 2010, Int. J. Math. Model. Numer. Optimisation.

[58]  Rahim Ali Abbaspour,et al.  Efficient boosted grey wolf optimizers for global search and kernel extreme learning machine training , 2019, Appl. Soft Comput..

[59]  Xin-She Yang,et al.  Firefly algorithm, stochastic test functions and design optimisation , 2010, Int. J. Bio Inspired Comput..

[60]  Sen Zhang,et al.  Stochastic Fractal Search Algorithm for Template Matching with Lateral Inhibition , 2017, Sci. Program..

[61]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[62]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[63]  Huazhou Chen,et al.  A Fuzzy Optimization Strategy for the Implementation of RBF LSSVR Model in Vis–NIR Analysis of Pomelo Maturity , 2019, IEEE Transactions on Industrial Informatics.

[64]  Alexandros Tzanetos,et al.  Nature inspired optimization algorithms or simply variations of metaheuristics? , 2020, Artificial Intelligence Review.

[65]  Liu Yang,et al.  Particle Swarm Optimization Algorithm with Mutation Operator for Particle Filter Noise Reduction in Mechanical Fault Diagnosis , 2020, Int. J. Pattern Recognit. Artif. Intell..

[66]  Ardeshir Bahreininejad,et al.  Mine blast algorithm: A new population based algorithm for solving constrained engineering optimization problems , 2013, Appl. Soft Comput..

[67]  Petros Koumoutsakos,et al.  Reducing the Time Complexity of the Derandomized Evolution Strategy with Covariance Matrix Adaptation (CMA-ES) , 2003, Evolutionary Computation.

[68]  Xuehua Zhao,et al.  A balanced whale optimization algorithm for constrained engineering design problems , 2019, Applied Mathematical Modelling.

[69]  W. Kutta Beitrag zur Naherungsweisen Integration Totaler Differentialgleichungen , 1901 .

[70]  N. Siddique,et al.  Central Force Optimization , 2017 .

[71]  Adam P. Piotrowski,et al.  How novel is the "novel" black hole optimization approach? , 2014, Inf. Sci..

[72]  Hossam Faris,et al.  An enhanced associative learning-based exploratory whale optimizer for global optimization , 2019, Neural Computing and Applications.

[73]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[74]  Hossam Faris,et al.  Grasshopper optimization algorithm for multi-objective optimization problems , 2017, Applied Intelligence.

[75]  Guohua Wu,et al.  Across neighborhood search for numerical optimization , 2014, Inf. Sci..

[76]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[77]  U. P. Verma,et al.  Numerical Computational Methods , 2006 .

[78]  Jia Shi,et al.  Adaptive differential evolution with a Lagrange interpolation argument algorithm , 2019, Inf. Sci..

[79]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[80]  Houbing Song,et al.  A Many-Objective Optimization Model of Industrial Internet of Things Based on Private Blockchain , 2020, IEEE Network.

[81]  Liancun Zheng,et al.  Modeling and Analysis of Modern Fluid Problems , 2017 .

[82]  S. Salcedo-Sanz Modern meta-heuristics based on nonlinear physics processes: A review of models and design procedures , 2016 .

[83]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[84]  Witold Pedrycz,et al.  A variable reduction strategy for evolutionary algorithms handling equality constraints , 2015, Appl. Soft Comput..

[85]  Biling Zhang,et al.  Novel infrared image enhancement optimization algorithm combined with DFOCS , 2020 .

[86]  Kenneth Sörensen,et al.  Metaheuristics - the metaphor exposed , 2015, Int. Trans. Oper. Res..

[87]  Bin Cao,et al.  Hybrid Microgrid Many-Objective Sizing Optimization With Fuzzy Decision , 2020, IEEE Transactions on Fuzzy Systems.

[88]  Zhenxing Zhang,et al.  Atom search optimization and its application to solve a hydrogeologic parameter estimation problem , 2019, Knowl. Based Syst..

[89]  Iman Ahmadianfar,et al.  Developing optimal policies for reservoir systems using a multi-strategy optimization algorithm , 2019, Appl. Soft Comput..

[90]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[91]  Chunwei Zhang,et al.  Structural Damage Localization and Quantification Based on a CEEMDAN Hilbert Transform Neural Network Approach: A Model Steel Truss Bridge Case Study , 2020, Sensors.