An improved Simulated Annealing algorithm based on ancient metallurgy techniques

Abstract Simulated Annealing (SA) is a single-solution-based metaheuristic technique based on the annealing process in metallurgy. It is also one of the best-known metaheuristic algorithms due to its simplicity and good performance. Despite its interesting characteristics, SA suffers from several limitations such as premature convergence. On the other hand, Japanese swordsmithing refers to the manual-intensive process for producing high-quality bladed weapons from impure raw metals. During this process, Japanese smiths fold and reheat pieces of metal multiple times in order to eliminate impurities and defects. In this paper, an improved version of the SA algorithm is presented. In the new approach, a population of agents is considered. Each agent conducts a search strategy based on a modification of the SA scheme. The proposed algorithm modifies the original SA incorporating two new operators, folding and reheating, inspired by the ancient Japanese Swordsmithing technique. Under the new approach, the process of folding is conceived as a compression of the search space, while the reheating mechanism considers a reinitialization of the cooling process in the original SA scheme. With this inclusion, the new algorithm maintains the computational structure of the SA method but improving its search capacities. In order to evaluate its performance, the proposed algorithm is tested in a set of 28 benchmark functions, which include multimodal, unimodal, composite and shifted functions, and 3 real world optimization problems. The results demonstrate the high performance of the proposed method when compared to the original SA and other popular state-of-the-art algorithms.

[1]  Yuhui Shi,et al.  Metaheuristic research: a comprehensive survey , 2018, Artificial Intelligence Review.

[2]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[3]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[4]  Ibrahim Eksin,et al.  A new optimization method: Big Bang-Big Crunch , 2006, Adv. Eng. Softw..

[5]  Mitsuo Gen,et al.  Auto-tuning strategy for evolutionary algorithms: balancing between exploration and exploitation , 2008, Soft Comput..

[6]  Xin-She Yang,et al.  Firefly Algorithm, Lévy Flights and Global Optimization , 2010, SGAI Conf..

[7]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[8]  Ezra Wari,et al.  A survey on metaheuristics for optimization in food manufacturing industry , 2016, Appl. Soft Comput..

[9]  Erik Cuevas,et al.  A States of Matter Search-Based Approach for Solving the Problem of Intelligent Power Allocation in Plug-in Hybrid Electric Vehicles , 2017 .

[10]  Mohammed Azmi Al-Betar,et al.  Artificial bee colony algorithm, its variants and applications: A survey. , 2013 .

[11]  A. Kaveh,et al.  A new meta-heuristic method: Ray Optimization , 2012 .

[12]  Nikolaus Hansen,et al.  The CMA Evolution Strategy: A Tutorial , 2016, ArXiv.

[13]  Alessandro Goedtel,et al.  Metaheuristics optimization applied to PI controllers tuning of a DTC-SVM drive for three-phase induction motors , 2018, Appl. Soft Comput..

[14]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[15]  E. Sandgren,et al.  Nonlinear Integer and Discrete Programming in Mechanical Design Optimization , 1990 .

[16]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[17]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[18]  Marte A. Ramírez-Ortegón,et al.  An optimization algorithm inspired by the States of Matter that improves the balance between exploration and exploitation , 2013, Applied Intelligence.

[19]  Shu-Cherng Fang,et al.  An Electromagnetism-like Mechanism for Global Optimization , 2003, J. Glob. Optim..

[20]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[21]  José Francisco Aldana Montes,et al.  Solving molecular flexible docking problems with metaheuristics: A comparative study , 2015, Appl. Soft Comput..

[22]  Leon Kapp,et al.  The Craft of the Japanese Sword , 1987 .

[23]  Tiranee Achalakul,et al.  The best-so-far selection in Artificial Bee Colony algorithm , 2011, Appl. Soft Comput..

[24]  J. Koski Defectiveness of weighting method in multicriterion optimization of structures , 1985 .

[25]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[26]  B. Walczak,et al.  Particle swarm optimization (PSO). A tutorial , 2015 .

[27]  Halife Kodaz,et al.  Community detection from biological and social networks: A comparative analysis of metaheuristic algorithms , 2017, Appl. Soft Comput..

[28]  José A. Gámez,et al.  Using metaheuristic algorithms for parameter estimation in generalized Mallows models , 2016, Appl. Soft Comput..

[29]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[30]  Rob A. Rutenbar,et al.  Simulated annealing algorithms: an overview , 1989, IEEE Circuits and Devices Magazine.

[31]  C. Smith Book Reviews: A History of Metallography. The development of ideas on the structure of metals before 1890 , 1960 .

[32]  Seyed Mohammad Mirjalili,et al.  Moth-flame optimization algorithm: A novel nature-inspired heuristic paradigm , 2015, Knowl. Based Syst..

[33]  Erik Valdemar Cuevas Jiménez,et al.  A swarm optimization algorithm inspired in the behavior of the social-spider , 2013, Expert Syst. Appl..

[34]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[35]  B. Suman,et al.  A survey of simulated annealing as a tool for single and multiobjective optimization , 2006, J. Oper. Res. Soc..

[36]  Shi Cheng,et al.  Common Benchmark Functions for Metaheuristic Evaluation: A Review , 2017 .

[37]  Erik Valdemar Cuevas Jiménez,et al.  Parameter Estimation for Chaotic Fractional Systems by Using the Locust Search Algorithm , 2017, Computación y Sistemas.

[38]  Fernando Fausto,et al.  From ants to whales: metaheuristics for all tastes , 2019, Artificial Intelligence Review.

[39]  Christian Blum Hybrid Metaheuristics in Combinatorial Optimization: A Tutorial , 2012, TPNC.

[40]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[41]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[42]  Wilfrido Gómez-Flores,et al.  Automatic clustering using nature-inspired metaheuristics: A survey , 2016, Appl. Soft Comput..

[43]  Khalil Amine,et al.  Multiobjective Simulated Annealing: Principles and Algorithm Variants , 2019, Adv. Oper. Res..

[44]  Sam Kwong,et al.  Genetic algorithms and their applications , 1996, IEEE Signal Process. Mag..

[45]  Hojjat Adeli,et al.  Simulated Annealing, Its Variants and Engineering Applications , 2016, Int. J. Artif. Intell. Tools.

[46]  Camino R. Vela,et al.  Metaheuristics for solving a real-world electric vehicle charging scheduling problem , 2018, Appl. Soft Comput..

[47]  Tatsuo Inoue,et al.  Tatara and the Japanese sword: the science and technology , 2010 .

[48]  Alireza Askarzadeh,et al.  A novel metaheuristic method for solving constrained engineering optimization problems: Crow search algorithm , 2016 .

[49]  Erik Cuevas,et al.  An Improved Crow Search Algorithm Applied to Energy Problems , 2018 .

[50]  Andrew Lewis,et al.  The Whale Optimization Algorithm , 2016, Adv. Eng. Softw..