Improving backtracking search algorithm with variable search strategies for continuous optimization

Abstract The backtracking search algorithm (BSA), a relatively new evolutionary algorithm (EA), has been shown to be a competitive alternative to other population-based algorithms. To effectively solve a variety of optimization problems, this paper suggests ten mutation strategies and compares the performance of selection mechanisms in employing these strategies. Moreover, following the original BSA design, new parameters of historical mean and best positions are proposed in order to implement several additional mutation strategies. In addition, as recommended in the literature, a one-dimensional crossover scheme is enacted for greedy strategies in order to prevent premature convergence. Furthermore, three settings for search factors of mutation strategies are proposed. As a result, improved BSA versions that employed, respectively, ten and four mutation strategies were found to significantly facilitate the ability of BSA to handle optimization tasks of different characteristics. The experimental results show that the proposed versions outperformed the basic BSA in terms of achieving high convergence speed in the early stage, reaching the convergence precision and plateau with better scores, and performing perfectly on tests of composition functions. In addition, the improved BSA versions outperformed five popular, nature-inspired algorithms in terms of achieving the best convergence precision and performing perfectly on six composition functions.

[1]  Hsing-Chih Tsai,et al.  Isolated particle swarm optimization with particle migration and global best adoption , 2012 .

[2]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[3]  Michael N. Vrahatis,et al.  Unified Particle Swarm Optimization in Dynamic Environments , 2005, EvoWorkshops.

[4]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[5]  Mostafa Modiri-Delshad,et al.  Backtracking search algorithm for solving economic dispatch problems with valve-point effects and multiple fuel options , 2016 .

[6]  Renquan Lu,et al.  Learning backtracking search optimisation algorithm and its application , 2017, Inf. Sci..

[7]  Hong Liu,et al.  Particle swarm optimization based on dynamic niche technology with applications to conceptual design , 2007, Adv. Eng. Softw..

[8]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[9]  Ibrahim Berkan Aydilek A hybrid firefly and particle swarm optimization algorithm for computationally expensive numerical problems , 2018, Appl. Soft Comput..

[10]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[11]  Jianhua Wu,et al.  A modified differential evolution algorithm for unconstrained optimization problems , 2013, Neurocomputing.

[12]  Laizhong Cui,et al.  An enhanced artificial bee colony algorithm with dual-population framework , 2018, Swarm Evol. Comput..

[13]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[14]  Mesut Gündüz,et al.  Artificial bee colony algorithm with variable search strategy for continuous optimization , 2015, Inf. Sci..

[15]  Sam Kwong,et al.  Gbest-guided artificial bee colony algorithm for numerical function optimization , 2010, Appl. Math. Comput..

[16]  Graham Kendall,et al.  Optimization of fed-batch fermentation processes using the Backtracking Search Algorithm , 2018, Expert Syst. Appl..

[17]  Warren Hare,et al.  Best practices for comparing optimization algorithms , 2017, Optimization and Engineering.

[18]  Hsing-Chih Tsai,et al.  Novel Bees Algorithm: Stochastic self-adaptive neighborhood , 2014, Appl. Math. Comput..

[19]  Hsing-Chih Tsai,et al.  Unified particle swarm delivers high efficiency to particle swarm optimization , 2017, Appl. Soft Comput..

[20]  Mario Kusek,et al.  A self-optimizing mobile network: Auto-tuning the network with firefly-synchronized agents , 2012, Inf. Sci..

[21]  Pupong Pongcharoen,et al.  A tool for solving stochastic dynamic facility layout problems with stochastic demand using either a Genetic Algorithm or modified Backtracking Search Algorithm , 2017 .

[22]  Ville Tirronen,et al.  Recent advances in differential evolution: a survey and experimental analysis , 2010, Artificial Intelligence Review.

[23]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[24]  Jing J. Liang,et al.  Novel composition test functions for numerical global optimization , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[25]  Lingling Huang,et al.  A global best artificial bee colony algorithm for global optimization , 2012, J. Comput. Appl. Math..

[26]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[27]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[28]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[29]  Liang Gao,et al.  Backtracking Search Algorithm with three constraint handling methods for constrained optimization problems , 2015, Expert Syst. Appl..

[30]  Tiranee Achalakul,et al.  The best-so-far selection in Artificial Bee Colony algorithm , 2011, Appl. Soft Comput..

[31]  Helbert E. Espitia,et al.  Statistical analysis for vortex particle swarm optimization , 2018, Appl. Soft Comput..

[32]  Zhijian Wu,et al.  Multi-strategy ensemble artificial bee colony algorithm , 2014, Inf. Sci..

[33]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[34]  Hsing-Chih Tsai,et al.  Predicting strengths of concrete-type specimens using hybrid multilayer perceptrons with center-unified particle swarm optimization , 2010, Expert Syst. Appl..

[35]  Yunfeng Xu,et al.  A Simple and Efficient Artificial Bee Colony Algorithm , 2013 .

[36]  Yilong Yin,et al.  A Hybrid Backtracking Search Optimization Algorithm with Differential Evolution , 2015 .

[37]  Hsing-Chih Tsai,et al.  Modification of the fish swarm algorithm with particle swarm optimization formulation and communication behavior , 2011, Appl. Soft Comput..

[38]  Vasan Arunachalam,et al.  Optimization Using Differential Evolution , 2008 .

[39]  Honglun Wang,et al.  A hybrid backtracking search optimization algorithm for nonlinear optimal control problems with complex dynamic constraints , 2016, Neurocomputing.

[40]  Arun Kumar Singh,et al.  Comparable investigation of backtracking search algorithm in automatic generation control for two area reheat interconnected thermal power system , 2017, Appl. Soft Comput..

[41]  Hsing-Chih Tsai,et al.  Integrating the artificial bee colony and bees algorithm to face constrained optimization problems , 2014, Inf. Sci..

[42]  Masao Fukushima,et al.  Evolution Strategies Learned with Automatic Termination Criteria , 2006 .

[43]  Xueqiang Zhang,et al.  Backtracking search algorithm for effective and efficient surface wave analysis , 2015 .

[44]  Boubaker Daachi,et al.  On the robust PID adaptive controller for exoskeletons: A particle swarm optimization based approach , 2017, Appl. Soft Comput..

[45]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[46]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[47]  Hsing-Chih Tsai,et al.  Roach infestation optimization with friendship centers , 2015, Eng. Appl. Artif. Intell..

[48]  Jian Lin,et al.  Oppositional backtracking search optimization algorithm for parameter identification of hyperchaotic systems , 2015 .

[49]  Pinar Çivicioglu,et al.  Backtracking Search Optimization Algorithm for numerical optimization problems , 2013, Appl. Math. Comput..

[50]  Hsing-Chih Tsai,et al.  Gravitational particle swarm , 2013, Appl. Math. Comput..

[51]  Abdolreza Hatamlou,et al.  An efficient hybrid clustering method based on improved cuckoo optimization and modified particle swarm optimization algorithms , 2018, Appl. Soft Comput..

[52]  A. Kai Qin,et al.  Self-adaptive differential evolution algorithm for numerical optimization , 2005, 2005 IEEE Congress on Evolutionary Computation.

[53]  Azah Mohamed,et al.  Real time optimal schedule controller for home energy management system using new binary backtracking search algorithm , 2017 .