Potential bias when creating a differential-vector movement algorithm

Abstract Simulating natural biological processes has been used widely to create new algorithms to optimize complex problems. Hundreds of new algorithms have been proposed in this growing area of research, with many of these using differential-vector movement to generate new solutions. However, the relationship between the natural inspiration for an algorithm and its algorithmic behavior is sometimes tenuous. Unfortunately, high levels of solution quality and speed on narrowly defined benchmarks are often prioritized over general theoretical understanding. Several algorithms, including teaching–learning-based optimization, symbiotic organisms search, sine cosine algorithm, forensic-based investigation optimization, and grey wolf optimizer were examined to explore the search regions achieved by their suggested strategies. Interestingly, all of the five algorithms were found to frequently consider the origin of coordinates when generating new solutions. Accordingly, these algorithms sometimes obtained extraordinary results when applied to benchmark functions where the optimum solutions reside at the origin. The results highlight the importance of properly checking how and from which regions points are sampled when developing new metaheuristics. Furthermore, providing clear descriptions of the underlying designs of strategies and parameter settings is encouraged.

[1]  Jui-Sheng Chou,et al.  FBI inspired meta-optimization , 2020, Appl. Soft Comput..

[2]  Jing J. Liang,et al.  Performance Evaluation of Multiagent Genetic Algorithm , 2006, Natural Computing.

[3]  Hsing-Chih Tsai,et al.  Modification of the fish swarm algorithm with particle swarm optimization formulation and communication behavior , 2011, Appl. Soft Comput..

[4]  Nan Liu,et al.  The defect of the Grey Wolf optimization algorithm and its verification method , 2019, Knowl. Based Syst..

[5]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[6]  Yuhui Shi,et al.  Brain Storm Optimization Algorithm , 2011, ICSI.

[7]  Juan A. Carretero,et al.  On the convergence and origin bias of the Teaching-Learning-Based-Optimization algorithm , 2016, Appl. Soft Comput..

[8]  Hsing-Chih Tsai,et al.  Novel Bees Algorithm: Stochastic self-adaptive neighborhood , 2014, Appl. Math. Comput..

[9]  Sam Kwong,et al.  Genetic algorithms: concepts and applications [in engineering design] , 1996, IEEE Trans. Ind. Electron..

[10]  Ali Husseinzadeh Kashan,et al.  League Championship Algorithm (LCA): An algorithm for global optimization inspired by sport championships , 2014, Appl. Soft Comput..

[11]  Marco Dorigo,et al.  Ant system: optimization by a colony of cooperating agents , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Hsing-Chih Tsai,et al.  Roach infestation optimization with friendship centers , 2015, Eng. Appl. Artif. Intell..

[13]  Hsing-Chih Tsai,et al.  Confined teaching-learning-based optimization with variable search strategies for continuous optimization , 2019, Inf. Sci..

[14]  Anne Auger,et al.  Impacts of invariance in search: When CMA-ES and PSO face ill-conditioned and non-separable problems , 2011, Appl. Soft Comput..

[15]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[16]  Ole Winther,et al.  Bayesian Inference for Spatio-temporal Spike-and-Slab Priors , 2015, J. Mach. Learn. Res..

[17]  Yunfeng Xu,et al.  A Simple and Efficient Artificial Bee Colony Algorithm , 2013 .

[18]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[19]  Mohamed S. Gadala,et al.  Self-adapting control parameters in particle swarm optimization , 2019, Appl. Soft Comput..

[20]  K. Price Differential evolution vs. the functions of the 2/sup nd/ ICEO , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[21]  Hsing-Chih Tsai,et al.  Improving backtracking search algorithm with variable search strategies for continuous optimization , 2019, Appl. Soft Comput..

[22]  Hsing-Chih Tsai,et al.  Gravitational particle swarm , 2013, Appl. Math. Comput..

[23]  Akshya Swain,et al.  Efficient Feature Selection of Power Quality Events using Two Dimensional (2D) Particle Swarms , 2019, Appl. Soft Comput..

[24]  Anne Auger,et al.  COCO: Performance Assessment , 2016, ArXiv.

[25]  S. Arunachalam,et al.  Hybridizing bat algorithm with artificial bee colony for combined heat and power economic dispatch , 2018, Appl. Soft Comput..

[26]  Anne Auger,et al.  Performance evaluation of an advanced local search evolutionary algorithm , 2005, 2005 IEEE Congress on Evolutionary Computation.

[27]  Andrew Lewis,et al.  Grey Wolf Optimizer , 2014, Adv. Eng. Softw..

[28]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[29]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[30]  Anne Auger,et al.  Information-Geometric Optimization Algorithms: A Unifying Picture via Invariance Principles , 2011, J. Mach. Learn. Res..

[31]  Keqin Li,et al.  Complex network oriented artificial bee colony algorithm for global bi-objective optimization in three-echelon supply chain , 2019, Appl. Soft Comput..

[32]  Hsing-Chih Tsai,et al.  Unified particle swarm delivers high efficiency to particle swarm optimization , 2017, Appl. Soft Comput..

[33]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[34]  Nikolaus Hansen,et al.  Invariance, Self-Adaptation and Correlated Mutations and Evolution Strategies , 2000, PPSN.

[35]  Hsing-Chih Tsai,et al.  Isolated particle swarm optimization with particle migration and global best adoption , 2012 .

[36]  Zbigniew Michalewicz,et al.  Benchmarking Optimization Algorithms: An Open Source Framework for the Traveling Salesman Problem , 2014, IEEE Computational Intelligence Magazine.

[37]  Min-Yuan Cheng,et al.  Symbiotic Organisms Search: A new metaheuristic optimization algorithm , 2014 .

[38]  Seyedali Mirjalili,et al.  SCA: A Sine Cosine Algorithm for solving optimization problems , 2016, Knowl. Based Syst..

[39]  Alkin Yurtkuran,et al.  A novel artificial bee colony algorithm for the workforce scheduling and balancing problem in sub-assembly lines with limited buffers , 2018, Appl. Soft Comput..

[40]  Hsing-Chih Tsai,et al.  Artificial bee colony directive for continuous optimization , 2020, Appl. Soft Comput..

[41]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[42]  Mario Kusek,et al.  A self-optimizing mobile network: Auto-tuning the network with firefly-synchronized agents , 2012, Inf. Sci..

[43]  S. García,et al.  Comprehensive Taxonomies of Nature- and Bio-inspired Optimization: Inspiration Versus Algorithmic Behavior, Critical Analysis Recommendations , 2020, Cognitive Computation.

[44]  R. Venkata Rao,et al.  Teaching-learning-based optimization: A novel method for constrained mechanical design optimization problems , 2011, Comput. Aided Des..

[45]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[46]  Dervis Karaboga,et al.  A comprehensive survey: artificial bee colony (ABC) algorithm and applications , 2012, Artificial Intelligence Review.

[47]  Hsing-Chih Tsai,et al.  Integrating the artificial bee colony and bees algorithm to face constrained optimization problems , 2014, Inf. Sci..