How important is a transfer function in discrete heuristic algorithms

Abstract Transfer functions are considered the simplest and cheapest operators in designing discrete heuristic algorithms. The main advantage of such operators is the maintenance of the structure and other continuous operators of a continuous algorithm. However, a transfer function may show different behaviour in various heuristic algorithms. This paper investigates the behaviour and importance of transfer functions in improving performance of heuristic algorithms. As case studies, two algorithms with different mechanisms of optimisation were chosen: Gravitational Search Algorithm and Particle Swarm Optimisation. Eight transfer functions were integrated in these two algorithms and compared on a set of test functions. The results show that transfer functions may show diverse behaviours and have different impacts on the performance of algorithms, which should be considered when designing a discrete algorithm. The results also demonstrate the significant role of the transfer function in terms of improved exploration and exploitation of a heuristic algorithm.

[1]  Hossein Nezamabadi-pour,et al.  BGSA: binary gravitational search algorithm , 2010, Natural Computing.

[2]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[3]  M. Janga Reddy,et al.  Multipurpose Reservoir Operation Using Particle Swarm Optimization , 2007 .

[4]  Ali Safa Sadiq,et al.  Magnetic Optimization Algorithm for training Multi Layer Perceptron , 2011, 2011 IEEE 3rd International Conference on Communication Software and Networks.

[5]  Xin-She Yang.  Test Problems in Optimization , 2010, 1008.0549.

[6]  Xin-She Yang,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010, NICSO.

[7]  Minrui Fei,et al.  A Discrete Harmony Search Algorithm , 2010 .

[8]  Zheng Tang,et al.  Hybrid Gravitational Search Algorithm with Random-key Encoding Scheme Combined with Simulated Annealing , 2011 .

[9]  Ni Qing,et al.  Survey of Particle Swarm Optimization Algorithm , 2007 .

[10]  W. Pinebrook.  The evolution of strategy. , 1990, Case studies in health administration.

[11]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[12]  Leandro dos Santos Coelho,et al.  Binary optimization using hybrid particle swarm optimization and gravitational search algorithm , 2014, Neural Computing and Applications.

[13]  Andrew Lewis,et al.  Biogeography-based optimisation with chaos , 2014, Neural Computing and Applications.

[14]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[15]  Ponnuthurai N. Suganthan,et al.  A novel hybrid discrete differential evolution algorithm for blocking flow shop scheduling problems , 2010, Comput. Oper. Res..

[16]  Andrew Lewis,et al.  Adaptive gbest-guided gravitational search algorithm , 2014, Neural Computing and Applications.

[17]  Huang Shao-rong,et al.  Survey of particle swarm optimization algorithm , 2009 .

[18]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[19]  Siti Zaiton Mohd Hashim,et al.  Training feedforward neural networks using hybrid particle swarm optimization and gravitational search algorithm , 2012, Appl. Math. Comput..

[20]  Konstantinos G. Margaritis,et al.  On benchmarking functions for genetic algorithms , 2001, Int. J. Comput. Math..

[21]  NICSO.  Nature Inspired Cooperative Strategies for Optimization (NICSO 2007) , 2008, NICSO.

[22]  Andrew Lewis,et al.  S-shaped versus V-shaped transfer functions for binary Particle Swarm Optimization , 2013, Swarm Evol. Comput..

[23]  Li-Yeh Chuang,et al.  Improved binary PSO for feature selection using gene expression data , 2008, Comput. Biol. Chem..

[24]  Y. Rahmat-Samii,et al.  Particle swarm optimization in electromagnetics , 2004, IEEE Transactions on Antennas and Propagation.

[25]  Ying Zhang,et al.  Immune Gravitation Inspired Optimization Algorithm , 2011, ICIC.

[26]  M.H. Tayarani-N,et al.  Magnetic Optimization Algorithms a new synthesis , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[27]  M. A. Khanesar,et al.  A novel binary particle swarm optimization , 2007, 2007 Mediterranean Conference on Control & Automation.

[28]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[29]  Guo-Chang Gu,et al.  Research on particle swarm optimization: a review , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[30]  Li Cheng,et al.  A New Metaheuristic Bat-Inspired Algorithm , 2010 .

[31]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[32]  Dirk Sudholt,et al.  Runtime analysis of binary PSO , 2008, GECCO '08.

[33]  Xin‐She Yang,et al.  Appendix A: Test Problems in Optimization , 2010 .

[34]  Shang He,et al.  An improved particle swarm optimizer for mechanical design optimization problems , 2004 .

[35]  Dan Boneh,et al.  On genetic algorithms , 1995, COLT '95.

[36]  Mohamed E. El-Hawary,et al.  A Survey of Particle Swarm Optimization Applications in Electric Power Systems , 2009, IEEE Transactions on Evolutionary Computation.

[37]  Saman Sinaie,et al.  SOLVING SHORTEST PATH PROBLEM USING GRAVITATIONAL SEARCH ALGORITHM AND NEURAL NETWORKS , 2010 .

[38]  Xin-She Yang,et al.  Binary bat algorithm , 2013, Neural Computing and Applications.

[39]  G. Di Caro,et al.  Ant colony optimization: a new meta-heuristic , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[40]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[41]  Siti Zaiton Mohd Hashim,et al.  BMOA: Binary Magnetic Optimization Algorithm , 2012 .

[42]  S. Mirjalili,et al.  A new hybrid PSOGSA algorithm for function optimization , 2010, 2010 International Conference on Computer and Information Application.

[43]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[44]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[45]  Sakti Prasad Ghoshal,et al.  A novel opposition-based gravitational search algorithm for combined economic and emission dispatch problems of power systems , 2012 .

[46]  Dan Simon,et al.  Biogeography-Based Optimization , 2022 .

[47]  Salwani Abdullah,et al.  Gravitational search algorithm with heuristic search for clustering problems , 2011, 2011 3rd Conference on Data Mining and Optimization (DMO).

[48]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.