PS-ABC: A hybrid algorithm based on particle swarm and artificial bee colony for high-dimensional optimization problems

A hybrid algorithm (PS-ABC) based on PSO and ABC is proposed.PS-ABC examines the aging degree of pbest to decide which type of search phase.Particle swarm optimization (PSO) serves as a local search phase.Onlooker and modified scout bee from the ABC serves as two global search phases.Our algorithm is effective in solving high-dimensional optimization problems. Particle swarm optimization (PSO) and artificial bee colony (ABC) are new optimization methods that have attracted increasing research interests because of its simplicity and efficiency. However, when being applied to high-dimensional optimization problems, PSO algorithm may be trapped in the local optimal because of its low global exploration efficiency; ABC algorithm has slower convergence speed in some cases because of the lack of powerful local exploitation capacity. In this paper, we propose a hybrid algorithm called PS-ABC, which combines the local search phase in PSO with two global search phases in ABC for the global optimum. In the iteration process, the algorithm examines the aging degree of pbest for each individual to decide which type of search phase (PSO phase, onlooker bee phase, and modified scout bee phase) to adopt. The proposed PS-ABC algorithm is validated on 13 high-dimensional benchmark functions from the IEEE-CEC 2014 competition problems, and it is compared with ABC, PSO, HPA, ABC-PS and OXDE algorithms. Results show that the PS-ABC algorithm is an efficient, fast converging and robust optimization method for solving high-dimensional optimization problems.

[1]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[2]  Dervis Karaboga,et al.  AN IDEA BASED ON HONEY BEE SWARM FOR NUMERICAL OPTIMIZATION , 2005 .

[3]  David J. Sheskin,et al.  Handbook of Parametric and Nonparametric Statistical Procedures , 1997 .

[4]  Shen Pei-ping,et al.  Hybrid Artificial Bee Colony Algorithm and Particle Swarm Search for Global Optimization , 2014 .

[5]  Muhammad Khurram Khan,et al.  A hybrid particle swarm optimization algorithm for high-dimensional problems , 2011, Comput. Ind. Eng..

[6]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[7]  Shih-Wei Lin,et al.  Particle swarm optimization for parameter determination and feature selection of support vector machines , 2008, Expert Syst. Appl..

[8]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[9]  Dervis Karaboga,et al.  A comparative study of Artificial Bee Colony algorithm , 2009, Appl. Math. Comput..

[10]  Victor P. Gergel.  A Global Optimization Algorithm for Multivariate Functions with Lipschitzian First Derivatives , 1997, J. Glob. Optim..

[11]  Mesut Gündüz,et al.  A recombination-based hybridization of particle swarm optimization and artificial bee colony algorithm for continuous optimization problems , 2013, Appl. Soft Comput..

[12]  B. Holland,et al.  An Improved Sequentially Rejective Bonferroni Test Procedure , 1987 .

[13]  Ajith Abraham,et al.  A novel global optimization technique for high dimensional functions , 2009 .

[14]  Tiesong Hu,et al.  An Improved Particle Swarm Optimization Algorithm , 2007, 2011 International Conference on Electronics, Communications and Control (ICECC).

[15]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[16]  Yanchun Liang,et al.  An integrated algorithm based on artificial bee colony and particle swarm optimization , 2010, 2010 Sixth International Conference on Natural Computation.

[17]  Parham Moradi,et al.  Velocity based artificial bee colony algorithm for high dimensional continuous optimization problems , 2014, Eng. Appl. Artif. Intell..

[18]  Siegfried Höfinger,et al.  Parallel Global Optimization of High-Dimensional Problems , 2002, PVM/MPI.

[19]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[20]  Suganthan.  [IEEE 1999. Congress on Evolutionary Computation-CEC99 - Washington, DC, USA (6-9 July 1999)] Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406) - Particle swarm optimiser with neighbourhood operator , 1999 .

[21]  Mohd Noor Abdullah,et al.  Global Particle Swarm Optimization for High Dimension Numerical Functions Analysis , 2014, J. Appl. Math..

[22]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[23]  Jeng-Shyang Pan,et al.  Enhanced Artificial Bee Colony Optimization , 2022 .

[24]  H. Finner.  On a Monotonicity Problem in Step-Down Multiple Test Procedures , 1993 .

[25]  Zhiyong Li,et al.  A hybrid algorithm based on particle swarm and chemical reaction optimization , 2014, Expert Syst. Appl..

[26]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[27]  Dantong Ouyang,et al.  An artificial bee colony approach for clustering , 2010, Expert Syst. Appl..

[28]  Patrick Siarry,et al.  A Continuous Genetic Algorithm Designed for the Global Optimization of Multimodal Functions , 2000, J. Heuristics.

[29]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[30]  Qingfu Zhang,et al.  Enhancing the search ability of differential evolution through orthogonal crossover , 2012, Inf. Sci..

[31]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[32]  D. Karaboga,et al.  On the performance of artificial bee colony (ABC) algorithm , 2008, Appl. Soft Comput..

[33]  F. Herrera,et al.  Hybrid crossover operators with multiple descendents for real-coded genetic algorithms: Combining neighborhood-based crossover operators , 2009 .

[34]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[35]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[36]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[37]  P. Suganthan.  Particle swarm optimiser with neighbourhood operator , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[38]  B J Fregly,et al.  Parallel global optimization with the particle swarm algorithm , 2004, International journal for numerical methods in engineering.

[39]  Hitoshi Iba,et al.  Accelerating Differential Evolution Using an Adaptive Local Search , 2008, IEEE Transactions on Evolutionary Computation.

[40]  Mohammed El-Abd,et al.  A hybrid ABC-SPSO algorithm for continuous function optimization , 2011, 2011 IEEE Symposium on Swarm Intelligence.

[41]  Sam Kwong,et al.  Gbest-guided artificial bee colony algorithm for numerical function optimization , 2010, Appl. Math. Comput..

[42]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..