A new hybrid algorithm for continuous optimization problem

Abstract This paper applies a new hybrid method by a combination of three population base algorithms such as Genetic Algorithm (GA), Particle Swarm Optimization (PSO) and Symbiotic Organisms Search (SOS). The proposed method has been inspired from natural selection process and it completes this process in GA by using the PSO and SOS. It tends to minimize the execution time and in addition to reduce the complexity. Symbiotic organisms search is a robust and powerful metaheuristic algorithm which has attracted increasing attention in recent decades. There are three alternative phases in the proposed algorithm: GA, which develops and selects best population for the next phases, PSO, which gets experiences for each appropriate solution and updates them as well and SOS, which benefits from previous phases and performs symbiotic interaction update phases in the real-world population. The proposed algorithm was tested on the set of best known unimodal and multimodal benchmark functions in various dimensions. It has further been evaluated in, the experiment on the clustering of benchmark datasets. The obtained results from basic and non-parametric statistical tests confirmed that this hybrid method dominates in terms of convergence, execution time, success rate. It optimizes the high dimensional and complex functions Rosenbrock and Griewank up to 10 − 330 accuracy in less than 3 s, out-performing other known algorithms. It had also applied clustering datasets with minimum intra-cluster distance and error rate.

[1]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[2]  Ajith Abraham,et al.  Intelligent Systems - A Modern Approach , 2011, Intelligent Systems Reference Library.

[3]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[4]  Rui Mendes,et al.  Neighborhood topologies in fully informed and best-of-neighborhood particle swarms , 2006 .

[5]  Serhat Duman,et al.  Symbiotic organisms search algorithm for optimal power flow problem based on valve-point effect and prohibited zones , 2017, Neural Computing and Applications.

[6]  Ali Kaveh,et al.  Ray optimization for size and shape optimization of truss structures , 2013 .

[7]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Hamid Salimi,et al.  Stochastic Fractal Search: A powerful metaheuristic algorithm , 2015, Knowl. Based Syst..

[9]  Ahmad Bagheri,et al.  HEPSO: High exploration particle swarm optimization , 2014, Inf. Sci..

[10]  Vivek K. Patel,et al.  Adaptive symbiotic organisms search (SOS) algorithm for structural design optimization , 2016, J. Comput. Des. Eng..

[11]  Erwie Zahara,et al.  A hybrid genetic algorithm and particle swarm optimization for multimodal functions , 2008, Appl. Soft Comput..

[12]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[13]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Ardeshir Bahreininejad,et al.  Mine blast algorithm for optimization of truss structures with discrete variables , 2012 .

[15]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[16]  A. Kaveh,et al.  A novel heuristic optimization method: charged system search , 2010 .

[17]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[18]  Min-Yuan Cheng,et al.  A novel Multiple Objective Symbiotic Organisms Search (MOSOS) for time-cost-labor utilization tradeoff problem , 2016, Knowl. Based Syst..

[19]  Dervis Karaboga,et al.  A powerful and efficient algorithm for numerical function optimization: artificial bee colony (ABC) algorithm , 2007, J. Glob. Optim..

[20]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[21]  Min-Yuan Cheng,et al.  SOS optimization model for bridge life cycle risk evaluation and maintenance strategies , 2014 .

[22]  Xin-She Yang,et al.  Firefly Algorithms for Multimodal Optimization , 2009, SAGA.

[23]  Vassilios G. Agelidis,et al.  Optimal scheduling of renewable micro-grids considering plug-in hybrid electric vehicle charging demand , 2016 .

[24]  Zong Woo Geem,et al.  A New Heuristic Optimization Algorithm: Harmony Search , 2001, Simul..

[25]  Dinu Calin Secui,et al.  A modified Symbiotic Organisms Search algorithm for large scale economic dispatch problem with valve-point effects , 2016 .

[26]  Salwani Abdullah,et al.  Application of Gravitational Search Algorithm on Data Clustering , 2011, RSKT.

[27]  Kok Lay Teo,et al.  A hybrid approach to constrained global optimization , 2016, Appl. Soft Comput..

[28]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms: Second Edition , 2010 .

[29]  Christian Blum,et al.  Hybrid Metaheuristics: An Introduction , 2008, Hybrid Metaheuristics.

[30]  Ibrahim Eksin,et al.  A new optimization method: Big Bang-Big Crunch , 2006, Adv. Eng. Softw..

[31]  Taher Niknam,et al.  An efficient hybrid approach based on PSO, ACO and k-means for cluster analysis , 2010, Appl. Soft Comput..

[32]  Hamid Mirvaziri,et al.  A new algorithm for data clustering based on gravitational search algorithm and genetic operators , 2015, 2015 The International Symposium on Artificial Intelligence and Signal Processing (AISP).

[33]  Thomas Stützle,et al.  Ant Colony Optimization , 2009, EMO.

[34]  Tamer Ölmez,et al.  A new metaheuristic for numerical function optimization: Vortex Search algorithm , 2015, Inf. Sci..

[35]  Mesut Gündüz,et al.  A novel hybrid algorithm based on particle swarm and ant colony optimization for finding the global minimum , 2012, Appl. Math. Comput..

[36]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[37]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[38]  Qiang Ma,et al.  An Artificial Bee Colony algorithm with guide of global & local optima and asynchronous scaling factors for numerical optimization , 2015, Appl. Soft Comput..

[39]  Min-Yuan Cheng,et al.  Hybrid Artificial Intelligence–Based PBA for Benchmark Functions and Facility Layout Design Optimization , 2012 .

[40]  Patrick Siarry,et al.  Genetic and Nelder-Mead algorithms hybridized for a more accurate global optimization of continuous multiminima functions , 2003, Eur. J. Oper. Res..

[41]  Patrick Siarry,et al.  A survey on optimization metaheuristics , 2013, Inf. Sci..

[42]  A. Kaveh,et al.  A new optimization method: Dolphin echolocation , 2013, Adv. Eng. Softw..

[43]  T. Ryan Gregory,et al.  Understanding Natural Selection: Essential Concepts and Common Misconceptions , 2009, Evolution: Education and Outreach.

[44]  Christian Blum,et al.  Metaheuristics in combinatorial optimization: Overview and conceptual comparison , 2003, CSUR.

[45]  Min-Yuan Cheng,et al.  Optimizing Multiple-Resources Leveling in Multiple Projects Using Discrete Symbiotic Organisms Search , 2016, J. Comput. Civ. Eng..

[46]  Shahriar Lotfi,et al.  A Hybrid CS/PSO Algorithm for Global Optimization , 2012, ACIIDS.

[47]  Patrick Siarry,et al.  A Continuous Genetic Algorithm Designed for the Global Optimization of Multimodal Functions , 2000, J. Heuristics.

[48]  Victor O. K. Li,et al.  Real-Coded Chemical Reaction Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[49]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[50]  Anil K. Jain Data clustering: 50 years beyond K-means , 2010, Pattern Recognit. Lett..

[51]  Xin-She Yang,et al.  Nature-Inspired Metaheuristic Algorithms , 2008 .

[52]  Xiangyu Wang,et al.  A novel differential search algorithm and applications for structure design , 2015, Appl. Math. Comput..

[53]  Ardeshir Bahreininejad,et al.  Water cycle algorithm - A novel metaheuristic optimization method for solving constrained engineering optimization problems , 2012 .

[54]  Lotfi A. Zadeh,et al.  The Roles of Fuzzy Logic and Soft Computing in the Conception, Design and Deployment of Intelligent Systems , 1997, Software Agents and Soft Computing.

[55]  Yujun Zheng Water wave optimization: A new nature-inspired metaheuristic , 2015, Comput. Oper. Res..

[56]  D. Pham,et al.  THE BEES ALGORITHM, A NOVEL TOOL FOR COMPLEX OPTIMISATION PROBLEMS , 2006 .

[57]  Daobo Wang,et al.  Markov Chains and Martingale Theory Based Convergence Proof of Ant Colony Algorithm and Its Simulation Platform , 2006, 2006 6th World Congress on Intelligent Control and Automation.

[58]  Min-Yuan Cheng,et al.  Symbiotic Organisms Search: A new metaheuristic optimization algorithm , 2014 .

[59]  Zhiyong Li,et al.  A hybrid algorithm based on particle swarm and chemical reaction optimization , 2014, Expert Syst. Appl..