A modified competitive swarm optimizer for large scale optimization problems

Display Omitted The proposed work (MCSO) is motivated by the Competitive Swarm Optimizer (CSO).2/3rd of the swarm are updated in MCSO every time by a tri-competitive criteria.Both CEC 2008 and CEC 2010 benchmark functions have been solved using MCSO.Statistical results confirms the superiority of MCSO with faster convergence rate.Clearly, MCSO maintains good balance between exploration and exploitation search. In the recent literature a popular algorithm namely Competitive Swarm Optimizer (CSO) has been proposed for solving unconstrained optimization problems that updates only half of the population in each iteration. A modified CSO (MCSO) is being proposed in this paper where two thirds of the population swarms are being updated by a tri-competitive criterion unlike CSO. A small change in CSO makes a huge difference in the solution quality. The basic idea behind the proposition is to maintain a higher rate of exploration to the search space with a faster rate of convergence. The proposed MCSO is applied to solve the standard CEC2008 and CEC2013 large scale unconstrained benchmark optimization problems. The empirical results and statistical analysis confirm the better overall performance of MCSO over many other state-of-the-art meta-heuristics, including CSO. In order to confirm the superiority further, a real life problem namely sampling-based image matting problem is solved. Considering the winners of CEC 2008 and 2013, MCSO attains the second best position in the competition.

[1]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[2]  Hussein A. Abbass,et al.  Robustness Against the Decision-Maker's Attitude to Risk in Problems With Conflicting Objectives , 2012, IEEE Transactions on Evolutionary Computation.

[3]  Antonio LaTorre,et al.  A comprehensive comparison of large scale global optimizers , 2015, Inf. Sci..

[4]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[5]  Bruce A. Whitehead,et al.  Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[6]  Raymond Ros,et al.  A Simple Modification in CMA-ES Achieving Linear Time and Space Complexity , 2008, PPSN.

[7]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[8]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[9]  R. Eberhart,et al.  Empirical study of particle swarm optimization , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[10]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[11]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[12]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[13]  Idel Montalvo,et al.  A diversity-enriched variant of discrete PSO applied to the design of water distribution networks , 2008 .

[14]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[15]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[16]  Y. Rahmat-Samii,et al.  Particle swarm, genetic algorithm, and their hybrids: optimization of a profiled corrugated horn antenna , 2002, IEEE Antennas and Propagation Society International Symposium (IEEE Cat. No.02CH37313).

[17]  F. Wilcoxon.  Individual Comparisons by Ranking Methods , 1945 .

[18]  Amit Konar,et al.  Particle Swarm Optimization and Differential Evolution Algorithms: Technical Analysis, Applications and Hybridization Perspectives , 2008, Advances of Computational Intelligence in Industrial Systems.

[19]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[20]  Ke Tang,et al.  Scaling Up Covariance Matrix Adaptation Evolution Strategy Using Cooperative Coevolution , 2013, IDEAL.

[21]  Antonio LaTorre,et al.  Large scale global optimization: Experimental results with MOS-based hybrid algorithms , 2013, 2013 IEEE Congress on Evolutionary Computation.

[22]  Alexander G. Loukianov,et al.  Particle Swarm Optimization for Discrete-Time Inverse Optimal Control of a Doubly Fed Induction Generator , 2013, IEEE Transactions on Cybernetics.

[23]  Sönke Hartmann,et al.  A competitive genetic algorithm for resource-constrained project scheduling , 1998 .

[24]  Michael F. Cohen,et al.  An iterative optimization approach for unified image segmentation and matting , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[25]  Shengxiang Yang,et al.  Triggered Memory-Based Swarm Optimization in Dynamic Environments , 2007, EvoWorkshops.

[26]  Yiming Yang,et al.  A Comparative Study on Feature Selection in Text Categorization , 1997, ICML.

[27]  Mark Johnston,et al.  A novel particle swarm optimisation approach to detecting continuous, thin and smooth edges in noisy images , 2013, Inf. Sci..

[28]  Yuhui Shi,et al.  An Optimization Algorithm Based on Brainstorming Process , 2011, Int. J. Swarm Intell. Res..

[29]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[30]  Kedar Nath Das,et al.  An ideal tri-population approach for unconstrained optimization and applications , 2015, Appl. Math. Comput..

[31]  Michael F. Cohen,et al.  Optimized Color Sampling for Robust Matting , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Janez Brest,et al.  Self-adaptive differential evolution algorithm using population size reduction and three strategies , 2011, Soft Comput..

[33]  Chia-Feng Juang,et al.  A hybrid of genetic algorithm and particle swarm optimization for recurrent network design , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[36]  Y. Hochberg.  A sharper Bonferroni procedure for multiple tests of significance , 1988 .

[37]  Zhaoquan Cai,et al.  Improving sampling-based image matting with cooperative coevolution differential evolution algorithm , 2017, Soft Comput..

[38]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[39]  Francisco Herrera,et al.  A study on the use of non-parametric tests for analyzing the evolutionary algorithms’ behaviour: a case study on the CEC’2005 Special Session on Real Parameter Optimization , 2009, J. Heuristics.

[40]  Shang-Jeng Tsai,et al.  Solving large scale global optimization using improved Particle Swarm Optimizer , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[41]  Russell C. Eberhart,et al.  Parameter Selection in Particle Swarm Optimization , 1998, Evolutionary Programming.

[42]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[43]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[44]  Manuel Menezes de Oliveira Neto,et al.  Shared Sampling for Real‐Time Alpha Matting , 2010, Comput. Graph. Forum.

[45]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[46]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[47]  Carlos A. Coello Coello,et al.  Solving constrained optimization problems with a hybrid particle swarm optimization algorithm , 2011 .

[48]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[49]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[50]  Yaochu Jin,et al.  A multi-swarm evolutionary framework based on a feedback mechanism , 2013, 2013 IEEE Congress on Evolutionary Computation.

[51]  Jian Sun,et al.  A global sampling method for alpha matting , 2011, CVPR 2011.

[52]  Quan Yang,et al.  Research on Hybrid PSODE with Triple Populations Based on Multiple Differential Evolutionary Models , 2010, 2010 International Conference on Electrical and Control Engineering.

[53]  Ali Husseinzadeh Kashan,et al.  A particle swarm optimizer for grouping problems , 2013, Inf. Sci..

[54]  Ioan Cristian Trelea,et al.  The particle swarm optimization algorithm: convergence analysis and parameter selection , 2003, Inf. Process. Lett..

[55]  W. W. Daniel.  Applied Nonparametric Statistics , 1979 .

[56]  Narasimhan Sundararajan,et al.  Human meta-cognition inspired collaborative search algorithm for optimization , 2014, 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI).

[57]  Peter J. Angeline,et al.  Evolutionary Optimization Versus Particle Swarm Optimization: Philosophy and Performance Differences , 1998, Evolutionary Programming.

[58]  Antonio LaTorre,et al.  A MOS-based dynamic memetic differential evolution algorithm for continuous optimization: a scalability test , 2011, Soft Comput..

[59]  Jue Wang,et al.  A perceptually motivated online benchmark for image matting , 2009, CVPR.

[60]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[61]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[62]  S. Holm.  A Simple Sequentially Rejective Multiple Test Procedure , 1979 .

[63]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[64]  Paolo Rosso,et al.  An efficient Particle Swarm Optimization approach to cluster short texts , 2014, Inf. Sci..

[65]  Chang-Hwan Im,et al.  Multimodal function optimization based on particle swarm optimization , 2006, IEEE Transactions on Magnetics.

[66]  Andries Petrus Engelbrecht,et al.  Measuring exploration/exploitation in particle swarms using swarm diversity , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[67]  Zhi-Hui Zhan,et al.  An Efficient Resource Allocation Scheme Using Particle Swarm Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[68]  Jürgen Branke,et al.  Memory enhanced evolutionary algorithms for changing optimization problems , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[69]  Carlos A. Coello Coello,et al.  A bi-population PSO with a shake-mechanism for solving constrained numerical optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[70]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[71]  Yaochu Jin,et al.  A social learning particle swarm optimization algorithm for scalable optimization , 2015, Inf. Sci..

[72]  Patrick Siarry,et al.  Particle swarm and ant colony algorithms hybridized for improved continuous optimization , 2007, Appl. Math. Comput..

[73]  Teresa Wu,et al.  An Adaptive Particle Swarm Optimization With Multiple Adaptive Methods , 2013, IEEE Transactions on Evolutionary Computation.

[74]  Chun Chen,et al.  Multiple trajectory search for Large Scale Global Optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).