A Novel Consensus-Based Particle Swarm Optimization-Assisted Trust-Tech Methodology for Large-Scale Global Optimization

A novel three-stage methodology, termed the “consensus-based particle swarm optimization (PSO)-assisted Trust-Tech methodology,” to find global optimal solutions for nonlinear optimization problems is presented. It is composed of Trust-Tech methods, consensus-based PSO, and local optimization methods that are integrated to compute a set of high-quality local optimal solutions that can contain the global optimal solution. The proposed methodology compares very favorably with several recently developed PSO algorithms based on a set of small-dimension benchmark optimization problems and 20 large-dimension test functions from the CEC 2010 competition. The analytical basis for the proposed methodology is also provided. Experimental results demonstrate that the proposed methodology can rapidly obtain high-quality optimal solutions that can contain the global optimal solution. The scalability of the proposed methodology is promising.

[1]  José Neves,et al.  The fully informed particle swarm: simpler, maybe better , 2004, IEEE Transactions on Evolutionary Computation.

[2]  Jun Zhang,et al.  Adaptive Particle Swarm Optimization , 2008, ANTS Conference.

[3]  Salman Mohagheghi,et al.  Particle Swarm Optimization: Basic Concepts, Variants and Applications in Power Systems , 2008, IEEE Transactions on Evolutionary Computation.

[4]  Zhijian Wu,et al.  Sequential DE enhanced by neighborhood search for Large Scale Global Optimization , 2010, IEEE Congress on Evolutionary Computation.

[5]  Jeffery D. Weir,et al.  AHPS2: An optimizer using adaptive heterogeneous particle swarms , 2014, Inf. Sci..

[6]  Liang Gao,et al.  Cellular particle swarm optimization , 2011, Inf. Sci..

[7]  Nor Ashidi Mat Isa,et al.  An adaptive two-layer particle swarm optimization with elitist learning strategy , 2014, Inf. Sci..

[8]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[9]  Yang Tang,et al.  Feedback learning particle swarm optimization , 2011, Appl. Soft Comput..

[10]  Ling-Yuan Hsu,et al.  Turbulent-PSO-Based Fuzzy Image Filter With No-Reference Measures for High-Density Impulse Noise , 2013, IEEE Transactions on Cybernetics.

[11]  Shang-Jeng Tsai,et al.  Efficient Population Utilization Strategy for Particle Swarm Optimizer , 2009, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Zuren Feng,et al.  A Scatter Learning Particle Swarm Optimization Algorithm for Multimodal Problems , 2014, IEEE Transactions on Cybernetics.

[13]  Yaochu Jin,et al.  A Competitive Swarm Optimizer for Large Scale Optimization , 2015, IEEE Transactions on Cybernetics.

[14]  Guolong Chen,et al.  Multilayer Obstacle-Avoiding X-Architecture Steiner Minimal Tree Construction Based on Particle Swarm Optimization , 2015, IEEE Transactions on Cybernetics.

[15]  Hao Gao,et al.  A New Particle Swarm Algorithm and Its Globally Convergent Modifications , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.

[17]  H. Chiang,et al.  Stability Regions of Nonlinear Dynamical Systems: Theory, Estimation, and Applications , 2015 .

[18]  Jun Zhang,et al.  Orthogonal Learning Particle Swarm Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[19]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[20]  Shinn-Ying Ho,et al.  OPSO: Orthogonal Particle Swarm Optimization and Its Application to Task Assignment Problems , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[21]  MengChu Zhou,et al.  Composite Particle Swarm Optimizer With Historical Memory for Function Optimization , 2015, IEEE Transactions on Cybernetics.

[22]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer , 2005, Proceedings 2005 IEEE Swarm Intelligence Symposium, 2005. SIS 2005..

[23]  Hung-Chih Chiu,et al.  Adaptive fuzzy particle swarm optimization for global optimization of multimodal functions , 2011, Inf. Sci..

[24]  Ivor W. Tsang,et al.  A Hybrid PSO-BFGS Strategy for Global Optimization of Multimodal Functions , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Y. Volkan Pehlivanoglu,et al.  A New Particle Swarm Optimization Method Enhanced With a Periodic Mutation Strategy and Neural Networks , 2013, IEEE Transactions on Evolutionary Computation.

[26]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[27]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[28]  Bin Wang,et al.  Applications of TRUST-TECH Methodology in Optimal Power Flow of Power Systems , 2009 .

[29]  Junying Chen,et al.  Particle Swarm Optimization with Local Search , 2005, 2005 International Conference on Neural Networks and Brain.

[30]  Xiaodong Li,et al.  Niching Without Niching Parameters: Particle Swarm Optimization Using a Ring Topology , 2010, IEEE Transactions on Evolutionary Computation.

[31]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[32]  Jing J. Liang,et al.  Dynamic multi-swarm particle swarm optimizer with local search , 2005, 2005 IEEE Congress on Evolutionary Computation.

[33]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[34]  Bin Wang,et al.  ELITE: Ensemble of Optimal Input-Pruned Neural Networks Using TRUST-TECH , 2011, IEEE Transactions on Neural Networks.

[35]  Hsiao-Dong Chiang,et al.  TRUST-TECH-Based Expectation Maximization for Learning Finite Mixture Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[37]  Ying Lin,et al.  Particle Swarm Optimization With an Aging Leader and Challengers , 2013, IEEE Transactions on Evolutionary Computation.

[38]  Bo Liu,et al.  An Effective PSO-Based Memetic Algorithm for Flow Shop Scheduling , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[39]  Ganesh K. Venayagamoorthy,et al.  Particle Swarm Optimization in Wireless-Sensor Networks: A Brief Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[40]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[41]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[42]  Thomas Stützle,et al.  Frankenstein's PSO: A Composite Particle Swarm Optimization Algorithm , 2009, IEEE Transactions on Evolutionary Computation.

[43]  Hsiao-Dong Chiang,et al.  A dynamical trajectory-based methodology for systematically computing multiple optimal solutions of general nonlinear programming problems , 2004, IEEE Transactions on Automatic Control.

[44]  René Thomsen,et al.  A comparative study of differential evolution, particle swarm optimization, and evolutionary algorithms on numerical benchmark problems , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[45]  L. Coelho,et al.  A novel chaotic particle swarm optimization approach using Hénon map and implicit filtering local search for economic load dispatch , 2009 .

[46]  H. Chiang,et al.  A systematic search method for obtaining multiple local optimal solutions of nonlinear programming problems , 1996 .

[47]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[48]  Mohamed E. El-Hawary,et al.  A Survey of Particle Swarm Optimization Applications in Electric Power Systems , 2009, IEEE Transactions on Evolutionary Computation.

[49]  Nor Ashidi Mat Isa,et al.  Two-layer particle swarm optimization with intelligent division of labor , 2013, Eng. Appl. Artif. Intell..

[50]  Changhe Li,et al.  A Self-Learning Particle Swarm Optimizer for Global Optimization Problems , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).