Distributed Parallel Particle Swarm Optimization for Multi-Objective and Many-Objective Large-Scale Optimization

With the advent of big data era, complex optimization problems with many objectives and large numbers of decision variables are constantly emerging. Traditional research about multi-objective particle swarm optimization (PSO) focuses on multi-objective optimization problems (MOPs) with small numbers of variables and less than four objectives. At present, MOPs with large numbers of variables and many objectives (greater than or equal to four) are constantly emerging. When tackling this type of MOPs, the traditional multi-objective PSO algorithms have low efficiency. Aiming at these multi-objective large-scale optimization problems (MOLSOPs) and many-objective large-scale optimization problems (MaOLSOPs), we need to explore thoroughly parallel attributes of the particle swarm, and design the novel PSO algorithms according to the characteristics of distributed parallel computation. We survey the related research on PSO: multi-objective large-scale optimization, many-objective optimization, and distributed parallelism. Based on the aforementioned three aspects, the multi-objective large-scale distributed parallel PSO and many-objective large-scale distributed parallel PSO methodologies are proposed and discussed, and the other future research trends are also illuminated.

[1]  Jiang Bo,et al.  Multi-Objective Particle Swarm Optimization Algorithm Using Large Scale Variable Decomposition , 2016 .

[2]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[3]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[4]  Bernhard Sendhoff,et al.  A Reference Vector Guided Evolutionary Algorithm for Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[5]  Kevin D. Seppi,et al.  An exploration of topologies and communication in large particle swarms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[6]  Yudong Zhang,et al.  A Comprehensive Survey on Particle Swarm Optimization Algorithm and Its Applications , 2015 .

[7]  Gexiang Zhang,et al.  Enhancing distributed differential evolution with multicultural migration for global numerical optimization , 2013, Inf. Sci..

[8]  Wenhua Zeng,et al.  A New Local Search-Based Multiobjective Optimization Algorithm , 2015, IEEE Transactions on Evolutionary Computation.

[9]  Xiaodong Liu,et al.  A speculative approach to spatial-temporal efficiency with multi-objective optimization in a heterogeneous cloud environment , 2016, Secur. Commun. Networks.

[10]  Bin Cao,et al.  Cooperative co-evolution with graph-based differential grouping for large scale global optimization , 2016, 2016 12th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD).

[11]  Xiaodong Li,et al.  Cooperative Co-evolution for large scale optimization through more frequent random grouping , 2010, IEEE Congress on Evolutionary Computation.

[12]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[13]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[14]  Sadok Bouamama,et al.  GPU-PSO: Parallel Particle Swarm Optimization Approaches on Graphical Processing Unit for Constraint Reasoning: Case of Max-CSPs , 2015, KES.

[15]  汤可宗,et al.  Multi-strategy adaptive particle swarm optimization for numerical optimization , 2015 .

[16]  Wang Hu,et al.  Density estimation for selecting leaders and mantaining archive in MOPSO , 2013, 2013 IEEE Congress on Evolutionary Computation.

[17]  Pei-wei Tsai,et al.  Metaheuristics for the deployment problem of WSN: A review , 2015, Microprocess. Microsystems.

[18]  Xin Yao,et al.  Many-Objective Evolutionary Algorithms , 2015, ACM Comput. Surv..

[19]  Xiaodong Li,et al.  A Competitive Divide-and-Conquer Algorithm for Unconstrained Large-Scale Black-Box Optimization , 2016, ACM Trans. Math. Softw..

[20]  Zhihan Lv,et al.  Spark-Based Parallel Cooperative Co-evolution Particle Swarm Optimization Algorithm , 2016, 2016 IEEE International Conference on Web Services (ICWS).

[21]  Qingfu Zhang,et al.  Distributed evolutionary algorithms and their models: A survey of the state-of-the-art , 2015, Appl. Soft Comput..

[22]  Le Wu,et al.  Multi-objective optimization for design of a steam system with drivers option in process industries , 2016 .

[23]  MengChu Zhou,et al.  Composite Particle Swarm Optimizer With Historical Memory for Function Optimization , 2015, IEEE Transactions on Cybernetics.

[24]  Jian Chen,et al.  Particle Swarm Optimization with Double Learning Patterns , 2015, Comput. Intell. Neurosci..

[25]  Wei-neng Chen,et al.  Cross-generation Elites Guided Particle Swarm Optimization for large scale optimization , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[26]  Xue Wang,et al.  Hierarchical Deployment Optimization for Wireless Sensor Networks , 2011, IEEE Transactions on Mobile Computing.

[27]  Jun Zhang,et al.  Parallel Particle Swarm Optimization Using Message Passing Interface , 2015 .

[28]  Jing Zhang,et al.  Formalized model and analysis of mixed swarm based cooperative particle swarm optimization , 2016, Neurocomputing.

[29]  Xin Zhang,et al.  Sensitivity analysis of Parallel Cell Coordinate System in Many-objective Particle Swarm Optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[30]  Xin Yao,et al.  Two_Arch2: An Improved Two-Archive Algorithm for Many-Objective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[31]  Xiaodong Li,et al.  Cooperatively Coevolving Particle Swarms for Large Scale Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[32]  Yu Xue,et al.  A self-adaptive artificial bee colony algorithm based on global best for global optimization , 2017, Soft Computing.

[33]  Carlos A. Coello Coello,et al.  Use of cooperative coevolution for solving large scale multiobjective optimization problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[34]  Jun Zhang,et al.  A Parallel Implementation of Multiobjective Particle Swarm Optimization Algorithm Based on Decomposition , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[35]  Xingming Sun,et al.  Structural Minimax Probability Machine , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[36]  Fang Liu,et al.  A Multiobjective Evolutionary Algorithm Based on Decision Variable Analyses for Multiobjective Optimization Problems With Large-Scale Variables , 2016, IEEE Transactions on Evolutionary Computation.

[37]  Aderemi Oluyinka Adewumi,et al.  An Adaptive Velocity Particle Swarm Optimization for high-dimensional function optimization , 2013, 2013 IEEE Congress on Evolutionary Computation.

[38]  Ke Ding,et al.  A Survey on GPU-Based Implementation of Swarm Intelligence Algorithms , 2016, IEEE Transactions on Cybernetics.

[39]  Kevin D. Seppi,et al.  A speculative approach to parallelization in particle swarm optimization , 2012, Swarm Intelligence.

[40]  Wang Hu,et al.  Adaptive Multiobjective Particle Swarm Optimization Based on Parallel Cell Coordinate System , 2015, IEEE Transactions on Evolutionary Computation.

[41]  Jing J. Liang,et al.  Large-scale portfolio optimization using multiobjective dynamic mutli-swarm particle swarm optimizer , 2013, 2013 IEEE Symposium on Swarm Intelligence (SIS).

[42]  Bin Gu,et al.  Incremental Support Vector Learning for Ordinal Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Weiwei Zhang,et al.  Cooperative Differential Evolution With Multiple Populations for Multiobjective Optimization , 2016, IEEE Transactions on Cybernetics.

[44]  Bin Gu,et al.  Incremental learning for ν-Support Vector Regression , 2015, Neural Networks.

[45]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[46]  Gary G. Yen,et al.  Visualization and Performance Metric in Many-Objective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[47]  Ye Tian,et al.  A Decision Variable Clustering-Based Evolutionary Algorithm for Large-Scale Many-Objective Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[48]  Huanhuan Chen,et al.  A decentralized quantum-inspired particle swarm optimization algorithm with cellular structured population , 2016, Inf. Sci..

[49]  Xin Liu,et al.  A Distributed Parallel Cooperative Coevolutionary Multiobjective Evolutionary Algorithm for Large-Scale Optimization , 2017, IEEE Transactions on Industrial Informatics.

[50]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[51]  Xingming Sun,et al.  Efficient algorithm for k-barrier coverage based on integer linear programming , 2016, China Communications.