A cooperative particle swarm optimizer with statistical variable interdependence learning

Cooperative optimization algorithms, such as the cooperative coevolutionary genetic algorithm (CCGA) and the cooperative particle swarm optimization (CPSO) algorithm, have already been used with success to solve many optimization problems. One of the most important issues in cooperative optimization algorithms is the task of decomposition. Decomposition decision regarding variable interdependencies plays a significant role in the algorithm's performance. Algorithms that do not consider variable interdependencies often lose their effectiveness and advantages when applied to solve nonseparable problems. In this paper, we propose a cooperative particle swarm optimizer with statistical variable interdependence learning (CPSO-SL). A statistical model is proposed to explore the interdependencies among variables. With these interdependencies, the algorithm partitions large scale problems into overlapping small scale subproblems. Moreover, a CPSO framework is proposed to optimize the subproblems cooperatively. Finally, theoretical analysis is presented for further understanding of the proposed CPSO-SL. Simulated experiments were conducted on 10 classical benchmarks, 10 rotated classical benchmarks, and 10 CEC2005 benchmarks. The results demonstrate the performance of CPSO-SL in solving both separable and nonseparable problems, as compared with the performance of other recent cooperative optimization algorithms.

[1]  R. Salomon Re-evaluating genetic algorithm performance under coordinate rotation of benchmark functions. A survey of some theoretical and practical aspects of genetic algorithms. , 1996, Bio Systems.

[2]  Karsten Weicker,et al.  On the improvement of coevolutionary optimizers by learning variable interdependencies , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[3]  Muhammad Khurram Khan,et al.  An effective memetic differential evolution algorithm based on chaotic local search , 2011, Inf. Sci..

[4]  Aimo A. Törn,et al.  Global Optimization , 1999, Science.

[5]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for global optimization of multimodal functions , 2006, IEEE Transactions on Evolutionary Computation.

[7]  Xin Yao,et al.  Multilevel cooperative coevolution for large scale optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[8]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[9]  Wei Chu,et al.  A new evolutionary search strategy for global optimization of high-dimensional problems , 2011, Inf. Sci..

[10]  Andy J. Keane,et al.  Meta-Lamarckian learning in memetic algorithms , 2004, IEEE Transactions on Evolutionary Computation.

[11]  Efrén Mezura-Montes,et al.  Differential evolution in constrained numerical optimization: An empirical study , 2010, Inf. Sci..

[12]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[13]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[14]  R. Eberhart,et al.  Comparing inertia weights and constriction factors in particle swarm optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[15]  Xiaodong Li,et al.  Tackling high dimensional nonseparable optimization problems by cooperatively coevolving particle swarms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[16]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[17]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[18]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[19]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[20]  Swagatam Das,et al.  An improved differential evolution algorithm with fitness-based adaptation of the control parameters , 2011, Inf. Sci..

[21]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[22]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[23]  Tapabrata Ray,et al.  A cooperative coevolutionary algorithm with Correlation based Adaptive Variable Partitioning , 2009, 2009 IEEE Congress on Evolutionary Computation.

[24]  Yong Lu,et al.  A robust stochastic genetic algorithm (StGA) for global numerical optimization , 2004, IEEE Transactions on Evolutionary Computation.

[25]  Xin Yao,et al.  Evolutionary programming using mutations based on the Levy probability distribution , 2004, IEEE Transactions on Evolutionary Computation.

[26]  Chenggong Zhang,et al.  Scale-free fully informed particle swarm optimization algorithm , 2011, Inf. Sci..

[27]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[28]  Xin Yao,et al.  Differential evolution for high-dimensional function optimization , 2007, 2007 IEEE Congress on Evolutionary Computation.

[29]  Feng Qian,et al.  A hybrid genetic algorithm with the Baldwin effect , 2010, Inf. Sci..

[30]  Yanchun Liang,et al.  An Effective PSO and AIS-Based Hybrid Intelligent Algorithm for Job-Shop Scheduling , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[32]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.