Negatively Correlated Neural Network Ensemble with Multi-population Particle Swarm Optimization

Multi-population particle swarm optimization (MPPSO) algorithm is proposed to train negatively correlated neural network ensemble. Each sub-swarm is responsible for training a component network. The architecture of each component neural network in the ensemble is automatically configured. The component networks are trained simultaneously and successively exchange information among them. Because our approach automatically determines the number of hidden units for the component neural networks, the rational architectures of the component network are achieved and hence the performance of ensemble is improved. The experimental results show that MPPSO for negatively correlated ensemble is an effective and practical method.

[1]  Xin Yao,et al.  Evolutionary ensembles with negative correlation learning , 2000, IEEE Trans. Evol. Comput..

[2]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[4]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[5]  Yu Liu,et al.  Training Radial Basis Function Networks with Particle Swarms , 2004, ISNN.

[6]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[7]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Xin Yao,et al.  Simultaneous training of negatively correlated neural networks in an ensemble , 1999, IEEE Trans. Syst. Man Cybern. Part B.