An improved PSO algorithm coupling with prior information for classification of large scale dataset

An improved particle swarm optimization(PSO) algorithm coupling with prior information for classification of large scale dataset is proposed in this paper. The prior information derived from the data set is used to determine the initialposition of the particles. In the new algorithm, neural network is first trained by improved PSO and then by back-propagation (BP). The prior information narrows the search space and guides the movement direction of the particles, so the convergence rate and the generalization performance are improved. Experimental results demonstrate that the new algorithm is more effective than traditional methods.

[1]  David J. C. MacKay,et al.  A Practical Bayesian Framework for Backpropagation Networks , 1992, Neural Computation.

[2]  Yahya Rahmat-Samii,et al.  Particle swarm optimization for reconfigurable phase‐differentiated array design , 2003 .

[3]  Zhiwei Wang,et al.  Particle swarm optimization and neural network application for QSAR , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[4]  J R Saunders,et al.  A particle swarm optimizer with passive congregation. , 2004, Bio Systems.

[5]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[7]  Kevin D. Seppi,et al.  The Kalman Swarm: A New Approach to Particle Motion in Swarm Optimization , 2004, GECCO.

[8]  Yih-Lon Lin,et al.  A particle swarm optimization approach to nonlinear rational filter modeling , 2008, Expert Syst. Appl..

[9]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[10]  Frans van den Bergh,et al.  An analysis of particle swarm optimizers , 2002 .

[11]  Hans Henrik Thodberg,et al.  A review of Bayesian neural networks with an application to near infrared spectroscopy , 1996, IEEE Trans. Neural Networks.

[12]  Saman K. Halgamuge,et al.  Self-organizing hierarchical particle swarm optimizer with time-varying acceleration coefficients , 2004, IEEE Transactions on Evolutionary Computation.