Optimizing Particle Swarm Optimization algorithm

Particle Swarm Optimization (PSO) algorithm has become more popular recently. It has been shown to be an effective optimization tool in most of the applications. In this paper, we have applied the PSO algorithm to a sample Artificial Neural Network (ANN) application, measured the improvement, and optimized the PSO parameters to improve results as much as possible. The application is character recognition of English numbers. Two indicators of accuracy of the results and processing time are taken in to account. The objective of this paper is to show that we can empirically adjust the PSO parameters to optimize PSO for the best results. Through several iterative processes of extracting improvements and adjusting the PSO parameters, we have recorded optimized PSO parameters and respective variances for similar applications. Indeed, the method can also be extended to alphabetic characters by just providing the input training patterns of each character. The details of the proposed approach and the simulation results are recorded in this paper.

[1]  Mingzhe Liu,et al.  Improving generalization performance of artificial neural networks with genetic algorithms , 2005, 2005 IEEE International Conference on Granular Computing.

[2]  Andries Petrus Engelbrecht,et al.  Overfitting by PSO trained feedforward neural networks , 2010, IEEE Congress on Evolutionary Computation.

[3]  Peng Gong,et al.  Particle swarm optimization based power allocation in DF cooperative communications , 2013, 2013 Fifth International Conference on Ubiquitous and Future Networks (ICUFN).

[4]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[5]  Oscar Castillo,et al.  Optimization of type-2 fuzzy weight for neural network using genetic algorithm and particle swarm optimization , 2013, 2013 World Congress on Nature and Biologically Inspired Computing.

[6]  Wei-Chang Yeh,et al.  New Parameter-Free Simplified Swarm Optimization for Artificial Neural Network Training and its Application in the Prediction of Time Series , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Dong Yongfeng,et al.  Handwritten Chinese Characters Recognition Based on PSO Neural Networks , 2009, 2009 Second International Conference on Intelligent Networks and Intelligent Systems.

[8]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[9]  Guoshao Su,et al.  Accelerating Particle Swarm Optimization Algorithms Using Gaussian Process Machine Learning , 2009, 2009 International Conference on Computational Intelligence and Natural Computing.

[10]  S. Q. Liu,et al.  Non-linear dual-mode receding horizon control for multiple unmanned air vehicles formation flight based on chaotic particle swarm optimisation , 2010 .

[11]  Jun Liu,et al.  A Novel Hybrid PSO-BP Algorithm for Neural Network Training , 2009, 2009 International Joint Conference on Computational Sciences and Optimization.