A diversity guided PSO combined with BP for feedforward neural networks

In this paper, a diversity guided particle swarm optimization (DGPSO-BP) guided by diversity and fitness value is firstly proposed to address two problems: premature convergence in the standard PSO and longer searching time brought by the optimization of the PSO. Further, the DGPSO-BP is combined with back-propagation (BP) for feed forward neural networks to avoid the problem of being trapped into local minima in the BP and combines PSO's strong local search ability and BP's good local search ability meanwhile. Compared with the traditional learning algorithms, the improved learning algorithm has much better convergence performance. Finally, the experimental results are given to verify the efficiency and effectiveness of the proposed algorithm.

[1]  Fei Han,et al.  A new approach for function approximation incorporating adaptive particle swarm optimization and a priori information , 2008, Appl. Math. Comput..

[2]  De-Shuang Huang,et al.  Modified constrained learning algorithms incorporating additional functional constraints into neural networks , 2008, Inf. Sci..

[3]  Li Xiaoxiao,et al.  Analysis on oscillation in electro-hydraulic regulating system of steam turbine and fault diagnosis based on PSOBP , 2010 .

[4]  Adnan Khashman,et al.  A Modified Backpropagation Learning Algorithm With Added Emotional Coefficients , 2008, IEEE Transactions on Neural Networks.

[5]  Z. H. Che,et al.  PSO-based back-propagation artificial neural network for product and mold cost estimation of plastic injection molding , 2010, Comput. Ind. Eng..

[6]  Hao Xu,et al.  Automatic thesaurus construction for spam filtering using revised back propagation neural network , 2010, Expert Syst. Appl..

[7]  Gerald H. L. Cheang,et al.  Approximation with neural networks activated by ramp sigmoids , 2010, J. Approx. Theory.

[8]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[9]  ChunXia Zhao,et al.  Particle swarm optimization with adaptive population size and its application , 2009, Appl. Soft Comput..

[10]  Yubin Lan,et al.  Review: Development of soft computing and applications in agricultural and biological engineering , 2010 .

[11]  Vesna Rankovic,et al.  Feedforward neural network and adaptive network-based fuzzy inference system in study of power lines , 2010, Expert Syst. Appl..

[12]  Y. Huanga,et al.  Development of soft computing and applications in agricultural and biological engineering , 2010 .

[13]  Zongben Xu,et al.  New study on neural networks: the essential order of approximation , 2010, Neural Networks.