A Novel Neural Network Algorithm Optimized by PSO for Function Approximation

A novel neural network algorithm optimized by particle swarm optimization (PSO) for function approximation is proposed in this paper. The prior information extracted from the upper and lower bound of the approximated function is coupled into PSO. Since the prior information narrows the search space and guides the movement direction of the particles, the convergence rate and the approximation accuracy are improved. Experimental results demonstrate that the new algorithm is more effective than traditional methods.

[1]  Fei Han,et al.  An Improved PSO Algorithm Coupling with Prior Information for Function Approximation , 2011 .

[2]  T. Krink,et al.  Extending particle swarm optimisers with self-organized criticality , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[3]  S. Lawrence,et al.  Function Approximation with Neural Networks and Local Methods: Bias, Variance and Smoothness , 1996 .

[4]  Yih-Lon Lin,et al.  A particle swarm optimization approach to nonlinear rational filter modeling , 2008, Expert Syst. Appl..

[5]  Sun Zhiyi,et al.  Application of combined neural networks in nonlinear function approximation , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).

[6]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[7]  Tomaso Poggio,et al.  Incorporating prior information in machine learning by creating virtual examples , 1998, Proc. IEEE.

[8]  Thomas G. Dietterich.  What is machine learning? , 2020, Archives of Disease in Childhood.

[9]  Wenbo Xu,et al.  Particle swarm optimization with particles having quantum behavior , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[10]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[11]  Kwok-wing Chau,et al.  Application of a PSO-based neural network in analysis of outcomes of construction claims , 2007 .

[12]  Fei Han,et al.  A new approach for function approximation incorporating adaptive particle swarm optimization and a priori information , 2008, Appl. Math. Comput..

[13]  E. Ozcan,et al.  Particle swarm optimization: surfing the waves , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).