Taking advantage of hybrid bioinspired intelligent algorithm with decoupled extended Kalman filter for optimizing growing and pruning radial basis function network

The growing and pruning radial basis function (GAP-RBF) network is a promising sequential learning algorithm for prediction analysis, but the parameter selection of such a network is usually a non-convex problem and makes it difficult to handle. In this paper, a hybrid bioinspired intelligent algorithm is proposed to optimize GAP-RBF. Specifically, the excellent local convergence of particle swarm optimization (PSO) and the extensive search ability of genetic algorithm (GA) are both considered to optimize the weights and bias term of GAP-RBF. Meanwhile, a competitive mechanism is proposed to make the hybrid algorithm choose the appropriate individuals for effective search and further improve its optimization ability. Moreover, a decoupled extended Kalman filter (DEKF) method is introduced in this study to reduce the size of error covariance matrix and decrease the computational complexity for performing real-time predictions. In the experiments, three classic forecasting issues including abalone age, Boston house price and auto MPG are adopted for extensive test, and the experimental results show that our method performs better than PSO and GA these two single bioinspired optimization algorithms. What is more, our method via DEKF achieves the better results in comparison with the state-of-art sequential learning algorithms, such as GAP-RBF, minimal resource allocation network, resource allocation network using an extended Kalman filter and resource allocation network.

[1]  Russell C. Eberhart,et al.  A new optimizer using particle swarm theory , 1995, MHS'95. Proceedings of the Sixth International Symposium on Micro Machine and Human Science.

[2]  Mohamad T. Musavi,et al.  On the training of radial basis function classifiers , 1992, Neural Networks.

[3]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[4]  Paramasivan Saratchandran,et al.  Performance evaluation of a sequential minimal radial basis function (RBF) neural network learning algorithm , 1998, IEEE Trans. Neural Networks.

[5]  Haralambos Sarimveis,et al.  A new algorithm for developing dynamic radial basis function neural network models based on genetic algorithms , 2004, Comput. Chem. Eng..

[6]  Xin-Jian Zhu,et al.  Short communication Modeling a SOFC stack based on GA-RBF neural networks identification , 2007 .

[7]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[8]  Gholam Ali Montazer,et al.  An improvement in RBF learning algorithm based on PSO for real time applications , 2013, Neurocomputing.

[9]  Zhou Juan,et al.  Groundwater Table Prediction Based on Improved PSO Algorithm and RBF Neural Network , 2010, 2010 International Conference on Artificial Intelligence and Computational Intelligence.

[10]  Najdan Vukovic,et al.  A growing and pruning sequential learning algorithm of hyper basis function neural network for function approximation , 2013, Neural Networks.

[11]  Junfei Qiao,et al.  Model predictive control of dissolved oxygen concentration based on a self-organizing RBF neural network , 2012 .

[12]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[13]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Minrui Fei,et al.  A fast multi-output RBF neural network construction method , 2010, Neurocomputing.

[15]  Yue Shi,et al.  A modified particle swarm optimizer , 1998, 1998 IEEE International Conference on Evolutionary Computation Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98TH8360).

[16]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[17]  Reza Sabzevari,et al.  Three-phase strategy for the OSD learning method in RBF neural networks , 2009, Neurocomputing.

[18]  Tim Hendtlass.  Restarting Particle Swarm Optimisation for deceptive problems , 2012, 2012 IEEE Congress on Evolutionary Computation.

[19]  Zhifeng Chen,et al.  Application of PSO-RBF Neural Network in Network Intrusion Detection , 2009, 2009 Third International Symposium on Intelligent Information Technology Application.

[20]  John Moody,et al.  Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[21]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[22]  N. Sundararajan,et al.  A Recursive Growing and Pruning RBF (GAP-RBF) Algorithm for Function Approximations , 2003, 2003 4th International Conference on Control and Automation Proceedings.

[23]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[24]  Visakan Kadirkamanathan,et al.  A Function Estimation Approach to Sequential Learning with Neural Networks , 1993, Neural Computation.

[25]  Paramasivan Saratchandran,et al.  Improved GAP-RBF network for classification problems , 2007, Neurocomputing.

[26]  Adrian G. Bors,et al.  Minimal Topology for a Radial Basis Functions Neural Network for Pattern Classification , 1994 .

[27]  Vladan Babovic,et al.  GENETIC PROGRAMMING AND ITS APPLICATION IN REAL‐TIME RUNOFF FORECASTING 1 , 2001 .

[28]  Hui Wang,et al.  Using Radial Basis Function Networks for Function Approximation and Classification , 2012 .

[29]  Bin Wang,et al.  Application of GA-RBF networks to the nondestructive determination of active component in pharmaceutical powder by NIR spectroscopy , 2009 .