A novel self-adaptive extreme learning machine based on affinity propagation for radial basis function neural network

In this paper, a novel self-adaptive extreme learning machine (ELM) based on affinity propagation (AP) is proposed to optimize the radial basis function neural network (RBFNN). As is well known, the parameters of original ELM which developed by G.-B. Huang are randomly determined. However, that cannot objectively obtain a set of optimal parameters of RBFNN trained by ELM algorithm for different realistic datasets. The AP algorithm can automatically produce a set of clustering centers for the different datasets. According to the results of AP, we can, respectively, get the cluster number and the radius value of each cluster. In that case, the above cluster number and radius value can be used to initialize the number and widths of hidden layer neurons in RBFNN and that is also the parameters of coefficient matrix H of ELM. This may successfully avoid the subjectivity prior knowledge and randomness of training RBFNN. Experimental results show that the method proposed in this thesis has a more powerful generalization capability than conventional ELM for an RBFNN.

[1]  Selami Beyhan,et al.  Stable modeling based control methods using a new RBF network. , 2010, ISA transactions.

[2]  Wei Zeng,et al.  Human gait recognition via deterministic learning , 2012, Neural Networks.

[3]  Gang Ma,et al.  A Rough RBF Neural Networks Optimized by the Genetic Algorithm , 2011 .

[4]  Guang-Bin Huang,et al.  Upper bounds on the number of hidden neurons in feedforward networks with arbitrary bounded nonlinear activation functions , 1998, IEEE Trans. Neural Networks.

[5]  Zhizhong Mao,et al.  ELM based LF temperature prediction model and its online sequential learning , 2012, CCDC 2012.

[6]  Xuli Han,et al.  The multidimensional function approximation based on constructive wavelet RBF neural network , 2011, Appl. Soft Comput..

[7]  Sung-Kwun Oh,et al.  Design of information granule-oriented RBF neural networks and its application to power supply for high-field magnet , 2011, Eng. Appl. Artif. Intell..

[8]  Chee Kheong Siew,et al.  Extreme learning machine: RBF network case , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[9]  Bin Wang,et al.  Application of GA-RBF networks to the nondestructive determination of active component in pharmaceutical powder by NIR spectroscopy , 2009 .

[10]  Guang-Bin Huang,et al.  Learning capability and storage capacity of two-hidden-layer feedforward networks , 2003, IEEE Trans. Neural Networks.

[11]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[12]  Chunguang Zhou,et al.  Search the Optimal Preference of Affinity Propagation Algorithm , 2012, 2012 Fifth International Conference on Intelligent Computation Technology and Automation.

[13]  Leandro dos Santos Coelho,et al.  A RBF neural network model with GARCH errors: Application to electricity price forecasting , 2011 .

[14]  Xin-Jian Zhu,et al.  Predictive control of SOFC based on a GA-RBF neural network model , 2008 .

[15]  Chuanhou Gao,et al.  A comparative analysis of support vector machines and extreme learning machines , 2012, Neural Networks.

[16]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[17]  Mao Zhizhong,et al.  ELM based LF temperature prediction model and its online sequential learning , 2012, 2012 24th Chinese Control and Decision Conference (CCDC).

[18]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[19]  Junfei Qiao,et al.  An efficient self-organizing RBF neural network for water quality prediction , 2011, Neural Networks.

[20]  Han Xu-li,et al.  The multidimensional function approximation based on constructive wavelet RBF neural network , 2011 .

[21]  Ling Zhang,et al.  RBF neural networks for the prediction of building interference effects , 2004 .

[22]  Chao Wu,et al.  Forecasting stock indices using radial basis function neural networks optimized by artificial fish swarm algorithm , 2011, Knowl. Based Syst..

[23]  David W. Lewis,et al.  Matrix theory , 1991 .