An Effective Solution to Regression Problem by RBF Neuron Network

Radial Basis Function RBF neuron network is being applied widely in multivariate function regression. However, selection of neuron number for hidden layer and definition of suitable centre in order to produce a good regression network are still open problems which have been researched by many people. This article proposes to apply grid equally space nodes as the centre of hidden layer. Then, the authors use k-nearest neighbour method to define the value of regression function at the center and an interpolation RBF network training algorithm with equally spaced nodes to train the network. The experiments show the outstanding efficiency of regression function when the training data has Gauss white noise.

[1]  Ethem Alpaydin,et al.  Introduction to machine learning , 2004, Adaptive computation and machine learning.

[2]  Enrico Blanzieri,et al.  Theoretical Interpretations and Applications of Radial Basis Function Networks , 2003 .

[3]  Guang-Bin Huang,et al.  Neuron selection for RBF neural network classifier based on data structure preserving criterion , 2005, IEEE Transactions on Neural Networks.

[4]  Andrew Chi-Sing Leung,et al.  On Objective Function, Regularizer, and Prediction Error of a Learning Algorithm for Dealing With Multiplicative Weight Noise , 2009, IEEE Transactions on Neural Networks.

[5]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[6]  Hoang Xuan Huan,et al.  Multivariate interpolation using radial basis function networks , 2009, Int. J. Data Min. Model. Manag..

[7]  M.H. Hassoun,et al.  Fundamentals of Artificial Neural Networks , 1996, Proceedings of the IEEE.

[8]  Jooyoung Park,et al.  Approximation and Radial-Basis-Function Networks , 1993, Neural Computation.

[9]  Toyoaki Nishida,et al.  Knowledge Flow Networks and Communities of Practice in Business Process Management , 2010 .

[10]  B. Barsky,et al.  An Introduction to Splines for Use in Computer Graphics and Geometric Modeling , 1987 .

[11]  Oleksandr Bezsonov,et al.  Function Approximation Using Robust Radial Basis Function Networks , 2011, J. Intell. Learn. Syst. Appl..

[12]  Narasimhan Sundararajan,et al.  A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation , 2005, IEEE Transactions on Neural Networks.

[13]  Dirk Baldwin,et al.  The Business of Online Education , 2007 .

[14]  Carl G. Looney,et al.  Pattern recognition using neural networks: theory and algorithms for engineers and scientists , 1997 .

[15]  L. Collatz.  Functional analysis and numerical mathematics , 1968 .

[16]  Nick Russell,et al.  The People Integration Challenge , 2009, Handbook of Research on Business Process Modeling.

[17]  Minhong Wang,et al.  Handbook of Research on Complex Dynamic Process Management , 2009 .

[18]  Huu Tue Huynh,et al.  A novel efficient two-phase algorithm for training interpolation radial basis function networks , 2007, Signal Process..

[19]  Friedhelm Schwenker,et al.  Three learning phases for radial-basis-function networks , 2001, Neural Networks.

[20]  Luis Weruaga,et al.  Sparse Multivariate Gaussian Mixture Regression , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[22]  S. Konishi,et al.  Nonlinear regression modeling via regularized radial basis function networks , 2008 .

[23]  Huu Tue Huynh,et al.  Efficient Algorithm for Training Interpolation RBF Networks With Equally Spaced Nodes , 2011, IEEE Transactions on Neural Networks.

[24]  Antonio J. Rivera,et al.  Training algorithms for Radial Basis Function Networks to tackle learning processes with imbalanced data-sets , 2014, Appl. Soft Comput..

[25]  Wil M. P. van der Aalst,et al.  Handbook of Research on Business Process Modeling , 2009 .

[26]  David Sundaram,et al.  Business Processes: Operational Solutions for SAP Implementation , 2005 .

[27]  Jayavel Sounderpandian,et al.  E-Business Process Management: Technologies and Solutions , 2007 .

[28]  James D. Keeler,et al.  Layered Neural Networks with Gaussian Hidden Units as Universal Approximations , 1990, Neural Computation.

[29]  Gregory E. Fasshauer,et al.  On choosing “optimal” shape parameters for RBF approximation , 2007, Numerical Algorithms.