An Optimal Radial Basis Function (RBF) Neural Network for Hyper-surface Reconstruction

Data acquisition of chemical engineering processes is expensive and the collected data are always contaminated with inevitable measurement errors. Efficient algorithms are required to filter out the noise and capture the true underlying trend hidden in the training data sets. Regularization networks, which are the exact solution of multivariate linear regularization problem, provide appropriate facility to perform such a demanding task. These networks can be represented as a single hidden layer neural network with one neuron for each distinct exemplar. Efficient training of Regularization network requires calculation of linear synaptic weights, selection of isotropic spread (σ ) and computation of optimum level of regularization ( * λ ). The latter parameters (σ and * λ ) are highly correlated with each other. A novel method is presented in this article for development of a convenient procedure for decorrelating the above parameters and selecting the optimal values of * λ and * σ . The plot of

[1]  C. Micchelli Interpolation of scattered data: Distance matrices and conditionally positive definite functions , 1986 .

[2]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[3]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[4]  Giuseppe De Nicolao,et al.  Regularization networks: fast weight calculation via Kalman filtering , 2001, IEEE Trans. Neural Networks.

[5]  Venkat Venkatasubramanian,et al.  A neural network methodology for process fault diagnosis , 1989 .

[6]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[7]  A. Shahsavand,et al.  Application of optimal RBF neural networks for optimization and characterization of porous materials , 2005, Comput. Chem. Eng..

[8]  Josiah C. Hoskins,et al.  Artificial neural network models for knowledge representation in chemical engineering , 1990 .

[9]  T Poggio,et al.  Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks , 1990, Science.

[10]  Peter J. Gawthrop,et al.  Neural networks for control systems - A survey , 1992, Autom..

[11]  Richard K. Beatson,et al.  Smooth surface reconstruction from noisy range data , 2003, GRAPHITE '03.

[12]  Drew Seils,et al.  Optimal design , 2007 .

[13]  Akbar Shahsavand Optimal and adaptive radial basis function neural networks , 2000 .

[14]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[15]  Gene H. Golub,et al.  Matrix computations , 1983 .

[16]  Masashi Sugiyama,et al.  Optimal design of regularization term and regularization parameter by subspace information criterion , 2002, Neural Networks.