论文信息 - Statistical Analysis of the Main Parameters in the Definition of Radial Bases Function Networks

Statistical Analysis of the Main Parameters in the Definition of Radial Bases Function Networks

As there are many possibilities to select the set of basic functions, parameters and operators used in the design of a Radial Basis Function network (RBF) and in general in Artificial Neural Networks, the search for operators and parameters that are most suitable for the design of an RBF, its characterization and evaluation, is an important topic in the field of Neural Network design. A better insight into the performance of the alternative parameters in the design of an RBF (the distance used, the number of neurons and their nonlinear function in the hidden layer, the number of bits used for weight storage, etc) would make it easier to develop a practical application that uses this type of neural network. In the present contribution, the relevance and relative importance of the parameters involved in the design of an RBF are investigated by using a statistical tool, the ANalysis Of the VAriance (ANOVA)[9]. In order to analyzed the behaviour of the RBF, three different examples were used: the recognition of 26 different letters represented as a 5 by 7 grid of integer values, chaos time-series prediction using the Mackey-Glass differential equation and finally function estimation from samples. This methodology can also be applied to others Neural Networks. The results obtained show that the type of function in the hidden layer and the distance used are the most relevant factors in the behaviour of an RBF. Moreover, this statistical analysis is able to establish a classification of latter factors according to their intrinsic characteristics.

[1] Yung C. Shin,et al. Radial basis function neural network for approximation and estimation of nonlinear stochastic dynamic systems , 1994, IEEE Trans. Neural Networks.

[2] Bruce A. Whitehead,et al. Cooperative-competitive genetic evolution of radial basis function centers and widths for time series prediction , 1996, IEEE Trans. Neural Networks.

[3] Ioannis Pitas,et al. Median radial basis function neural network , 1996, IEEE Trans. Neural Networks.

[4] Paolo Frasconi,et al. Learning without local minima in radial basis function networks , 1995, IEEE Trans. Neural Networks.

[5] John Moody,et al. Fast Learning in Networks of Locally-Tuned Processing Units , 1989, Neural Computation.

[6] Martin Brown,et al. Neurofuzzy adaptive modelling and control , 1994 .

[7] G. Casella,et al. Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[8] Jooyoung Park,et al. Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.

[9] Vladimir Cherkassky,et al. Comparison of adaptive methods for function estimation from samples , 1996, IEEE Trans. Neural Networks.

[10] R. L. Hardy. Multiquadric equations of topography and other irregular surfaces , 1971 .

[11] Radu Dogaru,et al. A modified RBF neural network for efficient current-mode VLSI implementation , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.