Function approximation using artificial neural networks

Function approximation, which finds the underlying relationship from a given finite input-output data is the fundamental problem in a vast majority of real world applications, such as prediction, pattern recognition, data mining and classification. Various methods have been developed to address this problem, where one of them is by using artificial neural networks. In this paper, the radial basis function network and the wavelet neural network are applied in estimating periodic, exponential and piecewise continuous functions. Different types of basis functions are used as the activation function in the hidden nodes of the radial basis function network and the wavelet neural network. The performance is compared by using the normalized square root mean square error function as the indicator of the accuracy of these neural network models.

[1]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[2]  Leonardo Maria Reyneri,et al.  A comparison between weighted radial basis functions and wavelet networks , 1998, ESANN.

[3]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[4]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[5]  Wang Ting,et al.  A wavelet neural network for the approximation of nonlinear multivariable function , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[6]  Q. Zhang,et al.  Approximation by nonlinear wavelet networks , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[7]  David J. Evans,et al.  Optimization of learning methods for face recognition using multilayer perceptrons , 2001, SIP.

[8]  Abdulhamit Subasi,et al.  Wavelet neural network classification of EEG signals by using AR model with MLE preprocessing , 2005, Neural Networks.

[9]  David J. Evans,et al.  Human Face Recognition Using Accelerated Multilayer Perceptrons , 2003, Int. J. Comput. Math..

[10]  Eds Chapter 1st International Symposium on Neuro-Fuzzy Systems : AT'96, August 29-31, 1996, EPFL-Lausanne, Switzerland : conference report , 1996 .

[11]  Eric A. Rying,et al.  Focused local learning with wavelet neural networks , 2002, IEEE Trans. Neural Networks.

[12]  M. Moraud Wavelet Networks , 2018, Foundations of Wavelet Networks and Applications.

[13]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[14]  Peter Tino,et al.  IEEE Transactions on Neural Networks , 2009 .

[15]  Qinghua Zhang,et al.  Using wavelet network in nonparametric estimation , 1997, IEEE Trans. Neural Networks.

[16]  L. M. Reyneri Uni cation of Neural and Fuzzy Computing Paradigms , 1996 .

[17]  Abdulhamit Subasi,et al.  Epileptic seizure detection using dynamic wavelet network , 2005, Expert Syst. Appl..