A basis selection algorithm for wavelet neural networks

Abstract In this paper, a basis selection algorithm for wavelet neural networks is proposed. The algorithm repeatedly selects a wavelet basis to reduce residual error between network output and desired output. The newly selected wavelet is orthogonalized relative to all previously selected wavelets, and the optimal output weights are finally determined for all selected bases. The proposed approach has the advantage of being computationally less expensive than standard orthogonal least square algorithms. It also has better accuracy results than residual based selection algorithms.

[1]  S. Chen,et al.  Fast orthogonal least squares algorithm for efficient subset model selection , 1995, IEEE Trans. Signal Process..

[2]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[3]  Kwok-Wo Wong,et al.  Self-construction algorithm for synthesis of wavelet networks , 1998 .

[4]  Lennart Ljung,et al.  Nonlinear black-box modeling in system identification: a unified overview , 1995, Autom..

[5]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[6]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[7]  Shree K. Nayar,et al.  Automatic generation of RBF networks using wavelets , 1996, Pattern Recognit..

[8]  Yagyensh C. Pati,et al.  Analysis and synthesis of feedforward neural networks using discrete affine wavelet transformations , 1993, IEEE Trans. Neural Networks.

[9]  Jay A. Farrell,et al.  Wavelet-based system identification for nonlinear control , 1999, IEEE Trans. Autom. Control..

[10]  Jun Zhang,et al.  Wavelet neural networks for function learning , 1995, IEEE Trans. Signal Process..

[11]  Jean-Jacques E. Slotine,et al.  Space-frequency localized basis function networks for nonlinear system estimation and control , 1995, Neurocomputing.

[12]  D. D. Bruns,et al.  WaveARX neural network development for system identification using a systematic design synthesis , 1995 .

[13]  Charles K. Chui,et al.  An Introduction to Wavelets , 1992 .

[14]  Kwok-Wo Wong,et al.  On-line Successive Synthesis of Wavelet Networks , 1998, Neural Processing Letters.

[15]  Qinghua Zhang,et al.  Using wavelet network in nonparametric estimation , 1997, IEEE Trans. Neural Networks.