Regressor selection and wavelet network construction

The wavelet network has been introduced as a special feedforward neural network supported by the wavelet theory. In this paper the construction of feedforward neural networks is discussed from the regressor selection point of view. This reveals that the wavelet network structure is well suited for developing constructive methods of feedforward networks. An efficient construction procedure of the wavelet network based on the orthogonal least squares method is then proposed.<<ETX>>

[1]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[2]  Qinghua Zhang.  Wavelet Network : The Radial Structure and an Efficient Initialization Procedure , 1992 .

[3]  Kumpati S. Narendra,et al.  Identification and control of dynamical systems using neural networks , 1990, IEEE Trans. Neural Networks.

[4]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[5]  A. Grossmann,et al.  DECOMPOSITION OF HARDY FUNCTIONS INTO SQUARE INTEGRABLE WAVELETS OF CONSTANT SHAPE , 1984 .

[6]  Etienne Barnard,et al.  Avoiding false local minima by proper initialization of connections , 1992, IEEE Trans. Neural Networks.

[7]  Y. Meyer.  Wavelets and Operators , 1993 .

[8]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.

[9]  L. Jones.  Constructive approximations for neural networks by sigmoidal functions , 1990, Proc. IEEE.

[10]  S. Mallat.  Multiresolution approximations and wavelet orthonormal bases of L^2(R) , 1989 .

[11]  Yagyensh C. Pati.  Wavelets and Time-Frequency Methods in Linear Systems and Neural Networks , 1992 .

[12]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[13]  Hecht-Nielsen.  Theory of the backpropagation neural network , 1989 .

[14]  Robert Hecht-Nielsen,et al.  Theory of the backpropagation neural network , 1989, International 1989 Joint Conference on Neural Networks.

[15]  Qinghua Zhang,et al.  Wavelet networks , 1992, IEEE Trans. Neural Networks.

[16]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[17]  Shang-Liang Chen,et al.  Orthogonal least squares learning algorithm for radial basis function networks , 1991, IEEE Trans. Neural Networks.

[18]  Eduardo D. Sontag,et al.  Feedforward Nets for Interpolation and Classification , 1992, J. Comput. Syst. Sci..

[19]  L. Ljung,et al.  Overtraining, Regularization, and Searching for Minimum in Neural Networks , 1992 .

[20]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[21]  Å. Björck.  Solving linear least squares problems by Gram-Schmidt orthogonalization , 1967 .

[22]  J. D. Powell,et al.  Radial basis function approximations to polynomials , 1989 .