Ridge Functions and Orthonormal Ridgelets

Orthonormal ridgelets provide an orthonormal basis for L^2(R^2) built from special angularly-integrated ridge functions. In this paper we explore the relationship between orthonormal ridgelets and true ridge functions r(x"[email protected]+x"[email protected]). We derive a formula for the ridgelet coefficients of a ridge function in terms of the 1-D wavelet coefficients of the ridge profile r(t). The formula shows that the ridgelet coefficients of a ridge function are heavily concentrated in ridge parameter space near the underlying scale, direction, and location of the ridge function. It also shows that the rearranged weighted ridgelet coefficients of a ridge function decay at essentially the same rate as the rearranged weighted 1-D wavelet coefficients of the 1-D ridge profile r(t). In short, the full ridgelet expansion of a ridge function is in a certain sense equally as sparse as the 1-D wavelet expansion of the ridge profile. It follows that partial ridgelet expansions can give good approximations to objects which are countable superpositions of well-behaved ridge functions. We study the nonlinear approximation operator which ''kills'' coefficients below certain thresholds (depending on angular- and ridge-scale); we show that for approximating objects which are countable superpositions of ridge functions with 1-D ridge profiles in the Besov space B^1^/^p"p"," "p(R), 0

[1]  David L. Donoho,et al.  Nonlinear Pyramid Transforms Based on Median-Interpolation , 2000, SIAM J. Math. Anal..

[2]  Y. Meyer,et al.  Ondelettes et bases hilbertiennes. , 1986 .

[3]  J. Peetre,et al.  Interpolation of normed abelian groups , 1972 .

[4]  David L. Donoho,et al.  Orthonormal Ridgelets and Linear Singularities , 2000, SIAM J. Math. Anal..

[5]  George G. Lorentz,et al.  Constructive Approximation , 1993, Grundlehren der mathematischen Wissenschaften.

[6]  D. Donoho,et al.  Tight frames of k-plane ridgelets and the problem of representing objects that are smooth away from d-dimensional singularities in Rn. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[7]  E. Candès Harmonic Analysis of Neural Networks , 1999 .

[8]  C. Chui Wavelets: A Mathematical Tool for Signal Analysis , 1997 .

[9]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[10]  L. Jones A Simple Lemma on Greedy Approximation in Hilbert Space and Convergence Rates for Projection Pursuit Regression and Neural Network Training , 1992 .

[11]  Noboru Murata,et al.  An Integral Representation of Functions Using Three-layered Networks and Their Approximation Bounds , 1996, Neural Networks.

[12]  B. Logan,et al.  Optimal reconstruction of a function from its projections , 1975 .

[13]  Emmanuel J. Cand Harmonic Analysis of Neural Networks , 1998 .

[14]  Andrew R. Barron,et al.  Universal approximation bounds for superpositions of a sigmoidal function , 1993, IEEE Trans. Inf. Theory.