ESTIMATION OF A PROJECTION-PURSUIT TYPE REGRESSION MODEL'

Since the pioneering work of Friedman and Stuetzle in 1981, projection-pursuit algorithms have attracted increasing attention. This is mainly due to their potential for overcoming or reducing difficulties arising in nonparametric regression models associated with the so-called curse of dimensionality, that is, the amount of data required to avoid an unacceptably large variance increasing rapidly with dimensionality. Subsequent work has, however, uncovered a dependence on dimensionality for projection-pursuit regression models. Here we propose a projection-pursuit type estimation scheme, with two additional constraints imposed, for which the rate of convergence of the estimator is shown to be independent of the dimensionality. Let (X, Y) be a random vector such that X = (X1, . . , Xd)T ranges over Rd. The conditional mean of Y given X = x is assumed to be the sum of no more than d general smooth functions of 87[x, where p3i E Sd-1, the unit sphere in Rd centered at the origin. A least-squares polynomial spline and the final prediction error criterion are used to fit the model to a random sample of size n from the distribution of (X, Y). Under appropriate conditions, the rate of convergence of the proposed estimator is independent of d.

[1]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[2]  D. Pollard.  Convergence of stochastic processes , 1984 .

[3]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[4]  Carl de Boor,et al.  On uniform approximation by splines , 1968 .

[5]  I. Johnstone,et al.  Projection-Based Approximation and a Duality with Kernel Methods , 1989 .

[6]  Jerome H. Friedman,et al.  SMART User's Guide , 1984 .

[7]  Prabir Burman,et al.  Estimation of generalized additive models , 1990 .

[8]  L. Schumaker.  Spline Functions: Basic Theory , 1981 .

[9]  R. Bellman,et al.  V. Adaptive Control Processes , 1964 .

[10]  P. Hall.  On Projection Pursuit Regression , 1989 .

[11]  C. J. Stone,et al.  OPTIMAL GLOBAL RATES OF CONVERGENCE FOR NONPARAMETRIC ESTIMATORS , 1982 .

[12]  R. Tibshirani,et al.  Linear Smoothers and Additive Models , 1989 .

[13]  P. Whittle,et al.  Bounds for the Moments of Linear and Quadratic Forms in Independent Variables , 1960 .

[14]  Ker-Chau Li,et al.  Asymptotic Optimality for $C_p, C_L$, Cross-Validation and Generalized Cross-Validation: Discrete Index Set , 1987 .

[15]  R. Z. Khasʹminskiĭ,et al.  Statistical estimation : asymptotic theory , 1981 .

[16]  H. Akaike.  A new look at the statistical model identification , 1974 .

[17]  Gene H. Golub,et al.  Matrix computations , 1983 .

[18]  J. Friedman,et al.  Multidimensional Additive Spline Approximation , 1983 .

[19]  P. Diaconis,et al.  On Nonlinear Functions of Linear Combinations , 1984 .