Selection of the splined variables and convergence rates in a partial spline model

A method based on the principle of unbiased risk estimation is used to select the splined variables in an exploratory partial spline model proposed by Wahba (1985). The probability of correct selection based on the proposed procedure is discussed under regularity conditions. Furthermore, the resulting estimate of the regression function achieves the optimal rates of convergence over a general class of smooth regression functions (Stone 1982) when its underlying smoothness condition is not known. Une methode basee sur le principe de l'estimation sans biais du risque est utilisee dans le but de selecuonner les variables “splines” dans un modele propose par Wahba ( 1985 ). La probabilite d'une selection correcte est etudiee sous certaines conditions de regularite. L'estimateur obtenu pour la fonction de regression atteint le taux de convergence optimal relativement a une classe generate de fonctions de regression lisses (Stone 1982).

[1]  A. A. Weiss,et al.  Semiparametric estimates of the relation between weather and electricity sales , 1986 .

[2]  Hung Chen,et al.  Convergence Rates for Parametric Components in a Partly Linear Model , 1988 .

[3]  C. J. Stone,et al.  Consistent Nonparametric Regression , 1977 .

[4]  G. Wahba Smoothing noisy data with spline functions , 1975 .

[5]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[6]  Hung Chen,et al.  A two-stage spline smoothing method for partially linear models , 1991 .

[7]  J. Rice Bandwidth Choice for Nonparametric Regression , 1984 .

[8]  J. Friedman,et al.  Projection Pursuit Regression , 1981 .

[9]  C. J. Stone,et al.  Optimal Rates of Convergence for Nonparametric Estimators , 1980 .

[10]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[11]  H. Akaike A new look at the statistical model identification , 1974 .

[12]  W. J. Studden,et al.  Asymptotic Integrated Mean Square Error Using Least Squares and Bias Minimizing Splines , 1980 .

[13]  R. Shibata An optimal selection of regression variables , 1981 .

[14]  Ker-Chau Li,et al.  Asymptotic Optimality for $C_p, C_L$, Cross-Validation and Generalized Cross-Validation: Discrete Index Set , 1987 .

[15]  C. J. Stone,et al.  OPTIMAL UNIFORM RATE OF CONVERGENCE FOR NONPARAMETRIC ESTIMATORS OF A DENSITY FUNCTION OR ITS DERIVATIVES , 1983 .

[16]  Grace Wahba,et al.  Discussion: Projection Pursuit , 1985 .

[17]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[18]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[19]  P. Whittle,et al.  Bounds for the Moments of Linear and Quadratic Forms in Independent Variables , 1960 .

[20]  R. Jennrich Asymptotic Properties of Non-Linear Least Squares Estimators , 1969 .