Semiparametric and Additive Model Selection Using an Improved Akaike Information Criterion

Abstract An improved AIC-based criterion is derived for model selection in general smoothing-based modeling, including semiparametric models and additive models. Examples are provided of applications to goodness-of-fit, smoothing parameter and variable selection in an additive model and semiparametric models, and variable selection in a model with a nonlinear function of linear terms.

[1]  Jeffrey S. Simonoff,et al.  An Improved Goodness-of-Fit Statistic for Sparse Multinomials , 1985 .

[2]  J. Shiau,et al.  Data-Driven Efficient Estimators for a Partially Linear Model , 1994 .

[3]  Hung Chen,et al.  A two-stage spline smoothing method for partially linear models , 1991 .

[4]  S. Self,et al.  An Efficient Estimator for the Generalized Semilinear Model , 1997 .

[5]  H. Akaike,et al.  Information Theory and an Extension of the Maximum Likelihood Principle , 1973 .

[6]  D. Ruppert,et al.  Trimmed Least Squares Estimation in the Linear Model , 1980 .

[7]  B. Silverman,et al.  Nonparametric Regression and Generalized Linear Models: A roughness penalty approach , 1993 .

[8]  P. Bickel,et al.  On Some Global Measures of the Deviations of Density Function Estimates , 1973 .

[9]  P. Speckman.  Kernel smoothing in partial linear models , 1988 .

[10]  W. Härdle,et al.  How Far are Automatically Chosen Regression Smoothing Parameters from their Optimum , 1988 .

[11]  B. Yandell,et al.  Automatic Smoothing of Regression Functions in Generalized Linear Models , 1986 .

[12]  Ja-Yong Koo,et al.  Spline Estimation of Discontinuous Regression Functions , 1997 .

[13]  R. Shibata.  An optimal selection of regression variables , 1981 .

[14]  J. H. Schuenemeyer,et al.  Generalized Linear Models (2nd ed.) , 1992 .

[15]  P. McCullagh,et al.  Generalized Linear Models, 2nd Edn. , 1990 .

[16]  R. Tibshirani,et al.  Generalized additive models for medical research , 1986, Statistical methods in medical research.

[17]  J. Nelder,et al.  An extended quasi-likelihood function , 1987 .

[18]  B. Silverman,et al.  Nonparametric regression and generalized linear models , 1994 .

[19]  J. Simonoff.  Smoothing Methods in Statistics , 1998 .

[20]  P. McCullagh,et al.  Generalized Linear Models , 1992 .

[21]  R. L. Eubank,et al.  Testing Goodness-of-Fit in Regression Via Order Selection Criteria , 1992 .

[22]  Jianqing Fan,et al.  Generalized Partially Linear Single-Index Models , 1997 .

[23]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[24]  S. Weisberg.  Plots, transformations, and regression , 1985 .

[25]  Jeffrey D. Hart,et al.  Nonparametric Smoothing and Lack-Of-Fit Tests , 1997 .

[26]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[27]  G. Wahba.  Smoothing noisy data with spline functions , 1975 .

[28]  Clifford M. Hurvich,et al.  Model selection for extended quasi-likelihood models in small samples. , 1995, Biometrics.

[29]  J. Simonoff.  Three Sides of Smoothing: Categorical Data Smoothing, Nonparametric Regression, and Density Estimation , 1998 .

[30]  Clifford M. Hurvich,et al.  Smoothing parameter selection in nonparametric regression using an improved Akaike information criterion , 1998 .