Shrinkage estimation of the varying-coefficient model with continuous and categorical covariates

Abstract This paper studies shrinkage estimation of a general varying-coefficient model in Li and Racine (2010), with both continuous and categorical covariates. We propose a kernel least absolute shrinkage and selection operator (KLASSO) to implement estimation and variable selection for the model. We establish the estimation sparsity and oracle efficiency of the KLASSO estimator. We also provide a BIC-type criterion for tuning parameter selection and justify the model selection consistency. Simulation results suggest our method has a nice performance in terms of estimation errors and variable selection.

[1]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[2]  Qi Li,et al.  SMOOTH VARYING-COEFFICIENT ESTIMATION AND INFERENCE FOR QUALITATIVE AND QUANTITATIVE DATA , 2010, Econometric Theory.

[3]  Jianqing Fan,et al.  Statistical Methods with Varying Coefficient Models. , 2008, Statistics and its interface.

[4]  J. Aitchison,et al.  Multivariate binary discrimination by the kernel method , 1976 .

[5]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[6]  J. Horowitz,et al.  Asymptotic properties of bridge estimators in sparse high-dimensional regression models , 2008, 0804.0693.

[7]  Qi Zhang,et al.  Socioeconomic inequality of obesity in the United States: do gender, age, and ethnicity matter? , 2004, Social science & medicine.

[8]  Jianqing Fan,et al.  Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models , 2014, Journal of the American Statistical Association.

[9]  Yingcun Xia,et al.  Shrinkage Estimation of the Varying Coefficient Model , 2008 .

[10]  Shizhong Xu,et al.  Estimation and Inference in Generalized Additive Coefficient Models for Nonlinear Interactions with High-Dimensional Covariates. , 2015, Annals of statistics.

[11]  Chenlei Leng,et al.  Unified LASSO Estimation by Least Squares Approximation , 2007 .

[12]  B. Peng,et al.  Variable Selection for a Categorical Varying-Coefficient Model with Identifications for Determinants of Body Mass Index , 2015 .

[13]  Educational Differences in Obesity in the United States: A Closer Look at the Trends , 2012, Obesity.

[14]  H. Zou.  The Adaptive Lasso and Its Oracle Properties , 2006 .