A UNIFIED VARIABLE SELECTION APPROACH FOR VARYING COEFFICIENT MODELS

In varying coefficient models, three types of variable selection problems are of practical interests: separation of varying and constant effects, selection of variables with nonzero varying effects, and selection of variables with nonzero con- stant effects. Existing variable selection methods in the literature often focus on only one of the three types. In this paper, we develop a unified variable selection approach for both least squares regression and quantile regression models with pos- sibly varying coefficients. The developed method is carried out by using a two-step iterative procedure based on basis expansion and a double adaptive-LASSO-type penalty. Under some regularity conditions, we show that the proposed procedure is consistent in both variable selection and the separation of varying and constant coefficients. In addition, the estimated varying coefficients possess the optimal con- vergence rate under the same smoothness assumption, and the estimated constant coefficients have the same asymptotic distribution as their counterparts obtained when the true model is known. Finally, we investigate the finite sample perfor- mance of the proposed method through a simulation study and the analysis of the Childhood Malnutrition Data in India.

[1]  Runze Li,et al.  Quadratic Inference Functions for Varying‐Coefficient Models with Longitudinal Data , 2006, Biometrics.

[2]  C. J. Stone,et al.  Optimal Global Rates of Convergence for Nonparametric Regression , 1982 .

[3]  R. Koenker.  Additive models for quantile regression: Model selection and confidence bandaids , 2010 .

[4]  G. Schwarz.  Estimating the Dimension of a Model , 1978 .

[5]  Chin-Tsang Chiang,et al.  KERNEL SMOOTHING ON VARYING COEFFICIENT MODELS WITH LONGITUDINAL DEPENDENT VARIABLE , 2000 .

[6]  J. Horowitz,et al.  VARIABLE SELECTION IN NONPARAMETRIC ADDITIVE MODELS. , 2010, Annals of statistics.

[7]  Pin T. Ng,et al.  Quantile smoothing splines , 1994 .

[8]  C. J. Stone,et al.  Additive Regression and Other Nonparametric Models , 1985 .

[9]  Yingcun Xia,et al.  Shrinkage Estimation of the Varying Coefficient Model , 2008 .

[10]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[11]  P. Shi,et al.  Convergence rate of b-spline estimators of nonparametric conditional quantile functions ∗ , 1994 .

[12]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[13]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[14]  Yingcun Xia,et al.  Efficient estimation for semivarying‐coefficient models , 2004 .

[15]  Hao Helen Zhang,et al.  Component selection and smoothing in multivariate nonparametric regression , 2006, math/0702659.

[16]  Jianqing Fan,et al.  Efficient Estimation and Inferences for Varying-Coefficient Models , 2000 .

[17]  Jianhua Z. Huang,et al.  Variable Selection in Nonparametric Varying-Coefficient Models for Analysis of Repeated Measurements , 2008, Journal of the American Statistical Association.

[18]  Tao Hu,et al.  ADAPTIVE SEMI-VARYING COEFFICIENT MODEL SELECTION , 2012 .

[19]  Jianhua Z. Huang,et al.  Polynomial Spline Estimation and Inference for Varying Coefficient Models with Longitudinal Data , 2003 .

[20]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[21]  Jianqing Fan,et al.  Profile likelihood inferences on semiparametric varying-coefficient partially linear models , 2005 .

[22]  Xuming He,et al.  Conditional growth charts , 2006 .

[23]  Chenlei Leng,et al.  A simple approach for varying-coefficient model selection , 2009 .

[24]  Liugen Xue,et al.  Variable selection for semiparametric varying coefficient partially linear models , 2009 .

[25]  Jianhua Z. Huang,et al.  Varying‐coefficient models and basis function approximations for the analysis of repeated measurements , 2002 .

[26]  Hung Chen,et al.  Polynomial splines and nonparametric regression , 1991 .

[27]  Mi-Ok Kim,et al.  Quantile regression with varying coefficients , 2007, 0708.0471.

[28]  Jianhui Zhou,et al.  Quantile regression in partially linear varying coefficient models , 2009, 0911.3501.

[29]  H. Zou.  The Adaptive Lasso and Its Oracle Properties , 2006 .

[30]  W. W. Daniel.  Applied Nonparametric Statistics , 1979 .

[31]  Torsten Hothorn,et al.  Identifying Risk Factors for Severe Childhood Malnutrition by Boosting Additive Quantile Regression , 2011 .

[32]  L. Schumaker.  Spline Functions: Basic Theory , 1981 .