Robust estimation for varying index coefficient models

Varying index coefficient models (VICMs) proposed by Ma and Song (J Am Stat Assoc, 2014. doi:10.1080/01621459.2014.903185) are a new class of semiparametric models, which encompass most of the existing semiparametric models. So far, only the profile least squares method and local linear fitting were developed for the VICM, which are very sensitive to the outliers and will lose efficiency for the heavy tailed error distributions. In this paper, we propose an efficient and robust estimation procedure for the VICM based on modal regression which depends on a bandwidth. We establish the consistency and asymptotic normality of proposed estimators for index coefficients by utilizing profile spline modal regression method. The oracle property of estimators for the nonparametric functions is also established by utilizing a two-step spline backfitted local linear modal regression approach. In addition, we discuss the bandwidth selection for achieving better robustness and efficiency and propose a modified expectation–maximization-type algorithm for the proposed estimation procedure. Finally, simulation studies and a real data analysis are carried out to assess the finite sample performance of the proposed method.

[1]  J. Horowitz,et al.  VARIABLE SELECTION IN NONPARAMETRIC ADDITIVE MODELS. , 2010, Annals of statistics.

[2]  Hua Liang,et al.  ESTIMATION AND VARIABLE SELECTION FOR GENERALIZED ADDITIVE PARTIAL LINEAR MODELS. , 2011, Annals of statistics.

[3]  Jianqing Fan,et al.  Efficient Estimation and Inferences for Varying-Coefficient Models , 2000 .

[4]  Jianqing Fan,et al.  Local polynomial modelling and its applications , 1994 .

[5]  Zhike Lv,et al.  Robust variable selection for nonlinear models with diverging number of parameters , 2014 .

[6]  Jane-ling Wang,et al.  Estimation for a partial-linear single-index model , 2009, 0905.2042.

[7]  Jianqing Fan,et al.  Nonparametric Inferences for Additive Models , 2005 .

[8]  Nian-Sheng Tang,et al.  Varying coefficient partially functional linear regression models , 2016 .

[9]  L. Schumaker.  Spline Functions: Basic Theory , 1981 .

[10]  Runze Li,et al.  Local modal regression , 2012, Journal of nonparametric statistics.

[11]  James O. Ramsay,et al.  Functional Data Analysis , 2005 .

[12]  Lixing Zhu,et al.  The EFM approach for single-index models , 2011, 1211.5220.

[13]  Philippe Vieu,et al.  Variable selection in infinite-dimensional problems , 2014 .

[14]  Riquan Zhang,et al.  Profile empirical-likelihood inferences for the single-index-coefficient regression model , 2013, Stat. Comput..

[15]  Aldo Goia,et al.  A partitioned Single Functional Index Model , 2015, Comput. Stat..

[16]  Li Wang,et al.  Simultaneous variable selection and estimation in semiparametric modeling of longitudinal/clustered data , 2013, 1302.0151.

[17]  Riquan Zhang,et al.  A robust and efficient estimation method for single index models , 2013, J. Multivar. Anal..

[18]  Shizhong Xu,et al.  Semiparametric nonlinear regression for detecting gene and environment interactions , 2015 .

[19]  Lixing Zhu,et al.  On an asymptotically more efficient estimation of the single-index model , 2010, J. Multivar. Anal..

[20]  Liugen Xue,et al.  Statistical inference for a single-index varying-coefficient model , 2013, Stat. Comput..

[21]  D. Gale.  The Game of Hex and the Brouwer Fixed-Point Theorem , 1979 .

[22]  P. Massart,et al.  Invariance principles for absolutely regular empirical processes , 1995 .

[23]  Philippe Vieu,et al.  Partial linear modelling with multi-functional covariates , 2015, Comput. Stat..

[24]  Chaohui Guo,et al.  A robust and efficient estimation method for single-index varying-coefficient models , 2014 .

[25]  R. Tibshirani,et al.  Varying‐Coefficient Models , 1993 .

[26]  Weihua Zhao,et al.  Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression , 2013, Annals of the Institute of Statistical Mathematics.

[27]  Liugen Xue,et al.  Empirical likelihood for single-index varying-coefficient models , 2012 .

[28]  P. X. Song,et al.  Varying Index Coefficient Models , 2015 .

[29]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[30]  H. Tong,et al.  Article: 2 , 2002, European Financial Services Law.

[31]  Frédéric Ferraty,et al.  Variable selection in partial linear regression with functional covariate , 2015 .

[32]  Jianqing Fan,et al.  Statistical Methods with Varying Coefficient Models. , 2008, Statistics and its interface.