Doubly robust and efficient estimators for heteroscedastic partially linear single‐index models allowing high dimensional covariates

We study the heteroscedastic partially linear single-index model with an unspecified error variance function, which allows for high dimensional covariates in both the linear and the single-index components of the mean function. We propose a class of consistent estimators of the parameters by using a proper weighting strategy. An interesting finding is that the linearity condition which is widely assumed in the dimension reduction literature is not necessary for methodological or theoretical development: it contributes only to the simplification of non-optimal consistent estimation. We also find that the performance of the usual weighted least square type of estimators deteriorates when the non-parametric component is badly estimated. However, estimators in our family automatically provide protection against such deterioration, in that the consistency can be achieved even if the baseline non-parametric function is completely misspecified. We further show that the most efficient estimator is a member of this family and can be easily obtained by using non-parametric estimation. Properties of the estimators proposed are presented through theoretical illustration and numerical simulations. An example on gender discrimination is used to demonstrate and to compare the practical performance of the estimators.

[1]  Jianqing Fan,et al.  Nonconcave penalized likelihood with a diverging number of parameters , 2004, math/0406466.

[2]  Ker-Chau Li.  Sliced inverse regression for dimension reduction (with discussion) , 1991 .

[3]  Ker-Chau Li,et al.  Sliced Inverse Regression for Dimension Reduction , 1991 .

[4]  Hua Liang,et al.  Semiparametric GEE analysis in partially linear single-index models for longitudinal data , 2015, 1507.08473.

[5]  Jiti Gao,et al.  Estimation for Single-Index and Partially Linear Single-Index Nonstationary Time Series Models , 2014 .

[6]  R. Carroll,et al.  Semiparametric estimation in general repeated measures problems , 2006 .

[7]  A. Tsiatis.  Semiparametric Theory and Missing Data , 2006 .

[8]  Ker-Chau Li,et al.  On almost Linearity of Low Dimensional Projections from High Dimensional Data , 1993 .

[9]  Jane-ling Wang,et al.  Estimation for a partial-linear single-index model , 2009, 0905.2042.

[10]  Clive W. J. Granger,et al.  Semiparametric estimates of the relation between weather and electricity sales , 1986 .

[11]  Yingcun Xia,et al.  On extended partially linear single-index models , 1999 .

[12]  D. Ruppert,et al.  Penalized Spline Estimation for Partially Linear Single-Index Models , 2002 .

[13]  Qihua Wang,et al.  Semiparametric efficient estimation for partially linear single-index models with responses missing at random , 2014, J. Multivar. Anal..

[14]  Jianqing Fan,et al.  Generalized Partially Linear Single-Index Models , 1997 .

[15]  Lexin Li,et al.  Inference on the primary parameter of interest with the aid of dimension reduction estimation , 2011 .

[16]  Zhiqiang Tan,et al.  Nonparametric likelihood and doubly robust estimating equations for marginal and nested structural models , 2010 .

[17]  Yanyuan Ma,et al.  Efficient semiparametric estimator for heteroscedastic partially linear models , 2006 .

[18]  S. Christian Albright,et al.  Data Analysis and Decision Making with Microsoft Excel , 1999 .

[19]  Y. Xia,et al.  A Multiple-Index Model and Dimension Reduction , 2008 .

[20]  W. Härdle,et al.  Semi-parametric estimation of partially linear single-index models , 2006 .