Partial projective resampling method for dimension reduction: With applications to partially linear models

In many regression applications, the predictors naturally fall into two categories: "the predictors of primary interest" and "the predictors of secondary interest". It is often desirable to have a dimension reduction method that focuses on the predictors of primary interest while controlling the effect of the predictors of secondary interest. To achieve this goal, a partial dimension reduction method via projective resampling of a composite vector containing the response variable(s) and the predictors of secondary interest is proposed. The proposed method is general in the sense that the predictors of secondary interest can be quantitative, categorical or a combination of both. An application of the proposed method for estimation in partially linear models is emphasized. The performance of the proposed method is assessed and compared with other competing methods via extensive simulation. The empirical results show that, in addition to the superior estimation accuracy, the proposed method has a considerable computational advantage. We also demonstrate the usefulness of the proposed method by analyzing two real datasets.

[1]  Lexin Li,et al.  Inference on the primary parameter of interest with the aid of dimension reduction estimation , 2011 .

[2]  R. Cook,et al.  Fused Estimators of the Central Subspace in Sufficient Dimension Reduction , 2014 .

[3]  Xiangrong Yin,et al.  Stable Estimation in Dimension Reduction , 2015 .

[4]  L. Ferré.  Determining the Dimension in Sliced Inverse Regression and Related Methods , 1998 .

[5]  Bing Li,et al.  Dimension reduction for the conditional mean in regressions with categorical predictors , 2003 .

[6]  S. Weisberg,et al.  Comments on "Sliced inverse regression for dimension reduction" by K. C. Li , 1991 .

[7]  Jane-ling Wang,et al.  Estimation for a partial-linear single-index model , 2009, 0905.2042.

[8]  Zhou Yu,et al.  On Partial Sufficient Dimension Reduction With Applications to Partially Linear Multi-Index Models , 2013 .

[9]  Xuerong Meggie Wen.  A note on sufficient dimension reduction , 2007 .

[10]  Lixing Zhu,et al.  Sufficient dimension reduction through discretization-expectation estimation , 2010 .

[11]  Wolfgang Härdle,et al.  Partially Linear Models , 2000 .

[12]  Lixing Zhu,et al.  On Sliced Inverse Regression With High-Dimensional Covariates , 2006 .

[13]  Ruth M Pfeiffer,et al.  A Model Free Approach to Combining Biomarkers , 2008, Biometrical journal. Biometrische Zeitschrift.

[14]  Bing Li,et al.  Groupwise Dimension Reduction , 2010 .

[15]  R. Cook,et al.  Extending Sliced Inverse Regression , 2001 .

[16]  Xiangrong Yin.  NON‐PARAMETRIC ESTIMATION OF DIRECTION IN SINGLE‐INDEX MODELS WITH CATEGORICAL PREDICTORS , 2005 .

[17]  D. Ruppert,et al.  Penalized Spline Estimation for Partially Linear Single-Index Models , 2002 .

[18]  Ker-Chau Li,et al.  Sliced Inverse Regression for Dimension Reduction , 1991 .

[19]  Jianqing Fan,et al.  Generalized Partially Linear Single-Index Models , 1997 .

[20]  W. Härdle,et al.  Semi-parametric estimation of partially linear single-index models , 2006 .

[21]  R. H. Moore,et al.  Regression Graphics: Ideas for Studying Regressions Through Graphics , 1998, Technometrics.

[22]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[23]  Xiangrong Yin,et al.  Sufficient dimension reduction in multivariate regressions with categorical predictors , 2013, Comput. Stat. Data Anal..

[24]  R. Dennis Cook,et al.  Optimal sufficient dimension reduction in regressions with categorical predictors , 2002 .

[25]  Ker-Chau Li,et al.  On almost Linearity of Low Dimensional Projections from High Dimensional Data , 1993 .

[26]  B. Li,et al.  On a Projective Resampling Method for Dimension Reduction With Multivariate Responses , 2008 .