Transformation-based estimation

To alleviate the computational burden of making the relevant estimation algorithms stable for nonlinear and semiparametric regression models with, particularly, high-dimensional data, a transformation-based method combining sufficient dimension reduction approach is proposed. To this end, model-independent transformations are introduced to models under study. This generic methodology can be applied to transformation models; generalized linear models; and their corresponding quantile regression variants. The constructed estimates almost have closed forms in certain sense such that the above goals can be achieved. Simulation results show that, in finite sample cases with high-dimensional predictors and long-tailed distributions of error, the new estimates often exhibit a smaller degree of variance, and have much less computational burden than the classical methods such as the classical least squares and quantile regression estimation.

[1]  Ker-Chau Li,et al.  Sliced Inverse Regression for Dimension Reduction , 1991 .

[2]  R. Serfling Approximation Theorems of Mathematical Statistics , 1980 .

[3]  H. Zou,et al.  Composite quantile regression and the oracle Model Selection Theory , 2008, 0806.2905.

[4]  Lixing Zhu,et al.  An alternating determination-optimization approach for an additive multi-index model , 2012, Comput. Stat. Data Anal..

[5]  B. Li,et al.  Dimension reduction for nonelliptically distributed predictors , 2009, 0904.3842.

[6]  Bing Li,et al.  Dimension reduction for non-elliptically distributed predictors: second-order methods , 2010 .

[7]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[8]  R. Koenker Quantile Regression: Fundamentals of Quantile Regression , 2005 .

[9]  Lixing Zhu,et al.  Nonparametric Monte Carlo tests for multivariate distributions , 2000 .

[10]  R. H. Moore,et al.  Regression Graphics: Ideas for Studying Regressions Through Graphics , 1998, Technometrics.

[11]  H. Tong,et al.  An adaptive estimation of dimension reduction space, with discussion , 2002 .

[12]  Lixing Zhu,et al.  Sufficient dimension reduction through discretization-expectation estimation , 2010 .

[13]  Yuexiao Dong Dimension reduction for non-elliptically distributed predictors , 2009 .

[14]  Runze Li,et al.  NEW EFFICIENT ESTIMATION AND VARIABLE SELECTION METHODS FOR SEMIPARAMETRIC VARYING-COEFFICIENT PARTIALLY LINEAR MODELS. , 2011, Annals of statistics.

[15]  H. Zha,et al.  Contour regression: A general approach to dimension reduction , 2005, math/0508277.

[16]  Liping Zhu,et al.  Efficiency loss and the linearity condition in dimension reduction , 2013 .

[17]  C. Stein Estimation of the Mean of a Multivariate Normal Distribution , 1981 .

[18]  Prasad A. Naik,et al.  Single‐index model selections , 2001 .

[19]  Liping Zhu,et al.  A Semiparametric Approach to Dimension Reduction , 2012, Journal of the American Statistical Association.

[20]  Lixing Zhu,et al.  Nonparametric Monte Carlo tests and their applications , 2005 .

[21]  H. Tong,et al.  Article: 2 , 2002, European Financial Services Law.

[22]  S. Weisberg,et al.  Comments on "Sliced inverse regression for dimension reduction" by K. C. Li , 1991 .

[23]  J. Tukey On the Comparative Anatomy of Transformations , 1957 .

[24]  Jian Huang,et al.  A semiparametric approach for the nonparametric transformation survival model with multiple covariates. , 2007, Biostatistics.