Shrinkage estimation and variable selection in multiple regression models with random coefficient autoregressive errors

Abstract In this paper, we consider improved estimation strategies for the parameter vector in multiple regression models with first-order random coefficient autoregressive errors (RCAR(1)). We propose a shrinkage estimation strategy and implement variable selection methods such as lasso and adaptive lasso strategies. The simulation results reveal that the shrinkage estimators perform better than both lasso and adaptive lasso when and only when there are many nuisance variables in the model.

[1]  Chunming Zhang,et al.  Penalized Bregman divergence for large-dimensional regression and classification. , 2010, Biometrika.

[2]  R. Tibshirani,et al.  PATHWISE COORDINATE OPTIMIZATION , 2007, 0708.1485.

[3]  B. G. Quinn,et al.  Random Coefficient Autoregressive Models: An Introduction , 1982 .

[4]  I. Basawa,et al.  Parameter estimation in a regression model with random coefficient autoregressive errors , 1993 .

[5]  I. Basawa,et al.  The local asymptotic normality of a class of generalized random coefficient autoregressive processes , 1997 .

[6]  S. Rosset,et al.  Piecewise linear regularized solution paths , 2007, 0708.2197.

[7]  Rand R. Wilcox,et al.  The statistical implications of pre-test and Stein-rule estimators in econometrics , 1978 .

[8]  Nozer D. Singpurwalla,et al.  Assessing (Software) Reliability Growth Using a Random Coefficient Autoregressive Process and Its Ramifications , 1985, IEEE Transactions on Software Engineering.

[9]  S. E. Ahmed.  Shrinkage Estimation of Regression Coefficients From Censored Data With Multiple Observations , 2001 .

[10]  S. Ahmed,et al.  Shrinkage estimation for the regression parameter matrix in multivariate regression model , 2012 .

[11]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[12]  Arnold Zellner,et al.  An Econometric Model of the United Kingdom , 1962 .

[13]  K. Doksum,et al.  L 1 penalty and shrinkage estimation in partially linear models with random coefficient autoregressive errors , 2012 .

[14]  K. Lange,et al.  Coordinate descent algorithms for lasso penalized regression , 2008, 0803.3876.

[15]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[16]  H. Zou.  The Adaptive Lasso and Its Oracle Properties , 2006 .

[17]  Lon-Mu Liu,et al.  Random coefficient first-order autoregressive models , 1980 .

[18]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .