Adaptive LASSO for linear regression models with ARMA-GARCH errors

ABSTRACT The linear regression models with the autoregressive moving average (ARMA) errors (REGARMA models) are often considered, in order to reflect a serial correlation among observations. In this article, we focus on an adaptive least absolute shrinkage and selection operator (LASSO) (ALASSO) method for the variable selection of the REGARMA models and extend it to the linear regression models with the ARMA-generalized autoregressive conditional heteroskedasticity (ARMA-GARCH) errors (REGARMA-GARCH models). This attempt is an extension of the existing ALASSO method for the linear regression models with the AR errors (REGAR models) proposed by Wang et al. in 2007. New ALASSO algorithms are proposed to determine important predictors for the REGARMA and REGARMA-GARCH models. Finally, we provide the simulation results and real data analysis to illustrate our findings.

[1]  J. Friedman,et al.  [A Statistical View of Some Chemometrics Regression Tools]: Response , 1993 .

[2]  Pierre Alquier,et al.  Sparsity considerations for dependent variables , 2011, 1102.1615.

[3]  Hao Helen Zhang,et al.  Adaptive Lasso for Cox's proportional hazards model , 2007 .

[4]  Chih-Ling Tsai,et al.  A Joint Regression Variable and Autoregressive Order Selection Criterion , 2004 .

[5]  R. Tibshirani,et al.  Sparsity and smoothness via the fused lasso , 2005 .

[6]  Ruey S. Tsay Regression Models with Time Series Errors , 1984 .

[7]  Chih-Ling Tsai,et al.  Regression coefficient and autoregressive order shrinkage and selection via the lasso , 2007 .

[8]  Ding Yi,et al.  Time series analysis and its application , 2008, 2008 Chinese Control and Decision Conference.

[9]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[10]  H. Zou The Adaptive Lasso and Its Oracle Properties , 2006 .

[11]  C. A. Glasbey,et al.  Examples of regression with serially correlated errors , 1988 .

[12]  J. Friedman,et al.  A Statistical View of Some Chemometrics Regression Tools , 1993 .

[13]  J. Zakoian,et al.  Maximum likelihood estimation of pure GARCH and ARMA-GARCH processes , 2004 .

[14]  G. Casella,et al.  The Bayesian Lasso , 2008 .

[15]  Taewook Lee,et al.  Penalized regression models with autoregressive error terms , 2013 .

[16]  Sarah Eichmann Introductory Econometrics With Applications , 2016 .

[17]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .