Efficient estimation for time series following generalized linear models

In this paper, we consider James–Stein shrinkage and pretest estimation methods for time series following generalized linear models when it is conjectured that some of the regression parameters may be restricted to a subspace. Efficient estimation strategies are developed when there are many covariates in the model and some of them are not statistically significant. Statistical properties of the pretest and shrinkage estimation methods including asymptotic distributional bias and risk are developed. We investigate the relative performances of shrinkage and pretest estimators with respect to the unrestricted maximum partial likelihood estimator (MPLE). We show that the shrinkage estimators have a lower relative mean squared error as compared to the unrestricted MPLE when the number of significant covariates exceeds two. Monte Carlo simulation experiments were conducted for different combinations of inactive covariates and the performance of each estimator was evaluated in terms of its mean squared error. The practical benefits of the proposed methods are illustrated using two real data sets.

[1]  Anthony S. Tay,et al.  Direction-of-Change Forecasts Based on Conditional Variance, Skewness and Kurtosis Dynamics: International Evidence , 2006 .

[2]  P. Sen,et al.  On preliminary test and shrinkage m-estimation in linear models , 1987 .

[3]  Benjamin Kedem,et al.  Partial Likelihood Inference For Time Series Following Generalized Linear Models , 2004 .

[4]  W. Wong.  Theory of Partial Likelihood , 1986 .

[5]  Francis X. Diebold,et al.  The Rodney L. White Center for Financial Research Financial Asset Returns, Direction-of-Change Forecasting and Volatility , 2003 .

[6]  Benjamin Kedem,et al.  Regression Models for Time Series Analysis: Kedem/Time Series Analysis , 2005 .

[7]  J. Cavanaugh,et al.  Partial Likelihood , 2018, Wiley StatsRef: Statistics Reference Online.

[8]  Chih-Ling Tsai,et al.  Regression coefficient and autoregressive order shrinkage and selection via the lasso , 2007 .

[9]  K. Doksum,et al.  L 1 penalty and shrinkage estimation in partially linear models with random coefficient autoregressive errors , 2012 .

[10]  K. Doksum,et al.  SHRINKAGE, PRETEST AND ABSOLUTE PENALTY ESTIMATORS IN PARTIALLY LINEAR MODELS , 2007 .

[11]  Pranab Kumar Sen,et al.  Risk comparison of some shrinkage M-estimators in linear models , 2006 .

[12]  S. Nkurunziza.  Preliminary test and estimation in some multifactor diffusion processes , 2013, Sankhya A.

[13]  S. Ejaz Ahmed,et al.  Shrinkage, pretest, and penalty estimators in generalized linear models , 2015 .

[14]  Henri Nyberg,et al.  Studies on Binary Time Series Models with Applications to Empirical Macroeconomics and Finance , 2010 .

[15]  S. Nkurunziza.  Extension of some important identities in shrinkage-pretest strategies , 2013 .

[16]  Marwan A. Al-Momani,et al.  Shrinkage and LASSO strategies in high-dimensional heteroscedastic models , 2016 .

[17]  M. Leung,et al.  Forecasting Stock Indices: A Comparison of Classification and Level Estimation Models , 1999 .

[18]  Rongning Wu,et al.  Shrinkage estimation for linear regression with ARMA errors , 2012 .

[19]  Shakhawat Hossain,et al.  Shrinkage and Penalty Estimators of a Poisson Regression Model , 2012 .

[20]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[21]  Bonnie K. Ray,et al.  Regression Models for Time Series Analysis , 2003, Technometrics.

[22]  S. Hossain,et al.  Application of shrinkage estimation in linear regression models with autoregressive errors , 2015 .

[23]  Arjun K. Gupta,et al.  Improved Estimation in a Contingency Table: Independence Structure , 1989 .

[24]  K. Fokianos.  Penalized Estimation for Integer Autoregressive Models , 2010 .