James-Stein-Type Estimators in Large Samples With Application to the Least Absolute Deviations Estimator

We explore the extension of James–Stein–type estimators in a direction that enables them to preserve their superiority when the sample size goes to infinity. Instead of shrinking a base estimator toward a fixed point, we shrink it toward a data-dependent point. We provide an analytic expression for the asymptotic risk and bias of James–Stein–type estimators shrunk toward a data-dependent point and prove that they have smaller asymptotic risk than the base estimator. Shrinking an estimator toward a data-dependent point turns out to be equivalent to combining two random variables using the James–Stein rule. We propose a general combination scheme that includes random combination (the James–Stein combination) and the usual nonrandom combination as special cases. As an example, we apply our method to combine the least absolute deviations estimator and the least squares estimator. Our simulation study indicates that the resulting combination estimators have desirable finite-sample properties when errors are drawn from symmetric distributions. Finally, using stock return data, we present some empirical evidence that the combination estimators have the potential to improve out-of-sample prediction in terms of both mean squared error and mean absolute error.

[1]  Arthur Cohen,et al.  Combining Estimates of Location , 1976 .

[2]  Relative performance of stein-rule and preliminary test estimators in linear models: Least squares theory , 1987 .

[3]  A. Ullah Finite Sample Econometrics: A Unified Approach , 1990 .

[4]  L. Breiman Better subset regression using the nonnegative garrote , 1995 .

[5]  Ian Barrodale,et al.  Algorithm 478: Solution of an Overdetermined System of Equations in the l1 Norm [F4] , 1974, Commun. ACM.

[6]  Shrinking Techniques for Robust Regression , 1989 .

[7]  Rand R. Wilcox,et al.  The statistical implications of pre-test and Stein-rule estimators in econometrics , 1978 .

[8]  P. Sen,et al.  On preliminary test and shrinkage m-estimation in linear models , 1987 .

[9]  H. White,et al.  Determination of Estimators with Minimum Asymptotic Covariance Matrices , 1993, Econometric Theory.

[10]  P. Sen,et al.  On the asymptotic distributional risk properties of pre-test and shrinkage L 1 -estimators , 1987 .

[11]  On shrinkage r-estimation in a multiple regression model , 1986 .

[12]  L. Breiman Heuristics of instability and stabilization in model selection , 1996 .

[13]  C. Stein Inadmissibility of the Usual Estimator for the Mean of a Multivariate Normal Distribution , 1956 .

[14]  C. Stein,et al.  Estimation with Quadratic Loss , 1992 .

[15]  R. W. Farebrother,et al.  The statistical implications of pre-test and Stein-rule estimators in econometrics , 1978 .

[16]  William E. Strawderman,et al.  A James-Stein Type Estimator for Combining Unbiased and Possibly Biased Estimators , 1991 .

[17]  Pranab Kumar Sen,et al.  On Some Shrinkage Estimators of Multivariate Location , 1985 .

[18]  Yadolah Dodge,et al.  Mathematical Programming In Statistics , 1981 .

[19]  P. Sen,et al.  On shrinkage m-estimators of location parameters , 1985 .