Optimal high-dimensional shrinkage covariance estimation for elliptical distributions

We derive an optimal shrinkage sample covariance matrix (SCM) estimator which is suitable for high dimensional problems and when sampling from an unspecified elliptically symmetric distribution. Specifically, we derive the optimal (oracle) shrinkage parameters that obtain the minimum mean-squared error (MMSE) between the shrinkage SCM and the true covariance matrix when sampling from an elliptical distribution. Subsequently, we show how the oracle shrinkage parameters can be consistently estimated under the random matrix theory regime. Simulations show the advantage of the proposed estimator over the conventional shrinkage SCM estimator due to Ledoit and Wolf (2004). The proposed shrinkage SCM estimator often provides significantly better performance than the Ledoit-Wolf estimator and has the advantage that consistency is guaranteed over the whole class of elliptical distributions with finite 4th order moments.

[1]  R. Muirhead Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[2]  H. Oja,et al.  Sign and Rank Covariance Matrices: Statistical Properties and Application to Principal Components Analysis , 2002 .

[3]  H. Vincent Poor,et al.  Complex Elliptically Symmetric Distributions: Survey, New Results and Applications , 2012, IEEE Transactions on Signal Processing.

[4]  S. Kotz,et al.  Symmetric Multivariate and Related Distributions , 1989 .

[5]  Esa Ollila,et al.  Regularized $M$ -Estimators of Scatter Matrix , 2014, IEEE Transactions on Signal Processing.

[6]  Yacine Chitour,et al.  Generalized Robust Shrinkage Estimator and Its Application to STAP Detection Problem , 2013, IEEE Transactions on Signal Processing.

[7]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[8]  Ami Wiesel,et al.  Automatic diagonal loading for Tyler's robust covariance estimator , 2016, 2016 IEEE Statistical Signal Processing Workshop (SSP).

[9]  Matthew R. McKay,et al.  Large dimensional analysis and optimization of robust shrinkage covariance matrix estimators , 2014, J. Multivar. Anal..

[10]  M. Srivastava Some Tests Concerning the Covariance Matrix in High Dimensional Data , 2005 .

[11]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[12]  Alfred O. Hero,et al.  Shrinkage Algorithms for MMSE Covariance Estimation , 2009, IEEE Transactions on Signal Processing.

[13]  P. Bentler,et al.  Greatest lower bound to the elliptical theory kurtosis parameter , 1986 .