Comparing Correlation Matrix Estimators Via Kullback-Leibler Divergence

We use a self-averaging measure called Kullback-Leibler divergence to evaluate the performance of four different correlation estimators: Fourier, Pearson, Maximum Likelihood and Hayashi-Yoshida estimator. The study uses simulated transaction prices for a large number of stocks and different data generating mechanisms, including synchronous and non-synchronous transactions, homogeneous and heterogeneous inter-transaction time. Different distributions of stock returns, i.e. multivariate Normal and multivariate Student's t-distribution, are also considered. We show that Fourier and Pearson estimators are equivalent proxies of the `true' correlation matrix within all the settings under analysis, and that both methods are outperformed by the Maximum Likelihood estimator when prices are synchronously sampled and price fluctuations follow a multivariate Student's t-distribution. Finally, we suggest to solve the singularity problem affecting the Hayashi-Yoshida estimator by shrinking the correlation matrix towards either Pearson or Fourier matrices, and provide evidence that the resulting combination leads to an improved estimator with respect to its single components.

[1]  A. Stuart,et al.  Portfolio Selection: Efficient Diversification of Investments , 1959 .

[2]  W. H. Williams,et al.  Probability Theory and Mathematical Statistics , 1964 .

[3]  S. Ross The arbitrage theory of capital asset pricing , 1976 .

[4]  T. W. Epps Comovements in Stock Prices in the Very Short Run , 1979 .

[5]  A. Lo,et al.  Stock Market Prices Do Not Follow Random Walks: Evidence from a Simple Specification Test , 1987 .

[6]  A. Craig MacKinlay,et al.  Stock Market Prices Do Not Follow Random Walks: Evidence from a Simple Specification Test , 1988 .

[7]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[8]  Michel M. Dacorogna,et al.  Correlation of High Frequency Financial Time Series , 1998 .

[9]  James S. Harris,et al.  Probability theory and mathematical statistics , 1998 .

[10]  R. Mantegna Hierarchical structure in financial markets , 1998, cond-mat/9802256.

[11]  J. Bouchaud,et al.  Theory Of Financial Risk And Derivative Pricing , 2000 .

[12]  R. Gencay,et al.  An Introduc-tion to High-Frequency Finance , 2001 .

[13]  P. Embrechts,et al.  Risk Management: Correlation and Dependence in Risk Management: Properties and Pitfalls , 2002 .

[14]  Maria Elvira Mancino,et al.  Fourier series method for measurement of multivariate volatilities , 2002, Finance Stochastics.

[15]  P. Embrechts,et al.  Correlation and Dependency in Risk Management , 2002 .

[16]  Olivier Ledoit,et al.  Honey, I Shrunk the Sample Covariance Matrix , 2003 .

[17]  Thorsten Rheinländer Risk Management: Value at Risk and Beyond , 2003 .

[18]  Piazza S. Francesco,et al.  A CLOSER LOOK AT THE EPPS EFFECT , 2003 .

[19]  M. Martens Estimating Unbiased and Precise Realized Covariances , 2004 .

[20]  Olivier Ledoit,et al.  A well-conditioned estimator for large-dimensional covariance matrices , 2004 .

[21]  N. Yoshida,et al.  On covariance estimation of non-synchronously observed diffusion processes , 2005 .

[22]  G. Iori,et al.  Cross-correlation Measures in the High-frequency Domain , 2005 .

[23]  A. Lunde,et al.  Integrated Covariance Estimation using High-frequency Data in the Presence of Noise , 2006 .

[24]  M. Tumminello,et al.  Kullback-Leibler distance as a measure of the information filtered from multivariate data. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  G. Biroli,et al.  The Student ensemble of correlation matrices: eigenvalue spectrum and Kullback-Leibler entropy , 2007, 0710.0802.

[26]  M. Tumminello,et al.  Hierarchically nested factor model from multivariate data , 2007 .

[27]  Toshiya Hoshikawa,et al.  Nonparametric Estimation Methods of Integrated Multivariate Volatilities , 2008 .

[28]  Fabrizio Lillo,et al.  Correlation, Hierarchies, and Networks in Financial Markets , 2008, 0809.4615.

[29]  P. Malliavin,et al.  A Fourier transform method for nonparametric estimation of multivariate volatility , 2009, 0908.1890.

[30]  M. Tumminello,et al.  When do improved covariance matrix estimators enhance portfolio optimization? An empirical comparative study of nine estimators , 2010, 1004.4272.

[31]  S. Sanfelici,et al.  Estimating Covariance Via Fourier Method in the Presence of Asynchronous Trading and Microstructure Noise , 2011 .