Testing the Diagonality of a Large Covariance Matrix in a Regression Setting

In multivariate analysis, the covariance matrix associated with a set of variables of interest (namely response variables) commonly contains valuable information about the dataset. When the dimension of response variables is considerably larger than the sample size, it is a nontrivial task to assess whether there are linear relationships between the variables. It is even more challenging to determine whether a set of explanatory variables can explain those relationships. To this end, we develop a bias-corrected test to examine the significance of the off-diagonal elements of the residual covariance matrix after adjusting for the contribution from explanatory variables. We show that the resulting test is asymptotically normal. Monte Carlo studies and a numerical example are presented to illustrate the performance of the proposed test.

[1]  Mark M. Carhart.  On Persistence in Mutual Fund Performance , 1997 .

[2]  S. John.  Some optimal multivariate tests , 1971 .

[3]  Jianhua Z. Huang.  Covariance selection and estimation via penalised normal likelihood , 2005 .

[4]  Chenlei Leng,et al.  A moving average Cholesky factor model in covariance modelling for longitudinal data , 2012 .

[5]  M. Yuan,et al.  Model selection and estimation in regression with grouped variables , 2006 .

[6]  Gregory Connor,et al.  A Test for the Number of Factors in an Approximate Factor Model , 1993 .

[7]  Wolfgang Härdle,et al.  Partially Linear Models , 2000 .

[8]  D. Edwards.  Introduction to graphical modelling , 1995 .

[9]  Leon Jay Gleser,et al.  A Note on the Sphericity Test , 1966 .

[10]  Olivier Ledoit,et al.  Honey, I Shrunk the Sample Covariance Matrix , 2003 .

[11]  Jianqing Fan,et al.  High dimensional covariance matrix estimation using a factor model , 2007, math/0701124.

[12]  J. W. Silverstein,et al.  Spectral Analysis of Large Dimensional Random Matrices , 2009 .

[13]  B. Efron.  Are a set of microarrays independent of each other? , 2009, The annals of applied statistics.

[14]  N. Meinshausen,et al.  High-dimensional graphs and variable selection with the Lasso , 2006, math/0608017.

[15]  James R. Schott,et al.  Testing for complete independence in high dimensions , 2005 .

[16]  Chenlei Leng,et al.  Sparse Matrix Graphical Models , 2012 .

[17]  Jing Lv,et al.  A moving average Cholesky factor model in covariance modeling for composite quantile regression with longitudinal data , 2017, Comput. Stat. Data Anal..

[18]  Song-xi Chen,et al.  Tests for High-Dimensional Covariance Matrices , 2010, Random Matrices: Theory and Applications.

[19]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[20]  Charles Trzcinka,et al.  On the Number of Factors in the Arbitrage Pricing Model , 1986 .

[21]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[22]  P. Hall,et al.  Martingale Limit Theory and its Application. , 1984 .

[23]  J. Lintner.  THE VALUATION OF RISK ASSETS AND THE SELECTION OF RISKY INVESTMENTS IN STOCK PORTFOLIOS AND CAPITAL BUDGETS , 1965 .

[24]  Marcelo J. Moreira,et al.  Asymptotic power of sphericity tests for high-dimensional data , 2013, 1306.4867.

[25]  E. Fama,et al.  Common risk factors in the returns on stocks and bonds , 1993 .

[26]  E. Fama,et al.  Multifactor Explanations of Asset Pricing Anomalies , 1996 .

[27]  J. Mossin.  EQUILIBRIUM IN A CAPITAL ASSET MARKET , 1966 .

[28]  P J Diggle,et al.  Nonparametric estimation of covariance structure in longitudinal data. , 1998, Biometrics.

[29]  H. Nagao,et al.  On Some Test Criteria for Covariance Matrix , 1973 .

[30]  Narasimhan Jegadeesh,et al.  Returns to Buying Winners and Selling Losers: Implications for Stock Market Efficiency , 1993 .

[31]  Stephen J. Brown.  The Number of Factors in Security Returns , 1989 .

[32]  Jianqing Fan,et al.  Sparsistency and Rates of Convergence in Large Covariance Matrix Estimation. , 2007, Annals of statistics.

[33]  Jianhua Z. Huang,et al.  Covariance matrix selection and estimation via penalised normal likelihood , 2006 .

[34]  R. Christensen.  Introduction to Graphical Modeling , 2001 .

[35]  W. Sharpe.  CAPITAL ASSET PRICES: A THEORY OF MARKET EQUILIBRIUM UNDER CONDITIONS OF RISK* , 1964 .

[36]  H. Müller,et al.  Local Polynomial Modeling and Its Applications , 1998 .

[37]  Y. Xia,et al.  A Multiple-Index Model and Dimension Reduction , 2008 .

[38]  P. Hall,et al.  Martingale Limit Theory and Its Application , 1980 .

[39]  C. Anderson‐Cook,et al.  An Introduction to Multivariate Statistical Analysis (3rd ed.) (Book) , 2004 .

[40]  Olivier Ledoit,et al.  Some hypothesis tests for the covariance matrix when the dimension is large compared to the sample size , 2002 .

[41]  R. Kohn,et al.  Parsimonious Covariance Matrix Estimation for Longitudinal Data , 2002 .

[42]  M. Drton,et al.  Model selection for Gaussian concentration graphs , 2004 .

[43]  J. Magnus.  The Exact Moments of a Ratio of Quadratic Forms in Normal Variables , 1986 .

[44]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[45]  M. Srivastava.  Some Tests Concerning the Covariance Matrix in High Dimensional Data , 2005 .