Testing Simultaneous Diagonalizability

Abstract: This paper proposes novel methods to test for simultaneous diagonalization of possibly asymmetric matrices. Motivated by various applications, a two-sample test as well as a generalization for multiple matrices are proposed. A partial version of the test is also studied to check whether a partial set of eigenvectors is shared across samples. Additionally, a novel algorithm for the considered testing methods is introduced. Simulation studies demonstrate favorable performance for all designs. Finally, the theoretical results are utilized to decouple vector autoregression models into multiple univariate time series, and to test for the same stationary distribution in recurrent Markov chains. These applications are demonstrated using macroeconomic indices of 8 countries and streamflow data, respectively.

[1]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[2]  Helmut Lütkepohl,et al.  Modified wald tests under nonregular conditions , 1997 .

[3]  S. Mahmud,et al.  Macroeconometric modelling and Pakistan's economy: A vector autoregression approach , 1992 .

[4]  Zaka Ratsimalahelo.  Rank Test Based On Matrix Perturbation Theory , 2001 .

[5]  S. Sra,et al.  Matrix Differential Calculus , 2005 .

[6]  Stephen G. Donald,et al.  ON RANK ESTIMATION IN SYMMETRIC MATRICES: THE CASE OF INDEFINITE MATRIX ESTIMATORS , 2007, Econometric Theory.

[7]  Karim Abed-Meraim,et al.  A new Jacobi-like method for joint diagonalization of arbitrary non-defective matrices , 2009, Appl. Math. Comput..

[8]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[9]  S. Gratton,et al.  A short note on backward errors for the common eigenvector problem , 2022 .

[10]  W. Gautschi,et al.  An algorithm for simultaneous orthogonal transformation of several positive definite symmetric matrices to nearly diagonal form , 1986 .

[11]  Nikos Vlassis,et al.  Approximate Joint Matrix Triangularization , 2016, ArXiv.

[12]  Partial common principal component subspaces , 1999 .

[13]  S. Gratton,et al.  Newton's method for the common eigenvector problem , 2008 .

[14]  B. Nadler.  Finite sample approximation results for principal component analysis: a matrix perturbation approach , 2009, 0901.3245.

[15]  Mikhail Belkin,et al.  Consistency of spectral clustering , 2008, 0804.0678.

[16]  G. Box.  Some Theorems on Quadratic Forms Applied in the Study of Analysis of Variance Problems, I. Effect of Inequality of Variance in the One-Way Classification , 1954 .

[17]  Nikos Vlassis,et al.  Tensor Decomposition via Joint Matrix Schur Decomposition , 2016, ICML.

[18]  Rajeev Motwani,et al.  The PageRank Citation Ranking : Bringing Order to the Web , 1999, WWW 1999.

[19]  Philip Wolfe,et al.  An algorithm for quadratic programming , 1956 .

[20]  B. Rao.  Estimation of Functionals , 1983 .

[21]  Jianqing Fan,et al.  ESTIMATION OF FUNCTIONALS OF SPARSE COVARIANCE MATRICES. , 2014, Annals of statistics.

[22]  David E. Tyler.  Asymptotic Inference for Eigenvectors , 1981 .

[23]  Helmut Ltkepohl,et al.  New Introduction to Multiple Time Series Analysis , 2007 .

[24]  An approximate test for common principal component subspaces in two groups , 1993 .

[25]  David S. Moore,et al.  Generalized Inverses, Wald's Method, and the Construction of Chi-Squared Tests of Fit , 1977 .

[26]  Bin Yu,et al.  Spectral clustering and the high-dimensional stochastic blockmodel , 2010, 1007.1684.

[27]  Jianqing Fan,et al.  An l∞ Eigenvector Perturbation Bound and Its Application to Robust Covariance Estimation , 2018, Journal of machine learning research : JMLR.

[28]  J. Robin,et al.  TESTS OF RANK , 2000, Econometric Theory.

[29]  A. Rinaldo,et al.  Consistency of spectral clustering in stochastic block models , 2013, 1312.2050.

[30]  Carey E. Priebe,et al.  Limit theorems for eigenvectors of the normalized Laplacian for random graphs , 2016, The Annals of Statistics.

[31]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[32]  S. Johansen.  Estimation and Hypothesis Testing of Cointegration Vectors in Gaussian Vector Autoregressive Models , 1991 .

[33]  Jianqing Fan,et al.  Large covariance estimation by thresholding principal orthogonal complements , 2011, Journal of the Royal Statistical Society. Series B, Statistical methodology.

[34]  I. Jolliffe.  Principal Components in Regression Analysis , 1986 .

[35]  Vladimir Spokoiny,et al.  Bootstrap confidence sets for spectral projectors of sample covariance , 2017, Probability Theory and Related Fields.

[36]  Subhadeep Paul,et al.  Spectral and matrix factorization methods for consistent community detection in multi-layer networks , 2017, The Annals of Statistics.

[37]  T. Cai,et al.  Sparse PCA: Optimal rates and adaptive estimation , 2012, 1211.1309.

[38]  Thibault Espinasse,et al.  Estimating the transition matrix of a Markov chain observed at random times , 2014 .

[39]  Jianqing Fan,et al.  Hypothesis testing for eigenspaces of covariance matrix , 2020, 2002.09810.

[40]  T. Vogelsang.  Unit Roots, Cointegration, and Structural Change , 2001 .

[41]  E. Ott,et al.  Approximating the largest eigenvalue of network adjacency matrices. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[42]  Jonathan E. Taylor,et al.  Inference for eigenvalues and eigenvectors of Gaussian symmetric matrices , 2008, 0901.3290.

[43]  R. Paap,et al.  Generalized Reduced Rank Tests Using the Singular Value Decomposition , 2003 .

[44]  F. Chung.  Diameters and eigenvalues , 1989 .

[45]  C. Granger,et al.  Co-integration and error correction: representation, estimation and testing , 1987 .

[46]  V. Spokoiny,et al.  Bayesian inference for spectral projectors of the covariance matrix , 2017, 1711.11532.

[47]  D. Andrews.  Asymptotic Results for Generalized Wald Tests , 1987, Econometric Theory.

[48]  Karl Pearson F.R.S..  LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[49]  Eric Moreau,et al.  A fast algorithm for joint eigenvalue decomposition of real matrices , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[50]  Laurent Albera,et al.  Joint Eigenvalue Decomposition Using Polar Matrix Factorization , 2010, LVA/ICA.

[51]  Vladimir Koltchinskii,et al.  New Asymptotic Results in Principal Component Analysis , 2016, Sankhya A.

[52]  Ali S. Hadi,et al.  A note on generalized wald’s method , 1990 .

[53]  P. Robinson,et al.  Identifying Cointegration by Eigenanalysis , 2015, Journal of the American Statistical Association.

[54]  B. Flury.  Common Principal Components and Related Multivariate Models , 1988 .

[55]  Xiqi Gao,et al.  Simultaneous Diagonalization With Similarity Transformation for Non-Defective Matrices , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[56]  Asymptotic theory for common principal component analysis , 1986 .

[57]  B. Flury.  Common Principal Components in k Groups , 1984 .