An Introduction to Wishart Matrix Moments

This article provides a comprehensive, rigorous, and self-contained introduction to the analysis of Wishart matrix moments. This article may act as an introduction to some aspects of random matrix theory, or as a self-contained exposition of Wishart matrix moments. Random matrix theory plays a central role in nuclear and statistical physics, computational mathematics and engineering sciences, including data assimilation, signal processing, combinatorial optimization, compressed sensing, econometrics and mathematical finance, among numerous others. The mathematical foundations of the theory of random matrices lies at the intersection of combinatorics, non-commutative algebra, geometry, multivariate functional and spectral analysis, and of course statistics and probability theory. As a result, most of the classical topics in random matrix theory are technical, and mathematically difficult to penetrate for non-experts and regular users and practitioners. The technical aim of this article is to review and extend some important results in random matrix theory in the specific context of real random Wishart matrices. This special class of Gaussian-type sample covariance matrix plays an important role in multivariate analysis and in statistical theory. We derive non-asymptotic formulae for the full matrix moments of real valued Wishart random matrices. As a corollary, we derive and extend a number of spectral and trace-type results for the case of non-isotropic Wishart random matrices. We also derive the full matrix moment analogues of some classic spectral and trace-type moment results. For example, we derive semi-circle and Marchencko-Pastur-type laws in the non-isotropic and full matrix cases. Laplace matrix transforms and matrix moment estimates are also studied, along with new spectral and trace concentration-type inequalities.

[1]  Gérard Letac,et al.  The noncentral Wishart as an exponential family, and its moments , 2008 .

[2]  F. Hwang,et al.  A simple and direct derivation for the number of noncrossing partitions , 1998 .

[3]  Maurice G. Kendall,et al.  The advanced theory of statistics , 1945 .

[4]  Takakazu Sugiyama,et al.  PERCENTILE POINTS OF THE LARGEST LATENT ROOT OF A MATRIX AND POWER CALCULATIONS FOR TESTING HYPOTHESIS Σ=I , 1973 .

[5]  G. D. Lin,et al.  Hardy's Condition in the Moment Problem for Probability Distributions , 2013 .

[6]  Pierre Del Moral,et al.  A perturbation analysis of stochastic matrix Riccati diffusions , 2017, Annales de l'Institut Henri Poincaré, Probabilités et Statistiques.

[7]  R. Muirhead.  Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[8]  L. Mirsky.  SYMMETRIC GAUGE FUNCTIONS AND UNITARILY INVARIANT NORMS , 1960 .

[9]  K. Phillips,et al.  R Functions to Symbolically Compute the Central Moments of the Multivariate Normal Distribution , 2010 .

[10]  Rodica Simion,et al.  On the structure of the lattice of noncrossing partitions , 1991, Discret. Math..

[11]  Wenchang Chu,et al.  Moments on Catalan numbers , 2009 .

[12]  Joel A. Tropp,et al.  User-Friendly Tail Bounds for Sums of Random Matrices , 2010, Found. Comput. Math..

[13]  G. C. Wick.  The Evaluation of the Collision Matrix , 1950 .

[14]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[15]  Aarnout Brombacher,et al.  Probability... , 2009, Qual. Reliab. Eng. Int..

[16]  E. Wigner.  Characteristic Vectors of Bordered Matrices with Infinite Dimensions I , 1955 .

[17]  V. Marčenko,et al.  DISTRIBUTION OF EIGENVALUES FOR SOME SETS OF RANDOM MATRICES , 1967 .

[18]  Alice Guionnet,et al.  Large Random Matrices: Lectures on Macroscopic Asymptotics , 2009 .

[19]  Gérard Letac,et al.  The Hyperoctahedral Group, Symmetric Group Representations and the Moments of the Real Wishart Distribution , 2005 .

[20]  L. W. Shapiro,et al.  A Catalan triangle , 1976, Discret. Math..

[21]  M. Stephanov,et al.  Random Matrices , 2005, hep-ph/0509286.

[22]  A. Guionnet,et al.  An Introduction to Random Matrices , 2009 .

[23]  Pierre Del Moral,et al.  Matrix product moments in normal variables , 2017, 1703.00353.

[24]  P. Moral.  Feynman-Kac Formulae: Genealogical and Interacting Particle Systems with Applications , 2004 .

[25]  Rodica Simion,et al.  Combinatorial Statistics on Non-crossing Partitions , 1994, J. Comb. Theory, Ser. A.

[26]  Pierre Del Moral,et al.  On the stability and the uniform propagation of chaos properties of Ensemble Kalman-Bucy filters , 2016, 1605.09329.

[27]  Heung-No Lee,et al.  Concise Probability Distributions of Eigenvalues of Real-Valued Wishart Matrices , 2014 .

[28]  Pierre Del Moral,et al.  Mean Field Simulation for Monte Carlo Integration , 2013 .

[29]  Germain Kreweras,et al.  Sur les partitions non croisees d'un cycle , 1972, Discret. Math..

[30]  M. Rudelson.  Random Vectors in the Isotropic Position , 1996, math/9608208.

[31]  R. Speicher,et al.  Lectures on the Combinatorics of Free Probability: The free commutator , 2006 .

[32]  Alice Guionnet,et al.  Large deviations for Wigner's law and Voiculescu's non-commutative entropy , 1997 .

[33]  T. Carleman.  Les fonctions quasi analytiques : leçons professées au Collège de France , 1926 .

[34]  Jack H. Winters,et al.  On the Capacity of Radio Communication Systems with Diversity in a Rayleigh Fading Environment , 1987, IEEE J. Sel. Areas Commun..

[35]  Pui Lam Leung,et al.  An identity for the noncentral wishart distribution with application , 1994 .

[36]  Hiroaki Yoshida,et al.  Some set partition statistics in non-crossing partitions and generating functions , 2007, Discret. Math..

[37]  M. Browne.  Asymptotically distribution-free methods for the analysis of covariance structures. , 1984, The British journal of mathematical and statistical psychology.

[38]  P. Krishnaiah,et al.  On the exact distribution of the smallest root of the wishart matrix using zonal polynomials , 1971 .

[39]  José Luis López-Bonilla,et al.  On Stirling numbers , 2018 .

[40]  Nachum Dershowitz,et al.  Ordered trees and non-crossing partitions , 1986, Discret. Math..

[41]  T. Tao.  Topics in Random Matrix Theory , 2012 .

[42]  H. W. Gould,et al.  Combinatorial Identities for Stirling Numbers: The Unpublished Notes of H W Gould , 2015 .

[43]  Patrick L. Combettes,et al.  Signal detection via spectral theory of large dimensional random matrices , 1992, IEEE Trans. Signal Process..

[44]  Roland Speicher,et al.  Free Probability and Random Matrices , 2014, 1404.3393.

[45]  Charalambos A. Charalambides,et al.  Enumerative combinatorics , 2018, SIGA.

[46]  D. R. Jensen.  The Joint Distribution of Traces of Wishart Matrices and Some Applications , 1970 .

[47]  L. Isserlis.  ON A FORMULA FOR THE PRODUCT-MOMENT COEFFICIENT OF ANY ORDER OF A NORMAL FREQUENCY DISTRIBUTION IN ANY NUMBER OF VARIABLES , 1918 .

[48]  M. Junge,et al.  On the Best Constants in Some Non‐Commutative Martingale Inequalities , 2005, math/0505309.

[49]  Derrick S. Tracy,et al.  Higher order moments of multivariate normal distribution using matrix derivatives , 1993 .

[50]  Moe Z. Win,et al.  On the marginal distribution of the eigenvalues of wishart matrices , 2009, IEEE Transactions on Communications.

[51]  Rodica Simion,et al.  Noncrossing partitions , 2000, Discret. Math..

[52]  N. Akhiezer,et al.  The Classical Moment Problem and Some Related Questions in Analysis , 2020 .

[53]  J. Bouchaud,et al.  Theory of Financial Risk and Derivative Pricing: From Statistical Physics to Risk Management , 2011 .

[54]  Igor Kortchemski,et al.  Simply Generated Non-Crossing Partitions , 2015, Combinatorics, Probability and Computing.

[55]  A. Edelman.  Eigenvalues and condition numbers of random matrices , 1988 .

[56]  Y. Yin.  Limiting spectral distribution for a class of random matrices , 1986 .

[57]  John Riordan,et al.  Enumeration of Plane Trees by Branches and Endpoints , 1975, J. Comb. Theory, Ser. A.

[58]  F. Götze,et al.  Rate of convergence in probability to the Marchenko-Pastur law , 2004 .

[59]  M. Junge,et al.  Noncommutative Burkholder/Rosenthal inequalities II: Applications , 2007, 0705.1952.

[60]  G. Letac,et al.  A tutorial on non central Wishart distributions , 2004 .

[61]  Jonas Schmitt.  Portfolio Selection Efficient Diversification Of Investments , 2016 .

[62]  P. Krishnaiah,et al.  A Limit Theorem for the Eigenvalues of Product of Two Random Matrices , 2003 .

[63]  E. Elton.  Modern portfolio theory and investment analysis , 1981 .

[64]  Se-jin Oh,et al.  Weight Multiplicities and Young Tableaux Through Affine Crystals , 2017, Memoirs of the American Mathematical Society.

[65]  Jordan Stoyanov,et al.  On the moment determinacy of products of non-identically distributed random variables , 2014, 1406.1654.

[66]  Ender Ayanoglu,et al.  An Upper Bound to the Marginal PDF of the Ordered Eigenvalues of Wishart Matrices and Its Application to MIMO Diversity Analysis , 2010, 2010 IEEE International Conference on Communications.

[67]  Gérard Letac,et al.  All Invariant Moments of the Wishart Distribution , 2004 .

[68]  J. Wishart.  THE GENERALISED PRODUCT MOMENT DISTRIBUTION IN SAMPLES FROM A NORMAL MULTIVARIATE POPULATION , 1928 .

[69]  Raymond Kan.  From moments of sum to moments of product , 2008 .

[70]  Hyundong Shin,et al.  On the capacity of doubly correlated MIMO channels , 2005, IEEE Transactions on Wireless Communications.

[71]  István Mezö,et al.  Real zeros and partitions without singleton blocks , 2007, Eur. J. Comb..

[72]  A. Ferrari,et al.  The noncentral wishart distribution: properties and application to speckle imaging , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[73]  J. Fournier.  Noncommutative Khintchine and Paley inequalities via generic factorization , 2014, 1407.2578.