Symmetry, 0-1 Matrices and Jacobians: A Review

In this paper we bring together those properties of the Kronecker product, the vec operator, and 0-1 matrices which in our view are of interest to researchers and students in econometrics and statistics. The treatment of Kronecker products and the vec operator is fairly exhaustive; the treatment of 0–1 matrices is selective. In particular we study the “commutation” matrix K (defined implicitly by K vec A = vec A′ for any matrix A of the appropriate order), the idempotent matrix N = ½ (I + K), which plays a central role in normal distribution theory, and the “duplication” matrix D, which arises in the context of symmetry. We present an easy and elegant way (via differentials) to evaluate Jacobian matrices (first derivatives), Hessian matrices (second derivatives), and Jacobian determinants, even if symmetric matrix arguments are involved. Finally we deal with the computation of information matrices in situations where positive definite matrices are arguments of the likelihood function.

[1]  W. E. Roth.  On direct product matrices , 1934 .

[2]  W. Ledermann,et al.  VI.—On Singular Pencils of Zehfuss, Compound, and Schläflian Matrices , 1937 .

[3]  F. G. W. BROWN,et al.  The Theory of Group Representations , 1940, Nature.

[4]  A. C. Aitken.  On the Wishart distribution in statistics. , 1949, Biometrika.

[5]  A. Ac.  On the Wishart distribution in statistics. , 1949 .

[6]  T. Koopmans.  Statistical inference in dynamic economic models , 1951 .

[7]  Ingram Olkin,et al.  THE JACOBIANS OF CERTAIN MATRIX TRANSFORMATIONS USEFUL IN MULTIVARIATE ANALYSIS: BASED ON LECTURES OF P. L. HSU AT THE UNIVERSITY OF NORTH CAROLINA, 1947 , 1951 .

[8]  Ingram Olkin,et al.  NOTE ON ‘THE JACOBIANS OF CERTAIN MATRIX TRANSFORMATIONS USEFUL IN MULTIVARIATE ANALYSIS’ , 1953 .

[9]  M. N. Vartak.  On an Application of Kronecker Product of Matrices to Statistical Designs , 1955 .

[10]  Richard Bellman,et al.  Introduction to Matrix Analysis , 1972 .

[11]  Henry Jack,et al.  VII.—Jacobians of Transformations involving Orthogonal Matrices , 1965, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[12]  H. Neudecker.  The Kronecker Matrix Product and Some of its Applications in Econometrics , 1968 .

[13]  H. Neudecker.  Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix Products , 1969 .

[14]  Paul S. Dwyer,et al.  Multivariate Maxima and Minima with Matrix Derivatives , 1969 .

[15]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[16]  I. Olkin,et al.  Jacobians of matrix transformations and induced functional equations , 1972 .

[17]  M. Browne.  Generalized Least Squares Estimators in the Analysis of Covariance Structures. , 1973 .

[18]  S. Barnett,et al.  Matrix Differential Equations and Kronecker Products , 1973 .

[19]  Symmetric Functions in Statistics , 1974 .

[20]  J. Richard.  A note on the information matrix of the multivariate normal distribution , 1975 .

[21]  W. Vetter.  Vector structures and solutions of linear matrix equations , 1975 .

[22]  R. Hartwig,et al.  The universal flip matrix and the generalized faro-shuffle. , 1975 .

[23]  S. R. Searle,et al.  Vec and vech operators for matrices, with some uses in jacobians and multivariate statistics , 1979 .

[24]  J. Magnus,et al.  The Commutation Matrix: Some Properties and Applications , 1979 .

[25]  Jan R. Magnus,et al.  The Elimination Matrix: Some Lemmas and Applications , 1980, SIAM J. Algebraic Discret. Methods.

[26]  J. Edward Jackson.  The Algebra of Econometrics , 1980 .

[27]  A note on the characteristic polynomial of the commutation matrix , 1981 .

[28]  S. R. Searle,et al.  The Vec-Permutation Matrix, the Vec Operator and Kronecker Products: A Review , 1981 .

[29]  The Algebra of Econometrics , 1982 .

[30]  R. Muirhead.  Aspects of Multivariate Statistical Theory , 1982, Wiley Series in Probability and Statistics.

[31]  Jan R. Magnus,et al.  L-structured matrices and linear matrix equations , 1983 .

[32]  H. Neudecker.  On Jacobians of transformations with skew-symmetric, strictly (lower) triangular or diagonal matrix arguments , 1983 .

[33]  Tom Wansbeek,et al.  Some results on commutation matrices, with statistical applications , 1983 .

[34]  P. Phillips.  The Exact Distribution of LIML: II , 1984 .

[35]  J. Magnus,et al.  Matrix differential calculus with applications to simple, Hadamard, and Kronecker products. , 1985 .

[36]  D.S.G. Pollock,et al.  Tensor products and matrix differential calculus , 1985 .

[37]  G. Hillier.  On the Joint and Marginal Densities of Instrumental Variable Estimators in a General Structural Equation , 1985, Econometric Theory.

[38]  D. Wiens.  On some pattern-reduction matrices which appear in statistics , 1985 .