论文信息 - Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix Products

Some Theorems on Matrix Differentiation with Special Reference to Kronecker Matrix Products

Abstract Matrix differentiation, the procedure of finding partial derivatives of the elements of a matrix function with respect to the elements of the argument matrix, is the subject matter of this paper. The method followed here amounts to linking the differentials of the matrix function and the argument matrix, and then identifying matrices of partial derivatives. The basic assumption made is mathematical independence of the elements of the argument matrix. Matrix functions are divided into two categories: Kronecker matrix products and non-Kronecker (= ordinary) matrix products. Three definitions of partial derivatives matrices are used, to be denoted by D 1, D 2 and D 3 in this abstract. D 2 and D 3 are applied to Kronecker products, D 1 is applied to ordinary products. This is a matter of efficiency only. D 1 is developed first. Transforming matrices into column vectors turns out to be very convenient. D 2 and D 3 are developed then. D 3 is a generalisation of D 1.

H. Neudecker

[1] H. W. Turnbull. On Differentiating a Matrix , 1928 .

[2] H. W. Turnbull. A Matrix Form of Taylor's Theorem , 1930 .

[3] H. W. Turnbull. Matrix Differentiation of the Characteristic Function , 1931 .

[4] P. S. Dwyer,et al. Symbolic Matrix Derivatives , 1948 .

[5] Ingram Olkin,et al. THE JACOBIANS OF CERTAIN MATRIX TRANSFORMATIONS USEFUL IN MULTIVARIATE ANALYSIS: BASED ON LECTURES OF P. L. HSU AT THE UNIVERSITY OF NORTH CAROLINA, 1947 , 1951 .

[6] Ingram Olkin,et al. NOTE ON ‘THE JACOBIANS OF CERTAIN MATRIX TRANSFORMATIONS USEFUL IN MULTIVARIATE ANALYSIS’ , 1953 .

[7] S. Kullback,et al. Some Aspects of Multivariate Analysis. , 1958 .

[8] Richard Bellman,et al. Introduction to Matrix Analysis , 1972 .

[9] T. Rothenberg,et al. Efficient Estimation of Simultaneous Equation Systems , 1964 .

[10] Henry Jack,et al. VII.—Jacobians of Transformations involving Orthogonal Matrices , 1965, Proceedings of the Royal Society of Edinburgh. Section A. Mathematical and Physical Sciences.

[11] P. S. Dwyer. Some Applications of Matrix Derivatives in Multivariate Analysis , 1967 .

[12] K. Wallis,et al. Stochastically Dependent Equations , 1967 .

[13] J. Conlisk. The Equilibrium Covariance Matrix of Dynamic Econometric Models , 1969 .