Maximum Likelihood and Least Squares Estimation in Linear and Affine Functional Models

In a linear (or affine) functional model the principal parameter is a subspace (respectively an affine subspace) in a finite dimensional inner product space, which contains the means of n multivariate normal populations, all having the same covariance matrix. A relatively simple, essentially algebraic derivation of the maximum likelihood estimates is given, when these estimates are based on single observed vectors from each of the n populations and an independent estimate of the common covariance matrix. A new derivation of least squares estimates is also given.

[1]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[2]  K. Fan.  On a Theorem of Weyl Concerning Eigenvalues of Linear Transformations: II. , 1949, Proceedings of the National Academy of Sciences of the United States of America.

[3]  T. W. Anderson.  Estimating Linear Restrictions on Regression Coefficients for Multivariate Normal Distributions , 1951 .

[4]  C. Villegas,et al.  Maximum Likelihood Estimation of a Linear Functional Relationship , 1961 .

[5]  Calyampudi R. Rao.  The use and interpretation of principal component analysis in applied research , 1964 .

[6]  Calyampudi Radhakrishna Rao,et al.  Linear Statistical Inference and its Applications , 1967 .

[7]  M. L. Eaton.  Gauss-Markov Estimation for Multivariate Linear Models: A Coordinate Free Approach , 1970 .

[8]  C. Villegas.  Bayesian Inference in Linear Relations , 1972 .

[9]  Linear Relations in Time Series Models. I. , 1976 .

[10]  Maximum Likelihood and Least Squares Estimation of Linear Functional Relationships , 1976 .

[11]  Hans-Peter Höschel.  Generalized least squares estimators of linear functional relations with known error-covariance , 1978 .

[12]  C. Radhakrishna Rao,et al.  Separation theorems for singular values of matrices and their applications in multivariate analysis , 1979 .

[13]  I. Olkin,et al.  Inequalities: Theory of Majorization and Its Applications , 1980 .

[14]  John D. Healy.  Maximum likelihood estimation of a multivariate linear functional relationship , 1980 .