Equivalence of maximum likelihood estimation and iterative two-stage estimation for seemingly unrelated regression models

The seemingly unrelated regression model is viewed in the context of repeated measures analysis. Regression parameters and the variance-covariance matrix of the seemingly unrelated regression model can be estimated by using two-stage Aitken estimation. The first stage is to obtain a consistent estimator of the variance-covariance matrix. The second stage uses this matrix to obtain the generalized least squares estimators of the regression parameters. The maximum likelihood (ML) estimators of the regression parameters can be obtained by performing the two-stage estimation iteratively. The iterative two-stage estimation procedure is shown to be equivalent to the EM algorithm (Dempster, Laird, and Rubin, 1977) proposed by Jennrich and Schluchter (1986) and Laird, Lange, and Stram (1987) for repeated measures data. The equivalence of the iterative two-stage estimator and the ML estimator has been previously demonstrated empirically in a Monte Carlo study by Kmenta and Gilbert (1968). It does not appear to be ...

[1]  L. Telser,et al.  Iterative Estimation of a Set of Linear Regression Equations , 1964 .

[2]  R. F. Gilbert,et al.  Small Sample Properties of Alternative Estimators of Seemingly Unrelated Regressions , 1968 .

[3]  R. Jennrich,et al.  Unbalanced repeated-measures models with structured covariance matrices. , 1986, Biometrics.

[4]  N. S. Revankar,et al.  Some Finite Sample Results in the Context of Two Seemingly Unrelated Regression Equations , 1974 .

[5]  N. Laird,et al.  Maximum likelihood computations with repeated measures: application of the EM algorithm , 1987 .

[6]  A. Zellner.  An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias , 1962 .

[7]  D O Stram,et al.  Analysing repeated measurements with possibly missing observations by modelling marginal distributions. , 1988, Statistics in medicine.

[8]  James K. Binkley,et al.  A note on the efficiency of seemingly unrelated regression , 1988 .

[9]  Daniel O. Stram,et al.  Analysis of Repeated Ordered Categorical Outcomes with Possibly Missing Observations and Time-Dependent Covariates , 1988 .

[10]  A. Verbyla.  Analysis of repeated measures designs with changing covariates , 1988 .

[11]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[12]  R. Potthoff,et al.  A generalized multivariate analysis of variance model useful especially for growth curve problems , 1964 .

[13]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[14]  G. Koch,et al.  The Equivalence of Parameter Estimates from Growth Curve Models and Seemingly Unrelated Regression Models , 1985 .

[15]  H. I. Patel.  Analysis of repeated measures designs with changing covariates in clinical trials , 1986 .

[16]  R. Woolson,et al.  Estimation of Growth Norms from Incomplete Longitudinal Data , 1987 .

[17]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[18]  Scott L. Zeger,et al.  Analyzing repeated measures on generalized linear models via the bootstrap , 1989 .