Maximum likelihood estimation via the ECM algorithm: A general framework

Two major reasons for the popularity of the EM algorithm are that its maximum step involves only complete-data maximum likelihood estimation, which is often computationally simple, and that its convergence is stable, with each iteration increasing the likelihood. When the associated complete-data maximum likelihood estimation itself is complicated, EM is less attractive because the M-step is computationally unattractive. In many cases, however, complete-data maximum likelihood estimation is relatively simple when conditional on some function of the parameters being estimated

[1]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[2]  S. Lauritzen,et al.  Globally convergent algorithms for maximizing a likelihood function , 1991 .

[3]  Ronald A. Thisted,et al.  Elements of statistical computing , 1986 .

[4]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[5]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[6]  D. Rubin.  INFERENCE AND MISSING DATA , 1975 .

[7]  T. Szatrowski.  Explicit solutions, one iteration convergence and averaging in the multivariate normal estimation problem for patterned means and covariances , 1978 .

[8]  W. Rudin.  Principles of mathematical analysis , 1964 .

[9]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[10]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[11]  R. Jennrich,et al.  Unbalanced repeated-measures models with structured covariance matrices. , 1986, Biometrics.

[12]  S. Haberman,et al.  The analysis of frequency data , 1974 .

[13]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  New York Dover,et al.  ON THE CONVERGENCE PROPERTIES OF THE EM ALGORITHM , 1983 .

[15]  Xiao-Li Meng,et al.  On the rate of convergence of the ECM algorithm , 1994 .

[16]  Xiao-Li Meng,et al.  Using EM to Obtain Asymptotic Variance-Covariance Matrices: The SEM Algorithm , 1991 .

[17]  P. McMullen.  Convex Sets and Their Applications , 1982 .

[18]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[19]  A. Zellner.  An Efficient Method of Estimating Seemingly Unrelated Regressions and Tests for Aggregation Bias , 1962 .