Recursive Parameter Estimation Using Incomplete Data

Abstract : Stochastic approximation procedures are considered for the estimation of parameters using incomplete data. One procedure is stated and illustrated which often leads to asymptotically efficient estimators. Others are developed which, although possibly not optimal in the above sense, will be very much easier to apply. This will be particularly advantageous when quick recursive estimates are required. Examples are given and a link is made between one of the sub-optimal methods and the EM algorithm. (Author)

[1]  J. Sacks.  Asymptotic Distribution of Stochastic Approximation Procedures , 1958 .

[2]  Strother H. Walker,et al.  Estimation of the probability of an event as a function of several independent variables. , 1967, Biometrika.

[3]  V. Fabian.  On Asymptotic Normality in Stochastic Approximation , 1968 .

[4]  F. Downton.  Stochastic Approximation , 1969, Nature.

[5]  J. Behboodian.  Information matrix for a mixture of two normal distributions , 1972 .

[6]  D. M. Titterington,et al.  Updating a Diagnostic System using Unconfirmed Cases , 1976 .

[7]  Mikhail Borisovich Nevelʹson,et al.  Stochastic Approximation and Recursive Estimation , 1976 .

[8]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[9]  A. F. M. Smith,et al.  A quasi-Bayes unsupervised learning procedure for priors (Corresp.) , 1977, IEEE Trans. Inf. Theory.

[10]  Demetrios Kazakos,et al.  Recursive estimation of prior probabilities using a mixture , 1977, IEEE Trans. Inf. Theory.

[11]  A. F. Smith,et al.  A Quasi‐Bayes Sequential Procedure for Mixtures , 1978 .

[12]  V. Fabian.  On Asymptotically Efficient Recursive Estimation , 1978 .

[13]  J. Anderson.  Multivariate logistic compounds , 1979 .

[14]  D.G. Dudley,et al.  Dynamic system identification experiment design and data analysis , 1979, Proceedings of the IEEE.

[15]  D. M. Titterington,et al.  Aspects of Optimal Design in Dynamic Systems , 1980 .

[16]  Udi E. Makov.  On the choice of gain functions in recursive estimation of prior probabilities (Corresp.) , 1980, IEEE Trans. Inf. Theory.

[17]  D. Titterington,et al.  ‘Recursive estimation procedures for missing-data problems’ , 1983 .