A parallel filtered-based EM algorithm for hidden Markov model and sinusoidal drift parameter estimation with systolic array implementation

In this paper we derive finite-dimensional discrete-time filters for estimating the parameters of discrete-time finite-state Markov chains imbedded in a mixture of Gaussian white noise and deterministic signals of known functional form with unknown parameters. The filters that we derive, estimate quantities used in the expectation-maximization (EM) algorithm for maximum likelihood (ML) estimation of the Markov chain parameters (transition probabilities and state levels) as well as the parameters of the deterministic interference. Specifically, we consider two important types of deterministic signals: Periodic, or almost periodic signals with unknown frequency components, amplitudes and phases; polynomial drift in the states of the Markov process with the coefficients of the polynomial unknown. The advantage of using filters in the EM algorithm is that they have negligible memory requirements, indeed independent of the number of observations. In comparison, implementing the EM algorithm using smoothed variables (forward-backward variables) requires memory proportional to the number of observations. In addition our filters are suitable for multiprocessor implementation whereas the forward-backward algorithm is not.<<ETX>>

[1]  John B. Moore,et al.  On-line estimation of hidden Markov model parameters based on the Kullback-Leibler information measure , 1993, IEEE Trans. Signal Process..

[2]  Omry Paiss Elimination of exponential interference form finite-length discrete signals , 1990, IEEE Trans. Acoust. Speech Signal Process..

[3]  Jerry M. Mendel,et al.  Optimal simultaneous detection and estimation of filtered discrete semi-Markov chains , 1988, IEEE Trans. Inf. Theory.

[4]  Vikram Krishnamurthy,et al.  Hidden Markov Model Signal Processing in Presence , 1996 .

[5]  F. Gland,et al.  MLE for partially observed diffusions: direct maximization vs. the em algorithm , 1989 .

[6]  Amir Dembo,et al.  Exact filters for the estimation of the number of transitions of finite-state continuous-time Markov processes , 1988, IEEE Trans. Inf. Theory.

[7]  P. Brémaud Point Processes and Queues , 1981 .

[8]  M. James,et al.  Time discretization of continuous-time filters for hidden Markov model parameter estimation , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[9]  W. Wonham Some applications of stochastic difierential equations to optimal nonlinear ltering , 1964 .

[10]  V Krishnamurthy,et al.  Adaptive processing techniques based on hidden Markov models for characterizing very small channel currents buried in noise and deterministic interferences. , 1991, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.