Forward/backwardstate and modelparameter estimation for continuum-state hidden Markov models (CHMM) with Dirichlet state distributions

In this paper, the foundations of the theory of the continuum-state HMM (cHMM) are extended to include a forward/ backward algorithm producing probability densities analogous to those in conventional HMMs, and algorithms for estimating the parameters of the state transition density and the constituent output densities. The α and β densities are approximated as Dirichlet distributions, providing for nearly closed form, “closed” operations. The EM algorithm is extended to apply to the parameter estimation problem. Major results are presented, with details and proofs omitted due to space.

[1]  L. Prasanth,et al.  HMM-Based Online Handwriting Recognition System for Telugu Symbols , 2007 .

[2]  T. Moon The expectation-maximization algorithm , 1996, IEEE Signal Process. Mag..

[3]  Mark J. F. Gales,et al.  The Application of Hidden Markov Models in Speech Recognition , 2007, Found. Trends Signal Process..

[4]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[5]  Todd K. Moon,et al.  Continuum-state hidden Markov models with dirichlet state distributions , 2013, ICASSP.

[6]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[7]  Fazel Naghdy,et al.  Human Motion Recognition through Fuzzy Hidden Markov Model , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[8]  T. Moon Error Correction Coding: Mathematical Methods and Algorithms , 2005 .

[9]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .