Continuum-state hidden Markov models with dirichlet state distributions

In some modeling scenarios, particularly those representing data from natural sources, the discrete states conventionally used in hidden Markov models (HMMs) are at best an approximation, since the discrete states are a modeling artifact. In this paper we present an HMM in which the states take any value in a simplex. The Dirichlet distribution is used to provide a parsimonious representation of the distribution of the states. Conditional state estimates using an extension of the conventional forward/backward method, using Dirichlet distributions to provide a nearly closed-form, but approximate, representation.

[1]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[2]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[3]  Jianying Hu,et al.  HMM Based On-Line Handwriting Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michael I. Jordan,et al.  An HDP-HMM for systems with state persistence , 2008, ICML '08.

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  Jin-Hyung Kim,et al.  An HMM-Based Threshold Model Approach for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[8]  Mark J. F. Gales,et al.  The Application of Hidden Markov Models in Speech Recognition , 2007, Found. Trends Signal Process..

[9]  Fazel Naghdy,et al.  Human Motion Recognition through Fuzzy Hidden Markov Model , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).