Infinite Structured Hidden Semi-Markov Models

This paper reviews recent advances in Bayesian nonparametric techniques for constructing and performing inference in infinite hidden Markov models. We focus on variants of Bayesian nonparametric hidden Markov models that enhance a posteriori state-persistence in particular. This paper also introduces a new Bayesian nonparametric framework for generating left-to-right and other structured, explicit-duration infinite hidden Markov models that we call the infinite structured hidden semi-Markov model.

[1]  R. Jarrett.  A note on the intervals between coal-mining disasters , 1979 .

[2]  Biing-Hwang Juang,et al.  Mixture autoregressive hidden Markov models for speech signals , 1985, IEEE Trans. Acoust. Speech Signal Process..

[3]  Kin Hong Wong,et al.  Script recognition using hidden Markov models , 1986, ICASSP '86. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[5]  J. Sethuraman.  A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[6]  A. Krogh.  Hidden Markov Models in Computational Biology Applications to Protein Modeling UCSC CRL , 1993 .

[7]  Mark J. F. Gales,et al.  The theory of segmental hidden Markov models , 1993 .

[8]  J. Hartigan,et al.  A Bayesian Analysis for Change Point Problems , 1993 .

[9]  D. Haussler,et al.  Hidden Markov models in computational biology. Applications to protein modeling. , 1993, Journal of molecular biology.

[10]  Donald O. Tanguay.  Hidden Markov models for gesture recognition , 1995 .

[11]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[12]  Mari Ostendorf,et al.  From HMM's to segment models: a unified view of stochastic modeling for speech recognition , 1996, IEEE Trans. Speech Audio Process..

[13]  Frederick Jelinek,et al.  Statistical methods for speech recognition , 1997 .

[14]  S. Chib.  Estimation and comparison of multiple change-point models , 1998 .

[15]  T. Rydén,et al.  Stylized Facts of Daily Return Series and the Hidden Markov Model , 1998 .

[16]  Aaron F. Bobick,et al.  Parametric Hidden Markov Models for Gesture Recognition , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Lancelot F. James,et al.  Gibbs Sampling Methods for Stick-Breaking Priors , 2001 .

[18]  Carl E. Rasmussen,et al.  Factorial Hidden Markov Models , 1997 .

[19]  Kevin P. Murphy.  Hidden semi-Markov models ( HSMMs ) , 2002 .

[20]  P. Kantor.  Foundations of Statistical Natural Language Processing , 2001, Information Retrieval.

[21]  Shunzheng Yu,et al.  Practical implementation of an efficient forward-backward algorithm for an explicit-duration hidden Markov model , 2006, IEEE Transactions on Signal Processing.

[22]  Michael I. Jordan,et al.  Hierarchical Dirichlet Processes , 2006 .

[23]  P. Fearnhead,et al.  On‐line inference for multiple changepoint problems , 2007 .

[24]  Kevin P. Murphy,et al.  Modeling changing dependency structure in multivariate time series , 2007, ICML '07.

[25]  Heiga Zen,et al.  Hidden Semi-Markov Model Based Speech Synthesis System , 2006 .

[26]  Yee Whye Teh,et al.  Beam sampling for the infinite hidden Markov model , 2008, ICML '08.

[27]  Yee Whye Teh,et al.  The Infinite Factorial Hidden Markov Model , 2008, NIPS.

[28]  Yee Whye Teh,et al.  Spatial Normalized Gamma Processes , 2009, NIPS.

[29]  Matthew J. Johnson,et al.  The Hierarchical Dirichlet Process Hidden Semi-Markov Model , 2010, UAI.

[30]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[31]  Kenneth L. Shepard,et al.  Random telegraph noise in 45-nm CMOS: Analysis using an on-chip test and measurement system , 2010, 2010 International Electron Devices Meeting.

[32]  Michael I. Jordan,et al.  A Sticky HDP-HMM With Application to Speaker Diarization , 2009, 0905.2592.

[33]  C. Yau,et al.  Bayesian non‐parametric hidden Markov models with applications in genomics , 2011 .

[34]  Frank D. Wood,et al.  Inference in Hidden Markov Models with Explicit State Duration Distributions , 2012, IEEE Signal Processing Letters.

[35]  D. Titterington,et al.  Bayesian inference in hidden Markov modelsthrough reversible jump Markov chain Monte , 2022 .